Or at least the virtual environment that airflow i...
# advanced-need-helpd
datajoely
07/15/2022, 8:03 AMOr at least the virtual environment that airflow is looking for
a
arum
07/15/2022, 8:05 AMi haven't created any venv as it isn't anywhere in the docs https://kedro.readthedocs.io/en/stable/deployment/airflow_astronomer.html#deployment-process
d
datajoely
07/15/2022, 8:05 AMRight, but if airflow cant import kedro it cant be installed
datajoely
07/15/2022, 8:06 AMAt least at the location it's looking for
datajoely
07/15/2022, 8:06 AMIf you're able to run terminal to do
pipe freezewhich pythona
arum
07/15/2022, 8:08 AM$ which python
/Users/sl/mambaforge-pypy3/bin/python
arum
07/15/2022, 8:15 AMairflow is run in docker by astro, how can we make kedro available to airflow
d
datajoely
07/15/2022, 8:17 AMAnd was kedro in the pip freeze?
a
arum
07/15/2022, 8:32 AMyes
arum
07/15/2022, 8:32 AM Copy code
kedro==0.18.1
kedro-airflow==0.5.0
kedro-docker==0.3.0
kedro-telemetry==0.2.1
kedro-viz==4.7.0arum
07/15/2022, 8:46 AMwell, i have run the docker container in bash and did a pip freeze, which does not have kedro
arum
07/15/2022, 9:48 AMso here is what i could debug, there is no kedro available with
FROM quay.io/astronomer/ap-airflow:2.0.0-buster-onbuildarum
07/15/2022, 9:48 AMpip freeze in the docker image did not have kedro
arum
07/15/2022, 9:49 AMsolutions 1) i have added RUN pip install kedro to the Docker and it worked
arum
07/15/2022, 9:49 AM2) I have tried the latest image
FROM quay.io/astronomer/ap-airflow:2.3.3-onbuildarum
07/15/2022, 9:49 AMand this also worked
arum
07/15/2022, 9:50 AMWould be good to update the docs as it could save time for others
arum
07/15/2022, 10:01 AMFYI, also the demo dag new-kedro-project isn't successful
arum
07/15/2022, 10:02 AMthe input variables defined in catalog.yml are not the same as those used in pipeline.py and the demo DAG fails