datajoely
03/08/2022, 1:39 PMwilliamc
03/08/2022, 2:38 PMkedro new
supposed to create a cli.py
file in a new project by default?datajoely
03/08/2022, 2:39 PMdatajoely
03/08/2022, 2:40 PMwilliamc
03/08/2022, 2:41 PMcli.py
file is mentioned in the relevant docs. Is there a sample I can use to guide myself?datajoely
03/08/2022, 2:42 PMwilliamc
03/08/2022, 2:42 PMSolarer
03/09/2022, 2:45 PMpip install kedro -U
and created a new kedro project kedro new
and created a dedicated environment using venv
. After activating the new environment and running kedro build-reqs
the process fails because the restrictions for jupyter_client overlap and it cannot find a version that satisfies the requirements:
> Could not find a version that matches jupyter_client<7.0,=4.1,>=5.1,>=5.3.4,>=6.1.1,>=7.0.0 (from -r C:\Users\Jan\Documents\myprojects\analytics\src\requirements.in (line 8))
Any idea how to resolve this?Solarer
03/09/2022, 2:56 PMpip install -r src/requirements.txt
seems to work fine. Only kedro build-reqs
keeps failing...datajoely
03/09/2022, 3:25 PMjupyter_client
library changed something two days ago which is causing this . We've merged a fix here
https://github.com/kedro-org/kedro/pull/1322datajoely
03/09/2022, 3:26 PMdatajoely
03/09/2022, 3:26 PMnoestl
03/09/2022, 10:13 PMdatajoely
03/09/2022, 10:23 PMkedro build-docs
that's one of the command available in a project directory:datajoely
03/09/2022, 10:25 PMmake build-docs
will generate what goes onto http://kedro.readthedocs.io/beats-like-a-helix
03/10/2022, 11:50 AMkedro build-reqs
is still failing for me after changing to jupyter_client>=5.1, <8.0
. Is there anything else I'm supposed to do?datajoely
03/10/2022, 11:52 AMbeats-like-a-helix
03/10/2022, 12:03 PMNo requirements.in found. Copying contents from requirements.txt...
/Users/jordan/mambaforge/envs/test-env/bin/python3.8 -m piptools compile -q /Users/jordan/Documents/University/4/test_project/src/requirements.in
Could not find a version that matches jupyter_client<7.0,<8.0,>=4.1,>=5.1,>=5.3.4,>=6.1.1,>=7.0.0 (from -r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 8))
Tried: 4.0.0, 4.0.0, 4.0.0, 4.1.0, 4.1.0, 4.1.1, 4.1.1, 4.1.1, 4.2.0, 4.2.0, 4.2.0, 4.2.1, 4.2.1, 4.2.1, 4.2.2, 4.2.2, 4.2.2, 4.3.0, 4.3.0, 4.3.0, 4.4.0, 4.4.0, 5.0.0, 5.0.0, 5.0.1, 5.0.1, 5.1.0, 5.1.0, 5.2.0, 5.2.0, 5.2.1, 5.2.1, 5.2.2, 5.2.2, 5.2.3, 5.2.3, 5.2.4, 5.2.4, 5.3.0, 5.3.0, 5.3.1, 5.3.1, 5.3.2, 5.3.2, 5.3.3, 5.3.3, 5.3.4, 5.3.4, 5.3.5, 5.3.5, 6.0.0, 6.0.0, 6.1.0, 6.1.0, 6.1.1, 6.1.1, 6.1.2, 6.1.2, 6.1.3, 6.1.3, 6.1.5, 6.1.5, 6.1.6, 6.1.6, 6.1.7, 6.1.7, 6.1.8, 6.1.8, 6.1.9, 6.1.9, 6.1.10, 6.1.10, 6.1.11, 6.1.11, 6.1.12, 6.1.12, 6.1.13, 6.1.13, 6.2.0, 6.2.0, 7.0.0, 7.0.0, 7.0.1, 7.0.1, 7.0.2, 7.0.2, 7.0.3, 7.0.3, 7.0.4, 7.0.4, 7.0.5, 7.0.5, 7.0.6, 7.0.6, 7.1.0, 7.1.0, 7.1.1, 7.1.1, 7.1.2, 7.1.2
Skipped pre-versions: 7.0.0a0, 7.0.0a0, 7.0.0a1, 7.0.0a1, 7.0.0rc0, 7.0.0rc0, 7.0.0rc1, 7.0.0rc1
beats-like-a-helix
03/10/2022, 12:04 PMThere are incompatible versions in the resolved dependencies:
jupyter_client<8.0,>=5.1 (from -r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 8))
jupyter-client>=4.1 (from qtconsole==5.2.2->jupyter==1.0.0->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 7))
jupyter-client>=7.0.0 (from jupyter-console==6.4.3->jupyter==1.0.0->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 7))
jupyter-client>=6.1.1 (from jupyter-server==1.13.5->jupyterlab==3.3.1->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 9))
jupyter-client>=5.3.4 (from notebook==6.4.8->jupyter==1.0.0->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 7))
jupyter-client<8.0 (from ipykernel==6.9.1->jupyter==1.0.0->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 7))
jupyter-client<7.0,>=5.1 (from kedro==0.17.7->-r /Users/jordan/Documents/University/4/test_project/src/requirements.in (line 10))
deepyaman
03/10/2022, 1:08 PMjupyter-console<6.4.3 # 6.4.3 requires jupyter_client>=7.0
in your src/requirements.txt
(bumping the jupyter_client
range yourself isn't feasible since the Kedro dependency will still restrict it until a new release).datajoely
03/10/2022, 1:10 PMbeats-like-a-helix
03/10/2022, 5:24 PMmscrts
03/11/2022, 7:36 AMdatajoely
03/11/2022, 7:39 AMWolVez
03/15/2022, 2:33 PMdatajoely
03/15/2022, 2:34 PMMemoryDataSet
out of the box - what else would you like?WolVez
03/15/2022, 2:35 PMdatajoely
03/15/2022, 2:59 PMMemoryDataSet
and (2) you could tweak to get it to return the last dataset too
https://kedro.readthedocs.io/en/0.17.2/06_nodes_and_pipelines/04_run_a_pipeline.html#custom-runnersWolVez
03/15/2022, 3:01 PMdatajoely
03/15/2022, 3:59 PMpdb
or ipdb
debuggers to achieve the same thingdatajoely
03/15/2022, 3:59 PMpdb
or ipdb
debuggers to achieve the same thing