https://kedro.org/ logo
Title
w

waylonwalker

08/28/2021, 5:22 PM
I am playing with
kedro pipeline package/pull
. TLDR, how do I update pulled pipelines?
kedro new # proj1
kedro new # proj2

cd proj1
kedro pipeline create newpipe
# make some nodes
kedro pipeline package newpipe
cd src/dist
python -m http.server
# hosting dist directory at 8000

# new terminal
cd proj2
kedro pipeline pull http://localhost:8000/newpipe-0.1-py3-none-any.whl
At this point everything is working. My question is how do I update this pipeline
cd proj1
# update newpipe code
# update version in __init__.py
kedro pipeline package newpipe

cd proj2
kedro pipeline pull http://localhost:8000/newpipe-0.2-py3-none-any.whl
❯ kedro pipeline pull http://localhost:8000/newpipe-0.2-py3-none-any.whl

2021-08-28 12:11:02,473 - root - INFO - Registered CLI hooks from 1 installed plugin(s): kedro-telemetry-0.1.2
2021-08-28 12:11:02,476 - kedro_telemetry.plugin - INFO - You have opted into product usage analytics.
HTTPFileSystem requires "requests" and "aiohttp" to be installed
Trying to use 'pip download'...
/proj2/.venv/bin/python -m pip download --no-deps --dest /tmp/tmpucm6o5r2 http://localhost:8000/newpipe-0.2-py3-none-any.whl
Collecting newpipe==0.2
  Downloading http://localhost:8000/newpipe-0.2-py3-none-any.whl (6.0 kB)
Saved /tmp/tmpucm6o5r2/newpipe-0.2-py3-none-any.whl
Successfully downloaded newpipe
Creating `/proj2/conf/base/parameters`:
  Creating `/proj2/conf/base/parameters/newpipe.yml`: SKIPPED (already exists)
Creating `/proj2/src/tests/pipelines/newpipe/__init__.py`: SKIPPED (already exists)
Creating `/proj2/src/tests/pipelines/newpipe/test_pipeline.py`: SKIPPED (already exists)
Creating `/proj2/src/proj2/pipelines/newpipe/nodes.py`: SKIPPED (already exists)
Creating `/proj2/src/proj2/pipelines/newpipe/README.md`: SKIPPED (already exists)
Creating `/proj2/src/proj2/pipelines/newpipe/__init__.py`: SKIPPED (already exists)
Creating `/proj2/src/proj2/pipelines/newpipe/pipeline.py`: SKIPPED (already exists)