avan-sh04/21/2022, 3:18 PM
datajoely04/21/2022, 3:42 PM
merged on the CLI side
noklam04/21/2022, 3:44 PM
Rafał04/21/2022, 9:37 PM
Unfortunately all the documentation says nothing about
and how to initialize it. Moreover, the documentation code gives error since calling
ErrorMessage "TypeError: run() missing 1 required positional argument: 'hook_manager'
datajoely04/21/2022, 9:44 PM
Rafał04/21/2022, 10:21 PM
datajoely04/21/2022, 10:22 PM
noklam04/21/2022, 10:27 PM
instead of calling runner directly. If you absolutely need the runner for some reason, this is a hack work for 0.18.0 but there is no guarantee this will continue to work for coming version.
from kedro.framework.session.session import _create_hook_manager print(runner.run(greeting_pipeline, data_catalog, _create_hook_manager())
Rafał04/22/2022, 5:34 AM
. It is just that I have found in documentation that "Running pipeline" should create the runner first.
noklam04/22/2022, 8:07 AM
eleonora.picca04/22/2022, 10:49 AM
from kedro.framework.hooks import _create_hook_manager
but I would like to use session. Any help on how I could get or create the session to use for the
print(runner.run(greeting_pipeline, data_catalog, _create_hook_manager())
command? Is there a way to pass to the session a specific datacatalog? (I am using this to perform some tests and I created a fake data catalog to do this) Thank you in advance!
noklam04/22/2022, 2:43 PM
in interactive mode (Jupyter/Ipython), the most common way to interact with kedro is via the CLI,
which execute the pipeline. Under the hood, it will create all necessary components like
for you. To start a new kedro project, you would do
. You can do
which will create a template project for you with more advance kedro features. Then you can run a pipeline via
kedro new --starter=spaceflights
. The tutorial above will guide you step by step how to creating these project in practice.
eleonora.picca04/22/2022, 3:18 PM
has the DataCatalog argument, while
doesn't, but in this case would be useful to be able to pass a specific DataCatalog. Thank you again for your time
noklam04/22/2022, 3:46 PM
doesn't have the data catalog argument because it is managed by the session itself.
eleonora.picca04/22/2022, 8:33 PM
noklam04/22/2022, 8:56 PM
? or optionally
kedro run --env=test
kedro run --env=test --pipeline=TARGET_PIPELINE
Barros04/23/2022, 1:58 PM
How can I make the module
DataSetError: An exception occurred when parsing config for DataSet `val_csv_glebas`: Class `local_pipeline.extras.io.vector_datasets.ShpVectorDataset` not found or one of its dependencies has not been installed.
be known to DataCatalog class?
datajoely04/23/2022, 2:00 PM
it will be registered for you
kedro jupyter notebook
Barros04/23/2022, 2:03 PM
user04/25/2022, 9:12 AM
Flow04/26/2022, 2:13 PM
as part of the
file. Is there any good example on how that actually looks like? I guess what I am trying to figure out is once it's there do people add it to
of setup.py and then somehow change the
variable in settings.py or are there better approaches. Use case is an airflow deployment
Flow04/26/2022, 2:33 PM
Rafał04/26/2022, 3:12 PM
datajoely04/26/2022, 3:15 PM
Rafał04/26/2022, 3:40 PM
avan-sh04/26/2022, 4:12 PM
williamc04/26/2022, 7:30 PM
datajoely04/26/2022, 7:30 PM
williamc04/26/2022, 7:47 PM
williamc04/26/2022, 7:47 PM