Rafał
04/26/2022, 10:08 AMkedro run -c config.yml
.
I see the official documentation says nothing about --from-nodes
. I am afraid I have a case that kedo 0.18.0
ignores my option provided in run.from-nodes
noklam
04/26/2022, 11:03 AMlv
structure?Rafał
04/26/2022, 12:26 PMnoklam
04/26/2022, 12:35 PMload_version:
- dataset_name:version_name
Rafał
04/26/2022, 3:02 PMsession = KedroSession.create(
metadata, env=config["run"].get("env"), extra_params=params
)
session.run(
pipeline_name=config["run"]["pipeline"],
node_names=config["run"].get("node-names"),
from_nodes=config["run"].get("from-nodes"),
to_nodes=config["run"].get("to-nodes"),
from_inputs=config["run"].get("from-inputs"),
to_outputs=config["run"].get("to-outputs"),
)
session.close()
KedroSession.create
or runs it by run -c config.yaml
Now the code expect Iterable
but run -c config.yml
expects strings in the config file.noklam
04/26/2022, 3:42 PMRafał
04/26/2022, 6:40 PMsession.run( **kwargs )
are expected to be Iterable
. I just wanted to mention that providing strings like node1,node2
is Iterable, too.
But kedro
session will try to iterate it through single characters. Thus, one should remember to split strings with ,
(comma).noklam
04/26/2022, 6:41 PMRafał
04/26/2022, 6:47 PMextra_params=params
I actually iterate params
from some iterable taken from config.extra_params_list
This is my own modification of kedro run -c config.yml
in order to run the single pipeline (given by config.run
) multiple times 😉
with different params
, namely taken from extra_params_list
😉
I know it is tricky, but I didn't figure out better way to run the single pipeline with list of params.noklam
04/26/2022, 6:51 PMRafał
04/26/2022, 8:03 PM