datajoely
10/15/2021, 8:35 AMkedro pipeline create <pipeline_name>
in a new project to see the folder structure in action.
The clever part is articulated in this example:
python
final_pipeline = Pipeline(
[
pipeline(cook_pipeline, outputs={"grilled_meat": "new_name"}),
pipeline(lunch_pipeline, inputs={"food": "new_name"}),
node(...),
...,
]
)
Both cook_pipeline
and lunch_pipeline
are existing modular pipeline, but by using the pipeline
method (not class) you are able to create an instance of them where you can swap catalog inputs/outputs for them