Title
#beginners-need-help
hoodie

hoodie

01/05/2022, 5:21 PM
Hello! I have multiple time series with exogenous params. I have one dataset for each time serie, and would like to create one model for each dataset, following the same pipeline. Is it possible to easily do it with kedro? 🤔 Thanks for your response 😃
datajoely

datajoely

01/05/2022, 5:22 PM
Yes! we are currently updating our docs to better explain this feature
5:22 PM
and follow my example project here https://github.com/datajoely/modular-spaceflights
5:23 PM
You can reuse the same pipeline multiple times with different inputs
5:23 PM
here is an example how we use the same pipeline twice, using diff modelling techniques
w

Wit

04/24/2022, 7:46 PM
Can modular pipelines be data driven? Taking the time series example - I want to build models for each time series but time series ids are in db and change in time. For example in a retail chain some products are removed or added.
datajoely

datajoely

04/25/2022, 9:17 AM
so yes, you're able to do so - but it does harm reproducibility
9:17 AM
As a team we don't mind dynamic pipelines, but believe in order to make them maintainable the inputs can be dynamic - but the structure should be static
9:18 AM
The other way you can do this is loading/saving some checkpoints to another dataset to retain some idea of 'state'
9:18 AM
happy to help you think through the problem
w

Wit

04/28/2022, 7:47 AM
Thanks for reply. I know it harms reproducibility. I personally prefer have one pipeline and run it many times with different inputs.