Hello! I have multiple time series with exogenous params. I have one dataset for each time serie, and would like to create one model for each dataset, following the same pipeline. Is it possible to easily do it with kedro? 🤔 Thanks for your response :)
d
datajoely
01/05/2022, 5:22 PM
Yes! we are currently updating our docs to better explain this feature
here is an example how we use the same pipeline twice, using diff modelling techniques
w
Wit
04/24/2022, 7:46 PM
Can modular pipelines be data driven? Taking the time series example - I want to build models for each time series but time series ids are in db and change in time. For example in a retail chain some products are removed or added.
d
datajoely
04/25/2022, 9:17 AM
so yes, you're able to do so - but it does harm reproducibility
As a team we don't mind dynamic pipelines, but believe in order to make them maintainable the inputs can be dynamic - but the structure should be static
The other way you can do this is loading/saving some checkpoints to another dataset to retain some idea of 'state'
happy to help you think through the problem
w
Wit
04/28/2022, 7:47 AM
Thanks for reply. I know it harms reproducibility. I personally prefer have one pipeline and run it many times with different inputs.