https://kedro.org/ logo
#advanced-need-help
Title
# advanced-need-help
s

Seth

10/04/2022, 12:11 PM
Lets say for simplicity, I have a pipeline with a single node, which inputs dataset A and output dataset B. How to handle a situation where I want to run this pipeline each day (with airflow for example) and I want dataset B of the previous day as input (as dataset A) in the new day? In the ideal scenario I'd like to have a single versioned dataset, where I overwrite the input dataset with a new version. However, kedro doesnt allow the same dataset as input and output in a single node.