Lets say for simplicity, I have a pipeline with a ...
# advanced-need-help
s
Lets say for simplicity, I have a pipeline with a single node, which inputs dataset A and output dataset B. How to handle a situation where I want to run this pipeline each day (with airflow for example) and I want dataset B of the previous day as input (as dataset A) in the new day? In the ideal scenario I'd like to have a single versioned dataset, where I overwrite the input dataset with a new version. However, kedro doesnt allow the same dataset as input and output in a single node.