I'm trying to think about the best way to do this: - Custom dataset with no save method (a bit like our

APIDataSet

) could work - You could maybe do things in a

before_pipeline_run

hook and

catalog.add

your new data - You could do this outside of Kedro and simply set up your catalog to expect data at a certain location