Title
#beginners-need-help
waylonwalker

waylonwalker

08/05/2021, 1:10 PM
@User would it make sense for kedro to have a semi-permanant dataset that sits between MemoryDatasets and the others, one that just pickles to a tmp file? Mixing this with my issue to change the default dataset would be an interesting prospect. Since settings.py is a python script you could set up standards for your team to change base on env variables. Then its pretty much automatically doing what is best for your project in both prod and dev modes. https://github.com/quantumblacklabs/kedro/issues/849