waylonwalker08/05/2021, 3:42 AM
then make pickle or parquet datasets for each of them on the fly. They won't exist in the project's catalog but only in memory. You might even be able to use the
module to let the os clean up for you after your done.