Also it just occurred to me transcoding may be useful for your situation https://kedro.readthedocs.io/en/stable/05_data/01_data_catalog.html#transcoding-datasets