Channels
advanced-need-help
job-posting
welcome
announcements
resources
plugins-integrations
beginners-need-help
random
introductions
Powered by
#beginners-need-help
Title
# beginners-need-help
d
datajoely
03/11/2022, 7:39 AM
So since that's sort of an IO step I would recommend you define a custom dataset that only provides and implementation for load not a save operation
https://kedro.readthedocs.io/en/stable/07_extend_kedro/03_custom_datasets.html
You may want to take inspiration from the APIDataSet which look a bit like this
https://kedro.readthedocs.io/en/stable/_modules/kedro/extras/datasets/api/api_dataset.html#APIDataSet
Post