Goss
09/26/2022, 5:33 PMkedro.io.data_catalog - INFO - Loading data from 'data_science.candidate_modelling_pipeline.metrics' (MemoryDataSet)...
Since this is Kubeflow and MemoryDataset cannot be used, this is not surprising.
I observe that data_science.candidate_modelling_pipeline.metrics
is not mentioned in catalog.yml. Is the fix to simply modify catalog.yml to add in this dataset similar to the way data_science.active_modelling_pipeline.metrics
is already in there? As in, was this just an oversight? In which case, I would have separate output files for active and cadidate metrics...