Thanks for the suggestion, but not really. If I d...
# beginners-need-help
v
Thanks for the suggestion, but not really. If I dig deep I can find the something related to versioning in a dataset as
catalog._data_sets['labels']._version
--> Version(load=None, save='2022-05-30T19.18.04.963Z') but that's not useful and wouldn't like accessing it like that anyway. The save
version
is admittedly there (same for all outputs).
n
Are you trying to log the version of datasets that being save/load?
v
The more tricky part seems to be the load part.
n
Could you explain why it's trickier?
Ah, I guess it is because it is only determined at runtime since when no version is defined it will just pick the latest
v
I don't know exactly how kedro does it but yeah, that's essentially why. I guess it's not saved anywhere so that I can access it in the hook objects. If I could make the same calls that are used at load time, maybe that's a way.
n
Fair enough
I think hook is the most reasonable approach
Let me see if I can provide an implementation
v
for what it's worth, I'm thinking I'm not the only one who could find it useful 😉
n
Yeah, it would not be unreasonable to log it natively in session store to enrich kedro experiment tracking capability
I will get back to you.
https://github.com/kedro-org/kedro/issues/1580 It may be a disappointing answer, I thought it is doable but turns out to be quite difficult. I open an Issue here.
v
Ok, hope it gets merged at some point. Thanks for the help!