Ok, created a temporary repo for that https://gith...
# beginners-need-help
z
n
I think this is because you are using namespace in your pipeline, so
metric
should be
data_science.active_modelling.metric
. You are seeing MemoryDataSet because the kedro cannot find the corresponding entry, thus it thinks it is a in memory variable. @User I think when we update the spaceflights tutorial to namespace pipeline, the section after that has not been updated to align with it.
You probably created this repository yesterday, we have some fixed this morning. Dataset should be
namespaced
, which essentially follows a pattern of
namespace
.
output_names
, you can also have nested namespace like
namespace
.
namespace
.
some_data
https://github.com/kedro-org/kedro-starters/blob/main/spaceflights/%7B%7B%20cookiecutter.repo_name%20%7D%7D/conf/base/catalog.yml
z
So it should always be namespaced, no exceptions?
n
It depends on your use case, the main usage of namespace is when you have a lot of pipeline you start to have name collision
z
Or, only when you specify the namespace in the pipeline?
n
you can always use a namespace=None, which just fallback to a normal pipeline
d
Yes I think the exp tracking docs went in the same time as the namespace update and aren't aligned
z
I got a different error now, after namespacing, so it was the namespace problem.
please try to copy this
catalog.yml
, sorry for all these error we will have the documentation update soon. Also keep the namespace as it is.
z
The companies column is still saved on MemoryDataSet using that, is that intended? When I namespaced the MemoryDataSet it gave me an error
n
I have updated the gist,
companies_columns
should be
data_processing.companies_columns
instead. Please update the catalog again.
z
It works, but kedro viz is not updated with the metrics values
The data is in the folders now actually, so if it is out of topic we can move to a new one, or I can do some digging.
n
Thank you for staying with the tutorial, we will make sure the documentation is updated soon. I don't have a quick idea what's happened with viz, if it's not working, feel free to raise an Issue on Github or discord.
z
Ok, I will try to do some digging before I raise an issue, thank you for your time/help!
(if anyone finds this topic) this is the change that solved the namespacing problem: https://github.com/Zemeio/kedro_experiment/commit/44631b1fa2de77a5541b3be7ce3cfd91f6a19465
n
Are you able to solve the viz problem?
z
Sorry, I went to work and had a lot of overtime, so I wasn't able to touch it yet.
n
Rough day! No worries I will try to see if I can reproduce the issue.
z
Were you able to reproduce? I checked my session store and it doesn't have any relevant information, I don't know if it should have.
n
Sorry, I haven't started yet. I am working on something, but this will be next item to work on.
z
Sorry for disturbing, I will sleep soon, tomorrow if you haven't been able to find anything I will continue digging.
n
I wasn't able to reproduce the issue. This is the repo I am using with kedro==0.18.0 https://github.com/noklam/kedro_viz_demo
z
Weird, I cloned your repo, created a venv with my python 3.8.5, ran pip install on your requirements, and ran the application, after that I used viz and the same thing happened. I am running on windows, maybe I will dockerize and see if the problem happens on linux?
n
Just to confirm, all the files are there but nothing rendered?
Could you do a inspect with chrome developer tool to see if there are errors
z
The files under data are created just fine
n
What's your viz version?
I am trying to replicate this on a Window machine...
Can you raise an issue on https://github.com/kedro-org/kedro-viz ? It seems to be a bug, it doesn't show up on my Window machine either.
z
I got it working using docker, so maybe it is a windows thing. Do you want me to share the dockerfile?
n
That would be great!
I spent about 5 minutes building it, so please don't judge me for simplicity haha, if you prefer I can build a proper docker, but I plan on making documentation on how to do proper kedro containers in a different way to contribute to the community
n
Awesome! This is great.
d
Thank you for your help debugging this @Zemeio
z
It was my pleasure = ).
3 Views