https://kedro.org/ logo
#beginners-need-help
Title
# beginners-need-help
z

Zemeio

04/06/2022, 9:48 PM
n

noklam

04/06/2022, 10:10 PM
I think this is because you are using namespace in your pipeline, so
metric
should be
data_science.active_modelling.metric
. You are seeing MemoryDataSet because the kedro cannot find the corresponding entry, thus it thinks it is a in memory variable. @User I think when we update the spaceflights tutorial to namespace pipeline, the section after that has not been updated to align with it.
You probably created this repository yesterday, we have some fixed this morning. Dataset should be
namespaced
, which essentially follows a pattern of
namespace
.
output_names
, you can also have nested namespace like
namespace
.
namespace
.
some_data
https://github.com/kedro-org/kedro-starters/blob/main/spaceflights/%7B%7B%20cookiecutter.repo_name%20%7D%7D/conf/base/catalog.yml
z

Zemeio

04/06/2022, 10:14 PM
So it should always be namespaced, no exceptions?
n

noklam

04/06/2022, 10:15 PM
It depends on your use case, the main usage of namespace is when you have a lot of pipeline you start to have name collision
z

Zemeio

04/06/2022, 10:15 PM
Or, only when you specify the namespace in the pipeline?
n

noklam

04/06/2022, 10:15 PM
you can always use a namespace=None, which just fallback to a normal pipeline
d

datajoely

04/06/2022, 10:22 PM
Yes I think the exp tracking docs went in the same time as the namespace update and aren't aligned
z

Zemeio

04/06/2022, 10:22 PM
I got a different error now, after namespacing, so it was the namespace problem.
please try to copy this
catalog.yml
, sorry for all these error we will have the documentation update soon. Also keep the namespace as it is.
z

Zemeio

04/06/2022, 10:25 PM
The companies column is still saved on MemoryDataSet using that, is that intended? When I namespaced the MemoryDataSet it gave me an error
n

noklam

04/06/2022, 10:31 PM
I have updated the gist,
companies_columns
should be
data_processing.companies_columns
instead. Please update the catalog again.
z

Zemeio

04/06/2022, 10:38 PM
It works, but kedro viz is not updated with the metrics values
The data is in the folders now actually, so if it is out of topic we can move to a new one, or I can do some digging.
n

noklam

04/06/2022, 10:49 PM
Thank you for staying with the tutorial, we will make sure the documentation is updated soon. I don't have a quick idea what's happened with viz, if it's not working, feel free to raise an Issue on Github or discord.
z

Zemeio

04/06/2022, 10:50 PM
Ok, I will try to do some digging before I raise an issue, thank you for your time/help!
(if anyone finds this topic) this is the change that solved the namespacing problem: https://github.com/Zemeio/kedro_experiment/commit/44631b1fa2de77a5541b3be7ce3cfd91f6a19465
n

noklam

04/07/2022, 8:08 AM
Are you able to solve the viz problem?
z

Zemeio

04/07/2022, 11:15 AM
Sorry, I went to work and had a lot of overtime, so I wasn't able to touch it yet.
n

noklam

04/07/2022, 11:46 AM
Rough day! No worries I will try to see if I can reproduce the issue.
z

Zemeio

04/07/2022, 1:26 PM
Were you able to reproduce? I checked my session store and it doesn't have any relevant information, I don't know if it should have.
n

noklam

04/07/2022, 1:27 PM
Sorry, I haven't started yet. I am working on something, but this will be next item to work on.
z

Zemeio

04/07/2022, 1:28 PM
Sorry for disturbing, I will sleep soon, tomorrow if you haven't been able to find anything I will continue digging.
n

noklam

04/07/2022, 2:08 PM
I wasn't able to reproduce the issue. This is the repo I am using with kedro==0.18.0 https://github.com/noklam/kedro_viz_demo
z

Zemeio

04/07/2022, 9:41 PM
Weird, I cloned your repo, created a venv with my python 3.8.5, ran pip install on your requirements, and ran the application, after that I used viz and the same thing happened. I am running on windows, maybe I will dockerize and see if the problem happens on linux?
n

noklam

04/07/2022, 9:43 PM
Just to confirm, all the files are there but nothing rendered?
Could you do a inspect with chrome developer tool to see if there are errors
z

Zemeio

04/07/2022, 9:50 PM
The files under data are created just fine
n

noklam

04/07/2022, 9:51 PM
What's your viz version?
I am trying to replicate this on a Window machine...
Can you raise an issue on https://github.com/kedro-org/kedro-viz ? It seems to be a bug, it doesn't show up on my Window machine either.
z

Zemeio

04/07/2022, 10:51 PM
I got it working using docker, so maybe it is a windows thing. Do you want me to share the dockerfile?
n

noklam

04/07/2022, 10:53 PM
That would be great!
I spent about 5 minutes building it, so please don't judge me for simplicity haha, if you prefer I can build a proper docker, but I plan on making documentation on how to do proper kedro containers in a different way to contribute to the community
n

noklam

04/07/2022, 11:13 PM
Awesome! This is great.
d

datajoely

04/08/2022, 8:27 AM
Thank you for your help debugging this @Zemeio
z

Zemeio

04/08/2022, 9:19 AM
It was my pleasure = ).
3 Views