778216384475693066 #beginners-need-help

Channels

advanced-need-help

job-posting

welcome

sebaxtian

04/07/2022, 6:47 PM

Thanks !

sebaxtian

04/07/2022, 6:49 PM

@datajoely I fixed it as I mentioned here: https://github.com/kedro-org/kedro/issues/1409#issuecomment-1092053287 I'm not sure that is the right solution but its works for me

gui42

04/07/2022, 10:51 PM

Guys, sometimes when running

kedro run ...

the process hangs at the end and it doesn't finish. Any Idea on how to debug it?

datajoely

04/08/2022, 8:52 AM

Hi @gui42 it would be good to learn more. What stage fails? Can you provide some logs? Have you tried putting a

breakpoint()

within the node?

Edak

04/11/2022, 4:36 AM

Any example of a node that lazily loads and lazily saves a partitioned dataset while performing some transformations? I've seen the examples on this page (https://kedro.readthedocs.io/en/stable/data/kedro_io.html#partitioned-dataset-save) but am having trouble wrapping my head around how this is done in a node that doing a few transformation to a large dataset.

Malaguth

04/11/2022, 5:03 AM

Hello, everyone. I'm having a problem when I try to use the

TemplatedConfigLoader

through the settings file. I'm receiving the error: `dynaconf.validator.ValidationError`: Invalid value

kedro.config.templated_config.TemplatedConfigLoader

received for setting

CONFIG_LOADER_CLASS

. It must be a subclass of

kedro.config.config.ConfigLoader

. Is this validation correct? After the changes in 0.18, the superclass wouldn't be the

AbstractConfigLoader

noklam

04/11/2022, 7:00 AM

This is indeed a bug and we are aware of it. This will be fixed soon. https://github.com/kedro-org/kedro/issues/1402

datajoely

04/11/2022, 9:10 AM

Lazy partition save

Malaguth

04/11/2022, 12:46 PM

Thanks, I'll try the workaround in the issue for the time being

nd0rf1n

04/11/2022, 8:05 PM

Hello, everybody! It's my first day playing with Kedro and I'm getting the following error, when I'm running

kedro run

during the "Extend the data processing pipeline" step of the spaceflights tutorial (that's where you add the

pandas.ParquetDataset

to the catalog):

Copy code

kedro.io.core.DataSetError: Class `pandas.ParquetDataset` not found or one of its dependencies has not been installed.

Any ideas on what the issue is? I've spent quite a few hours playing around with conda environments, tried both on Windows and WSL, but I keep getting the same error. Googling around has not helped either.

Daehyun Kim

04/14/2022, 8:57 PM

Hi Team, do you have an official ML Kedro example project?

datajoely

04/14/2022, 8:59 PM

I haven't updated this to 0.18.x yet but this may be helpful https://github.com/datajoely/modular-spaceflights

Daehyun Kim

04/14/2022, 9:02 PM

thank you

Zemeio

04/18/2022, 1:19 PM

Hey guys. I am trying to create a new kedro project using the mini-kedro, but I am getting an error saying it does not exist. I am using kedro 0.8.0, with python 3.8.5. Was it just nor ported yet to 0.8.0?

Zemeio

04/18/2022, 1:20 PM

Copy code

Error: Kedro project template not found at git+https://github.com/kedro-org/kedro-starters.git. Specified tag 0.18.0. The following tags are available: 0.17.0, 0.17.1, 0.17.2, 0.17.3, 0.17.4, 0.17.5, 0.17.6, 0.17.7, 0.18.0. The aliases for the official Kedro starters are: 
- astro-airflow-iris
- mini-kedro
- pandas-iris
- pyspark
- pyspark-iris
- spaceflights

datajoely

04/18/2022, 1:20 PM

What command are you typing?

Zemeio

04/18/2022, 1:20 PM

kedro new -s mini-kedro

datajoely

04/18/2022, 1:21 PM

I think there is a chance that one has changed its name

Zemeio

04/18/2022, 1:21 PM

I saw that and tried the alias, but it didn't work as well

datajoely

04/18/2022, 1:22 PM

It's now called standalone-catalog

Zemeio

04/18/2022, 1:22 PM

Copy code

> kedro new -s standalone-datacatalog
kedro.framework.cli.utils.KedroCliError: Kedro project template not found at standalone-datacatalog. Specified tag 0.18.0. The following tags are available: . The aliases for the official Kedro starters are: 
- astro-airflow-iris
- mini-kedro
- pandas-iris
- pyspark
- pyspark-iris
- spaceflights

Run with --verbose to see the full exception
Error: Kedro project template not found at standalone-datacatalog. Specified tag 0.18.0. The following tags are available: . The aliases for the official Kedro starters are: 
- astro-airflow-iris
- mini-kedro
- pandas-iris
- pyspark
- pyspark-iris
- spaceflights

datajoely

04/18/2022, 1:22 PM

Can you try the actual git URL

datajoely

04/18/2022, 1:23 PM

I think there is a bug with the shortcut in the current code

datajoely

04/18/2022, 1:23 PM

kedro -s --help

Zemeio

04/18/2022, 1:29 PM

I don't know how to do that, kedro -s --help doesn't bring the help (neither does kedro new -s --help)

datajoely

04/18/2022, 1:30 PM

kedro new --starter=giturl --checkout=0.1.0

datajoely

04/18/2022, 1:30 PM

Sorry I'm on my phone so cant do it properly

Zemeio

04/18/2022, 1:31 PM

Oh, ok (sorry for the trouble), I will try it

Zemeio

04/18/2022, 1:34 PM

Copy code

shell
$> kedro new -s https://github.com/kedro-org/kedro-starters/tree/main/standalone-datacatalog --checkout 0.18.0
kedro.framework.cli.utils.KedroCliError: Kedro project template not found at https://github.com/kedro-org/kedro-starters/tree/main/standalone-datacatalog. Specified tag 0.18.0. The following tags are available: . The aliases for the official Kedro starters are: 
- astro-airflow-iris
- mini-kedro
- pandas-iris
- pyspark
- pyspark-iris
- spaceflights

Run with --verbose to see the full exception
Error: Kedro project template not found at https://github.com/kedro-org/kedro-starters/tree/main/standalone-datacatalog. Specified tag 0.18.0. The following tags are available: . The aliases for the official Kedro starters are: 
- astro-airflow-iris
- mini-kedro
- pandas-iris
- pyspark
- pyspark-iris
- spaceflights

Zemeio

04/18/2022, 1:34 PM

Did not work