Thank a lot! I'll give it a read

Hey guys! I'm having dependency issues in my CI (takes forever to resolve dependency > 1 hour) ever since I added kedro viz. Does this requirements.txt have any issues?

It shouldn't, you can use

kedro build-reqs

or

pip-compile

to pre resolve your deps

Hi all, I got this error when running the pipeline:

DataSetError: Failed while saving data to data set ImageDataSet(filepath=C:/Users/user/Documents/my_project/data/02_intermediate/xxx.png, protocol=file, save_args={}).
cannot write mode CMYK as PNG

. I am trying to save a .jpg image as png. It works for some .jpg, but other doesn't. Does anyone know how I can solve this?

Hey, so I have a couple datasets (all images, with a custom dataset for pdfs, and the other formats are jpg, png, and tiff) and I am trying to save them all as pngs and then store them under the same catalog

(02_intermediate)

after loading them from the

(01_raw)

. When I try to run a function that combines, "glues", the raw datasets into the

(02_intermediate)

it gives this error:

OutputNotUniqueError: Output(s) ['label_images_int_jpg'] are returned by more than one nodes. Node outputs must be unique.

This is the catalog for reference

Hey guys, good afternoon, so, I'm fresh into kedro, just finished the docs spaceflight tutorial and watch the @datajoely video doing the same thing and talking about kedro. With that in mind, I'm about to start some experimentations of my own and I would like to hear from you any more tips, and if possible, I do have in mind to work with GCP and learn about unit tests, so if any of your could share any extra tips, links, docs or any good material I would appreciate that...

Hello, you probably have your source images in different color spaces, some are in RGB and others in CMYK. maybe you should try to convert your images into rgb when needed before saving them?

It worked! Thanks for your help!

I created a custom loader to convert it to RGB

@Thiago Poletto Welcome to the kedro community!

Thank you @noklam

Is there a recommended way to reuse nodes/utility functions between different pipelines? micropackaging feels a little overkill for just 3 or so functions

also 2nd question: is there a way to directly call a function that defines a node from a jupyter lab session?

lol for the 2nd question I just did

from {{project_name}}.pipelines.{{pipeline_name}}.nodes import *

and it seemed to work well

What stop you from reusing a node between different pipelines?

namespaces?

Do u want to reuse the function? Or the node

function

Then it makes sense to just factor it out from the pipeline

It could be just a separate python module

Same for utils

Project.common.xxx

Then in your pipeline or notebook u just import from the module instead

is the upper level project accessible from the nodes.py file?

It's just python code, nothing kedro specific

The only specific thing is the namespace structure, but it's not relevant to this

very cool

didn't know that was a python thing

thought you could only see the files in the local folder, unless subdirectories had

__init__.py