thinking...

if you're able to share the code I can get it working?

oh god thats so overly helpful haha

yeah I might not get a chance tonight

let me play around with some of the tools you've given

but I can do it some point in the next 24 hours

and see if i cant resolve, i'll look into the no nodes pipeline bit and see if it changes it

i can load csv's just fine

if that helps at all

and i'll cross my T's and dot my I's on the spaceflight as well 🙂

id hate to waste your time

okay in

pipeline_registry.py

you can just remove the keys from the dictionary

its not a problem!

I'm going to create a thread so capture this topic though

awesome

and if i figure it out i'll report back 🙂

plugging right along 🙂 is there a preferred method for saving 3d numpy arrays to be called later in the pipeline?

PickleDataSet

is probably the best shout - potentially with the

joblib

backend

also note you don't have to save if you're using things later in the pipeline as it will automatically be handled as a

MemoryDataSet

gotcha, cool!

Can items in

global.yml

refer to other items in the same file for templating?

date: 2022-02-02
somefile: filename_${date}.txt

I'm not actually sure - no one has ever asked that before.

after looking at the code - I don't thinks so, the files which match

*globals.yml

first are consumed and then the templating is applied to the other files

Using environment vars is a common way to get round this sort of thing. Set the var outside of Kedro and then tweak your

register_config_loader

method in

hooks.py

python
globals_pattern="*globals.yml",
        globals_dict={
            k: v for k, v in os.environ 
            if k.startswith("date")
        },
    )

Hi team, I'm trying to pass Parameters at runtime. https://kedro.readthedocs.io/en/latest/04_kedro_project_setup/02_configuration.html#specify-parameters-at-runtime One of my params have comma in value for example, kedro run --params "param1=hi, param2=a,b" is there a way that I can have comma in the value of the param such as escape sequence or so?

I'm not actually sure - can you try putting a \ before it? Otherwise there is a chance this isn't possible

kedro run --params "param1=hi, param2=a\\,b"

is not working either

Yeah can you use a different delimiter?

I think it's fair to say commas are reserved