brewski
07/26/2022, 6:49 AMdatajoely
07/26/2022, 6:50 AMdatajoely
07/26/2022, 6:50 AMbrewski
07/26/2022, 6:51 AMcontext.class_variable_I_just_initialized
in kedro ipython -- I just want to access this same variable within a nodebrewski
07/26/2022, 6:51 AMdatajoely
07/26/2022, 6:52 AMdatajoely
07/26/2022, 6:53 AMbrewski
07/26/2022, 6:55 AMdatajoely
07/26/2022, 6:58 AMdatajoely
07/26/2022, 6:59 AMbrewski
07/26/2022, 7:03 AMdatajoely
07/26/2022, 7:20 AMwaylonwalker
07/27/2022, 9:13 PMinigohrey
07/28/2022, 9:24 AM**dict
) when defining a node, or maybe there's an alternative way of achieving what I want:
I want to merge two datasets using pd.merge
and pass it a set of parameters I define in config, but don't want to pass specific parameters à la ["params:merge.on", "params:merge.how"]
, as I want to keep the node as general as possible, so I can pass different sets of parameters, such as left_on
or right_index
. I'd want to just unpack [**"params:merge"]
values as kwargs. I could write a node which does that before passing to pd.merge
, but I would like to avoid that if possible as it is something I would like to do for multiple different functions, not just pd.merge
.noklam
07/28/2022, 10:21 AMnode = (some_function, ["some_dataset", "params:merge"])
In your actual fuction:
def merge(some_data, config):
pd.merge(some_data, **config)
...
inigohrey
07/28/2022, 10:23 AMpd.merge
that I want to interact with in this way. Could maybe write a general wrapper which does thisMichaelB
07/29/2022, 9:31 AMdatajoely
07/29/2022, 9:31 AMMichaelB
07/29/2022, 9:40 AMcrayfish
08/01/2022, 12:48 AMdatajoely
08/01/2022, 5:54 AMkedro build-reqs
or pip-compile
to pre resolve your depsNick Sieraad
08/01/2022, 11:43 AMDataSetError: Failed while saving data to data set ImageDataSet(filepath=C:/Users/user/Documents/my_project/data/02_intermediate/xxx.png, protocol=file, save_args={}).
cannot write mode CMYK as PNG
. I am trying to save a .jpg image as png. It works for some .jpg, but other doesn't. Does anyone know how I can solve this?MichaelB
08/01/2022, 1:21 PM(02_intermediate)
after loading them from the (01_raw)
. When I try to run a function that combines, "glues", the raw datasets into the (02_intermediate)
it gives this error: OutputNotUniqueError: Output(s) ['label_images_int_jpg'] are returned by more than one nodes. Node outputs must be unique.
MichaelB
08/01/2022, 1:21 PMThiago Poletto
08/01/2022, 5:52 PMZhee
08/01/2022, 7:12 PMNick Sieraad
08/02/2022, 7:47 AMNick Sieraad
08/02/2022, 7:48 AMnoklam
08/02/2022, 8:49 AMnoklam
08/02/2022, 8:49 AM