datajoely05/03/2022, 2:28 PM
datajoely05/03/2022, 2:29 PM
teddycarebears🇷🇴05/03/2022, 4:31 PM
datajoely05/03/2022, 4:52 PM
Ashwin_1105/05/2022, 7:13 AM
noklam05/05/2022, 12:14 PM
(the related entry)?
Ashwin_1105/05/2022, 12:17 PM
datajoely05/05/2022, 12:18 PM
Carlos Bonilla05/05/2022, 2:44 PM
Carlos Bonilla05/05/2022, 2:45 PM
Carlos Bonilla05/05/2022, 2:48 PM
Carlos Bonilla05/05/2022, 2:49 PM
noklam05/05/2022, 3:04 PM
Carlos Bonilla05/05/2022, 3:16 PM
Ashwin_1105/05/2022, 3:20 PM
inigohrey05/06/2022, 3:07 PM
Ashwin_1105/06/2022, 3:13 PM
JA_next05/11/2022, 12:23 AM
I have a question here: here 'model_input_table' is a data frame from data catalog, while how can I know this is not a string?
node( func=split_data, inputs=["model_input_table", "params:model_options"], outputs=["X_train", "X_test", "y_train", "y_test"], name="split_data_node", )
Carlos Bonilla05/11/2022, 3:43 AM
noklam05/11/2022, 4:31 PM
, then it will be just a variable ->
The string is the name of the DataSet
JA_next05/11/2022, 6:21 PM
JA_next05/11/2022, 10:00 PM
noklam05/11/2022, 10:05 PM
noklam05/11/2022, 10:13 PM
JA_next05/11/2022, 11:59 PM
This is one pipeline, merging 2 feature_df into main_df. but what if I dont know how many feature_dfs in advance, how can I do that?
pipeline_steps.append(node(merging_features_to_main_data, inputs = dict(main_df = 'main_df', feature_1_df = 'feature_df1', feature_2_df = 'feature_df2'), outputs='main_feature_df'))
datajoely05/12/2022, 5:31 AM
Kastakin05/13/2022, 7:20 AM
command. This command mounts as volumes the required data/conf/logs folders and then runs kedro inside of it. All good! But now let's say I would like to migrate my finalised project from my development machine to the machine in my lab where we would run the pipeline directly, what are the steps needed to use the dockerized pipeline there? The documentation suggest pushing the built docker image to the registry and then pull it on the "production" env but that doesn't bring with it neither the catalog, the folder structure of the data folder nor the Kedro CLI itself.
kedro docker run
antony.milne05/13/2022, 8:00 AM
anna-lea05/13/2022, 12:55 PM
. What I then see is the following file structure:
which is versioned, but not super handy. What I would expect is more something in this direction:
Do you have an idea how I can get to the second file structure, or is it a "feature" :p Thanks!
Valentin DM.05/13/2022, 5:45 PM
command (I did
) Kedro version :
pip install src/requirements.txt
Do you have any idea?