datajoely04/13/2022, 12:06 PM
gui4204/14/2022, 1:20 AM
datajoely04/14/2022, 4:16 AM
praveenbisht04/14/2022, 2:38 PM
noklam04/14/2022, 3:03 PM
praveenbisht04/14/2022, 3:04 PM
noklam04/14/2022, 3:08 PM
noklam04/14/2022, 3:09 PM
, you don't need to access context to execute a pipeline. In fact
has been removed.
praveenbisht04/14/2022, 4:36 PM
user04/18/2022, 6:33 AM
deepyaman04/19/2022, 10:52 AM
as a backend for this (and being more Python-native), but
isn't really maintained anymore (and was lacking some other necessary functionality, like joining streams). There's an overall question of how to better support streaming workflows with Kedro, as Kedro is notoriously batch-oriented.
user04/20/2022, 5:32 PM
Rjify04/20/2022, 7:01 PM
Onéira04/21/2022, 7:29 AM
datajoely04/21/2022, 9:11 AM
Rafał04/21/2022, 10:48 AM
which takes the input param
and gives the output
I would like to run this pipeline with different values of parameter
I know I can pass extra params using CLI
, My problem is that I would like to create the following pipeline: * run
kedro run --pipeline pipe --params "alpha:5"
and name the output as
* collect all the outputs from previous step and run the node which takes that collection and creates the single
output. I am afraid I do not know how to do that in kedro. I am using kedro 0.18 I have already idea to create the pipeline with takes the
and calls the function which does
loop and creates fake
in current kedro session..... and then stops since it is too complicated. Is there any clean solution?
datajoely04/21/2022, 11:10 AM
Rafał04/21/2022, 11:30 AM
? The only thing I have in my mind is to create fake kedro's catalog item with new "temporary_alpha_param" Actually I have no how to override the pipeline params in
hook. Could you point some example code?
Rafał04/21/2022, 11:39 AM
hook, right ?
datajoely04/21/2022, 11:47 AM
datajoely04/21/2022, 11:49 AM
datajoely04/21/2022, 11:50 AM
avan-sh04/21/2022, 2:47 PM
datajoely04/21/2022, 2:50 PM
noklam04/21/2022, 3:14 PM
avan-sh04/21/2022, 3:18 PM
datajoely04/21/2022, 3:42 PM
merged on the CLI side