kradja
07/12/2022, 2:32 AMkedro run
my first pipeline data_processing has a node which outputs prokka_bins. This data is one of the outputs of the pipeline data_processing.
namespace="data_processing",
inputs=["partition_prokka_faa", "partition_prokka_gff"],
outputs=["hypo_prot","prokka_bins"]
I was wondering how I can access the data from my new pipeline edge_processing
inputs="prokka_bins"
when this code is within a node in edge_processing, I get the error.
ValueError: Pipeline input(s) {'edge_processing.prokka_bins'} not found in the DataCatalog
Other than essentially duplicating an entry in my DataCatalog with edge_processing.prokka_bins
which makes things more messy, is there any way I can access this data in my second pipeline?datajoely
07/12/2022, 6:05 AMSimon W
07/12/2022, 1:42 PMnoklam
07/12/2022, 1:43 PMnoklam
07/12/2022, 1:45 PMGoss
07/12/2022, 6:39 PM./src/settings.py
but it should be ./src/{project name}/settings.py
noklam
07/12/2022, 6:44 PMnoklam
07/12/2022, 6:45 PMGoss
07/12/2022, 6:52 PMnoklam
07/12/2022, 6:58 PMSpikeyhog
07/13/2022, 11:11 AMdatajoely
07/13/2022, 12:29 PMSpikeyhog
07/13/2022, 12:42 PMdatajoely
07/13/2022, 12:44 PMSpikeyhog
07/13/2022, 12:46 PMdatajoely
07/13/2022, 1:20 PMSpikeyhog
07/13/2022, 3:25 PMbgereke
07/13/2022, 4:22 PMdatajoely
07/13/2022, 4:33 PMdatajoely
07/13/2022, 4:33 PMkedro viz --autoreload
bgereke
07/13/2022, 4:38 PMteddycarebears🇷🇴
07/13/2022, 8:11 PMSpikeyhog
07/14/2022, 9:07 AMlancechua
07/14/2022, 9:59 AMdatajoely
07/14/2022, 10:04 AMdatajoely
07/14/2022, 10:04 AMparams
syntax in the inputs. If you mean a pipeline then the answer is sort of, you can use hooks for this.lancechua
07/14/2022, 10:50 AMdatajoely
07/14/2022, 11:08 AMlancechua
07/14/2022, 11:34 AMdatajoely
07/14/2022, 11:47 AM