08/19/2022, 5:51 PM
Hi everyone! I've been using Kedro for a couple of months but I've recently come across an issue that I'm hoping someone here can give me some advice on. I'm trying to use a runtime parameter (specified via
kedro run --params ...
) with templated configuration of my data catalog so I can specify a project/site name to use as a prefix (subdirectory) on my file paths in the catalog. I'm able to achieve this functionality if I specify the parameter in my globals config, but it appears that runtime parameters provided through the CLI are not available to the TemplateConfigLoader. My goal is to enable execution of the pipeline on different raw datasets while preserving the previous dataset's data directory and without requiring the user to edit the global config file. Is this possible or is there another way I should go about this? Any advice would be greatly appreciated 😀