https://kedro.org/ logo
Title
v

vivecalindahl

03/16/2022, 10:05 AM
Hi all! I'd like to parameterize my data catalog using an environment variable. For instance, say I have an environment variable
FILEPATH=/path/to/file/
and in my data catalog I'd want something like
example_iris_data:
 type: pandas.CSVDataSet
 filepath: "${params:filepath}"
Then I could run kedro as
kedro run --params filepath=$FILEPATH
. I'm aware of the
TemplatedConfigLoader
https://kedro.readthedocs.io/en/latest/04_kedro_project_setup/02_configuration.html#template-configuration . But is there a way of skipping the extra loop through the config file
globals.yaml
? I haven't been able to figure out how to do what I outlined above, i.e. using the parameters dict directly. Basically it would be nice to directly provide the env variable, without first creating a
globals.yaml
containing a single variable.