Hi all! I'd like to parameterize my data catalog ...
# beginners-need-help
v
Hi all! I'd like to parameterize my data catalog using an environment variable. For instance, say I have an environment variable
FILEPATH=/path/to/file/
and in my data catalog I'd want something like
Copy code
example_iris_data:
 type: pandas.CSVDataSet
 filepath: "${params:filepath}"
Then I could run kedro as
kedro run --params filepath=$FILEPATH
. I'm aware of the
TemplatedConfigLoader
https://kedro.readthedocs.io/en/latest/04_kedro_project_setup/02_configuration.html#template-configuration . But is there a way of skipping the extra loop through the config file
globals.yaml
? I haven't been able to figure out how to do what I outlined above, i.e. using the parameters dict directly. Basically it would be nice to directly provide the env variable, without first creating a
globals.yaml
containing a single variable.
2 Views