03/22/2022, 9:58 PM
Is there a well-defined pattern for bubbling kedro pipelines up through dev/qa/prod environments? My specific use case is in the intermediate steps where data is serialized after any given node. We save parquet files in s3 however as we move pipelines out of dev and into a qa or prod environment we'd have to change those s3 bucket paths. I'd like to be able to configure the bucket based on an environment variable but this isn't immediately obvious to me as to how to do it without hijacking the config loader. Am I missing a simple answer?