Are you using Kubeflow Pipelines? To build on what...
# advanced-need-help
d
Are you using Kubeflow Pipelines? To build on what @noklam said, I would recommend defining (Python-based) components that run each modular pipeline, and passing artifacts between them. Your containers can either get created by passing
packages_to_install
based on the requirements for the modular pipelines, or you can just package the modular pipeline itself and build based on that. Most of my understanding is of the Kubeflow v2 SDK in Python (which is still in beta), but you can achieve similar results in earlier versions I believe.