Well modular pipelines and configuration scalable pattern for managing large projects, but you should also be wary of premature opimisation