Arnaldo
06/18/2021, 12:46 PMArnaldo
06/18/2021, 12:46 PMdatajoely
06/18/2021, 12:47 PMArnaldo
06/18/2021, 12:47 PMdatajoely
06/18/2021, 12:47 PMArnaldo
06/18/2021, 12:47 PMArnaldo
06/18/2021, 12:47 PMdatajoely
06/18/2021, 1:56 PMArnaldo
06/18/2021, 2:38 PMArnaldo
06/21/2021, 8:21 PMArnaldo
06/21/2021, 8:23 PMArnaldo
06/21/2021, 8:23 PMdatajoely
06/22/2021, 7:53 AMTemplatedConfigLoader
- Design code to be readable 6 months later
- Keep nodes simple and to the point
- Avoid dynamic DAG creation in Kedro unless you really have to
- If you have to, ensure that the DAG is structurally immutable and only differs in terms of dataset flow.
- Most extensions to Kedro can and should happen via a Hook
- Use pre-commit hooks
- Write tests with fabricated data, use something like Great Expectations for defensive checksdatajoely
06/22/2021, 7:54 AMantony.milne
06/22/2021, 8:40 AM_
)
* any helper functions shared between nodes in the same modular pipeline go in utils.py
within that modular pipeline
* any helper functions shared between nodes in the multiple modular pipeline go in utils.py
(or even a directory utils
) in src/project_name
antony.milne
06/22/2021, 8:41 AMArnaldo
06/22/2021, 12:49 PMetl
, ml_app
, and user_app
- tags to define which nodes will be used for training and servingdatajoely
06/22/2021, 12:51 PMArnaldo
06/22/2021, 12:51 PMwaylonwalker
06/22/2021, 1:59 PMantony.milne
06/22/2021, 4:12 PMwaylonwalker
06/22/2021, 9:02 PMdatajoely
06/23/2021, 2:49 PMYetunde
06/28/2021, 5:06 PMuser
06/29/2021, 6:18 AMsigma
06/29/2021, 5:26 PMdatajoely
07/01/2021, 10:57 AM