datajoely
09/07/2021, 8:00 AMwaylonwalker
09/08/2021, 3:40 AM__all__
is for every node in the project, __default__
, every node past the raw layer. This serves as a sane default for developers to work from, I am always very explicit at deployment about which part of my DAG gets scheduled, during development I just want to run quickly. raw
These are the nodes that were removed from __all__ to make __default__, This is the first thing that gets scheduled for a project, once we have something usable we expand, but early on we feed the dev team with fresh data so they don't have to wait for it or pull it with their own machines. After those three everything else is project dependentende
09/10/2021, 8:32 PMdatajoely
09/10/2021, 8:44 PM