datajoely09/07/2021, 8:00 AM
waylonwalker09/08/2021, 3:40 AM
is for every node in the project,
, every node past the raw layer. This serves as a sane default for developers to work from, I am always very explicit at deployment about which part of my DAG gets scheduled, during development I just want to run quickly.
These are the nodes that were removed from __all__ to make __default__, This is the first thing that gets scheduled for a project, once we have something usable we expand, but early on we feed the dev team with fresh data so they don't have to wait for it or pull it with their own machines. After those three everything else is project dependent
ende09/10/2021, 8:32 PM
datajoely09/10/2021, 8:44 PM