Scott H
08/24/2022, 7:26 PMParallelRunner
by changing it's exception handling. Instead of re-raising, it could prune the to-do list of nodes that depend on the failing one, capturing the failed and skipped ones. Then it would just continue. At the end it could log those failed and skipped ones. It could even raise an exception at the end. But that way it tried to do everything that it could. Sometimes it's pretty valuable to have as many parts of the pipeline succeed as possible.antheas
08/24/2022, 9:59 PMScott H
08/25/2022, 8:21 PMantheas
08/25/2022, 8:42 PM