beats-like-a-helix
03/08/2022, 12:44 PMdatajoely
03/08/2022, 1:40 PMbeats-like-a-helix
03/08/2022, 2:14 PMdatajoely
03/08/2022, 2:37 PMon_pipeline_error
hook is really useful here
(2) Try and set up a data profiling pipeline that allows you to do low-cost analysis of the data that can maybe give you an idea of what may cause problems downstream
(3) for logic errors, you may want to use exception handlers to gracefully swallow and log errors rather than killing the processbeats-like-a-helix
03/08/2022, 2:58 PM