https://kedro.org/ logo
s

simon_myway

11/03/2021, 1:13 PM
Hi team, question about datasets: What is the recommended way to handle incremental dataset based on a SQL-like database (e.g. Google BigQuery)? Context: I'm building a data pipeline with a daily fetch of new data which are inserted in Google BigQuery table and then has to process those new data only subsequently