Hi team, question about datasets:
What is the recommended way to handle incremental dataset based on a SQL-like database (e.g. Google BigQuery)?
Context: I'm building a data pipeline with a daily fetch of new data which are inserted in Google BigQuery table and then has to process those new data only subsequently