Hi @User and @User we have some updates in 0.17.6: - We have updated

pandas.QueryDataSet

to so that it takes a reference to a SQL file - We have introduced

spark.DeltaTableDataSet

and some tutorials on how to do 'out of dag operations' which may translate here: https://kedro.readthedocs.io/en/latest/11_tools_integration/01_pyspark.html#spark-and-delta-lake-interaction