https://kedro.org/ logo
Title
d

datajoely

10/11/2021, 9:27 AM
Hi @User glad to hear Kedro helps some of your team's workflow. 1. It hasn't been a feature I recall being requested before as part of the existing IncrementalDataSet. I'd love to see what that would look like as YAML psuedocode if you have any ideas. Quite a lot of people template SQL calls via custom datasets, but we've been reluctant to support something like that out of the box for security reasons. 2. I'm not entirely sure what you mean here - I guess you could have two datasets pointing at the same data one in incremental form and one not and perform the operation in the node. From a glance what you're describing doesn't sound acyclic but I might be wrong so keen to understand more