I think it's fair to say this isn't Kedro's strong point - it's fundamentally a batch orientated paradigm. I think the same recommendations here apply - but I would argue Kedro isn't the best tool for the job here. https://discord.com/channels/778216384475693066/778998585454755870/912654557660712970