Good question! So Kedro is fundamentally a batch based methodology so to get this working you're going to have to orchestrate things to work in micro-batching. I'd also say that we don't have any SQS or datasets out of the box and I think you're going to have to define them yourself. 1. If you package a kedro project it is

pip installable

https://kedro.readthedocs.io/en/stable/03_tutorial/05_package_a_project.html 2 & 3 Here are the instructions on how to define a custom dataset in Kedro https://kedro.readthedocs.io/en/stable/07_extend_kedro/03_custom_datasets.html The other option is to do your stream pull/push operation outside of Kedro - dump stuff to a landing area, run your pipeline - dump processed data to a different landing area and have services which handle either side