Thanks @noklam, I can connect to spark locally using separate permissions. The airflow and Plotly functionalities are linked to the Jupyter env so guessing I'll need to have the project on Jupyter. I found this in the docs: https://kedro.readthedocs.io/en/stable/tools_integration/ipython.html. Will try working with this