Brand new kedro and spark user here. I've successf...
# beginners-need-help
b
Brand new kedro and spark user here. I've successfully installed and run the pyspark-iris starter locally and am now attempting to run it remotely on an EMR cluster by following the ssh interpreter docs for pycharm here: https://kedro.readthedocs.io/en/latest/09_development/02_set_up_pycharm.html. I setup the remote interpreter, and the local project files all transferred to the cluster fine. However, when I execute the custom run configuration button to call "kedro run" on the cluster, I get a "No such file or directory" error (I assume because I haven't installed kedro on the cluster). Is there a way to run pipelines remotely using the local kedro cli, or is it assumed that this should always be installed on the cluster? Perhaps more generally, what is the envisioned kedro workflow for EMR?