If the Jupyter env is the only place that you can connect to spark etc, then you need to have your project on Jupyter. Otherwise you can always connect to Spark cluster in a local project.