09/15/2022, 9:54 PM
Hello everyone, I am looking to setup a pipeline which involve kedro project, docker and databricks. I am curious to understand in what all different ways we can use these 3 tools . I know one approach where we can create a docker image of a kedro project and then run that docker image using a databricks cluster by authenticating to a container repository. It will be great if others can also chime in what all different approaches have worked and what did not work. Thanks.