06/27/2022, 5:18 PM
Hello, running a Kedro pipeline results in my job getting killed. It looks it is running out of memory as it is trying to save the result of a node to a ParquetDataSet. My inputs are about 2G in size. Any solutions or suggestions?