https://kedro.org/ logo
Title
r

rohan_ahire

09/17/2022, 4:35 PM
Understanding data catalog datasets
SparkHiveDataSet - Does this read from hive and load data in spark dataframe or does it write a spark dataframe to hive table? Or does it do both? I am getting confused with the data catalog definitions for not just hive but any type. I don't understand what it is reading from or what is it writing to.
d

datajoely

09/19/2022, 7:09 PM
r

rohan_ahire

09/19/2022, 8:00 PM
thanks, this is helpful
d

datajoely

09/19/2022, 8:00 PM
Pleasure