Thiago Poletto
08/29/2022, 12:44 PMdatajoely
08/29/2022, 2:00 PMsri
08/29/2022, 7:07 PMnoklam
08/30/2022, 9:48 AMsri
08/30/2022, 2:40 PMdatajoely
08/30/2022, 3:29 PMname
arg, or actually drop the explicit name altogetherThiago Poletto
08/31/2022, 11:45 AMJose Alejandro M
08/31/2022, 10:17 PMnoklam
08/31/2022, 10:20 PMJose Alejandro M
08/31/2022, 10:21 PMnoklam
08/31/2022, 10:30 PMnoklam
08/31/2022, 10:31 PMnoklam
08/31/2022, 10:31 PMJose Alejandro M
09/01/2022, 1:10 AMfantasprite
09/01/2022, 12:20 PMnoklam
09/01/2022, 12:50 PM0.18.2
, you can share the errors that you get and we can try work together and help you with the migration.
2. If upgrade is not possible, a slightly better option is make your own CustomHiveDataSet
, that just inherit from the original SparkHiveDataSet
and you implement the _exists
method to override its behavior, you can package that in your project. One addition thing you need to is update the DataSet
type in your catalog,yml
to point to your custom implementation instead.fantasprite
09/01/2022, 1:24 PMnoklam
09/01/2022, 1:38 PMfantasprite
09/01/2022, 1:47 PMnoklam
09/01/2022, 2:08 PMfantasprite
09/01/2022, 2:13 PMfantasprite
09/01/2022, 2:52 PMrohan_ahire
09/01/2022, 9:49 PMrohan_ahire
09/01/2022, 9:51 PMnoklam
09/01/2022, 9:52 PMrohan_ahire
09/01/2022, 9:52 PMrohan_ahire
09/01/2022, 10:00 PMnoklam
09/01/2022, 10:01 PMrohan_ahire
09/01/2022, 10:05 PMnoklam
09/01/2022, 10:06 PM