datajoely
02/18/2022, 3:53 PMIsaac89
02/18/2022, 3:56 PMIsaac89
02/21/2022, 10:19 AMdatajoely
02/21/2022, 10:21 AMIsaac89
02/21/2022, 10:25 AMdatajoely
02/21/2022, 10:26 AMantony.milne
02/21/2022, 12:54 PMdatasets = {dataset: dataset._describe() for dataset in catalog.datasets}
yaml.dump(datasets)
This won't give exactly the reverse of from_config
but will go some of the way.
Possibly str(dataset)
might be useful also.Isaac89
02/21/2022, 1:12 PMRRoger
02/22/2022, 4:54 AMparameters.yml
is a long complicated SQL string:
sql_param: >
SELECT
...
The weird thing is that running it in through the node produces errors. If I copy and paste the SQL string to a DB tool, it runs fine. Is yaml or Kedro treating some characters in the SQL script differently?
Is there a better way to make a node run SQL? Can I use pandas.SQLQueryDataSet even though the query is not supposed to return anything?grizzlyfederica
02/22/2022, 8:53 AMSQL -> kedro_pipeline()
datajoely
02/22/2022, 9:33 AMwilliamc
02/22/2022, 8:54 PM'\t'
) for a Pandas.CSVDataSet
I get a "delimiter" must be a 1-character string
error. Is there another way to accomplish this?datajoely
02/22/2022, 9:00 PMwilliamc
02/22/2022, 9:04 PMmovie_titles:
type: pandas.CSVDataSet
filepath: s3:${s3_bucket}data/07_model_output/tars_movie_titles.tsv
save_args:
index: False
header: True
sep: '\t'
versioned: True
datajoely
02/22/2022, 9:06 PMwilliamc
02/22/2022, 9:44 PMdatajoely
02/22/2022, 10:00 PMyaml
sep: "\t"
williamc
02/22/2022, 10:03 PMEdak
02/23/2022, 4:38 AMdeepyaman
02/23/2022, 5:57 AMdatajoely
02/23/2022, 8:17 AMpotterhead
02/23/2022, 12:00 PMdatajoely
02/23/2022, 12:01 PMpotterhead
02/23/2022, 12:04 PMdatajoely
02/23/2022, 12:05 PMdatajoely
02/23/2022, 12:05 PMpotterhead
02/23/2022, 12:06 PMdatajoely
02/23/2022, 12:06 PMpypeaday
02/23/2022, 7:10 PMpypeaday
02/23/2022, 7:10 PM