RRoger
02/09/2022, 4:48 AMcatalog_01_raw.yml
has "companies", "reviews" (no prefixes)
* catalog_02_int.yml
has "data_ingestion.int_typed_companies", "data_ingestion.int_typed_shuttles" (prefix with dot)
* catalog_03_prm.yml
has "prm_shuttle_company_reviews", "prm_spine_table" (prefix with underscore)
Or does is it a matter of taste?ChainYo
02/09/2022, 5:46 AMdatajoely
02/09/2022, 10:02 AMantony.milne
02/09/2022, 10:09 AMprm
is in the name of the catalog file I wouldn't use it in the name of the dataset. But it does depend on how your project is structured, so it might be that repeating the layer in the dataset name makes things easier for you.
Note that the "prefix with dot" is actually a pipeline namespace, which has "real meaning" rather than just being the name of the dataset. Doing layer.dataset_name
is not comparable to doing layer_dataset_name
.datajoely
02/09/2022, 10:23 AMwrite code for someone else to read... even if that person is future you