Would

PartionedDataSet

work in my case? It would allow me to specify a directory path that contains multiple files? I'm using data catalog, just not for the initial input