I'd also make sure you're aware of how the PartitionedDataSet wrapper works as that's usually important for this type of work