j c h a r l e s

j c h a r l e s

12/13/2021, 11:48 PM
Another question - is there any concept of appending output data as a run continues. I have a node that iterates over a large amount of data (list of entities in a
dataset. For each entity, it takes between 15 minutes and 1 hour to process that specific entity. I have a node that is looping over each entity, processing that entity, and then merging all of these entities together. What's the best way to split up this node so that I can process each user as its own node? The number of desired nodes would be one node per entity in the original dataset.