Batching a Created JSON file

Hi everyone, thanks for your help. I have a table with approximately 100,000 lines of data. I’m looking to batch the JSON I create into files containing 500 to 1,000 lines each and automate the looping process. Is there an efficient way to achieve this using EasyMorph?

Thank you.

I have created a manual version in which I enumerate the rows and then filtered by that row id 1-1000..1001-2000. And had to manual adjust the file name each time jn_1 jn_2. Trying to see if there is an automated approach.

I do something similar for limiting the number of records for an iteration command. I just created a calculated column. Floor(row number/1000) which is passed as a parameter and then merged with a derived copy of the original table to output the rows. There might be a better approach but this worked for me.

Can you send me a sample version of that so I can see how you did it. Manually I can do it having a hard time figuring out the looping approach. Much thanks.

I hope, I understood your "challenge" :slight_smile: the right way.
Here is how I would try it. First table is only for creating sample lines.

Batch processing JSON files.morph (3.9 KB)