Since iterations are always executed sequentially, I don’t think that 6 SharePoint actions per iteration will cause any problems.
As for a ‘Keep session active’ option - EasyMorph use CSOM library which is not guaranteed to be thread-safe. So we can’t share a session object between SharePoint actions because some of them may be executed in parallel.
It sadly looks like we are running into a throttling limit.
Talking with our O365 team, we’re seeing about 400+ actions over 15 minutes, which is having us hit the limit pretty quickly, causing SharePoint to start rejecting our credentials.
Some of this may be because there isn’t a “Move Files” action for SharePoint I, so to move files from one folder to another, we have to:
Get a list of files from the folder
Download the files
Upload them to another folder.
There are about 90+ iterations of the above.
Then we have to go through our data transformation, then upload the transformed files (~200 files over ~ another 90 iterations).
Are there any thoughts on ways to improve the connections, or at least keep the SharePoint session active in the same module?
Additional question that could help us reduce actions: is there a way for us to set up a list of files so the Sharepoint “Upload” command interprets /foldernamehere/filename here as subpaths? I know it requires you to select a parent folder, but if I can have it interpret subfolders from the list of files, I can pretty much eliminate nearly all of my sharepoint actions down to ~5 total, rather than 6 per iteration.
I just tested the “Import SharePoint list” action with SharePoint online and 500 consecutive executions. It took ~18 minutes to complete and all the imports were successful. The imported list was very small though.
Can you try to add a small delay between iterations or\and SharePoint actions with the “Wait” action?
The only other workaround that I can think of is to use the “PowerShell” action with the SharePoint PnP library and a custom PowerShell script. This way you should be able to implement required move workflow with a single action and a single connection.
SharePoint Upload command can only load files to the specified target folder.