30Gb CSV Import then Export to SQL Database

1

Good Morning,

I am still trialling EasyMorph with really positive results.

My current test involves importing one of our 30Gb CSVs.

Generally the UI locks up and never recovers when attempting to import and export this CSV to a database.

I have used the normal database export as well as the bulk export.

Is there any known way of doing this?

Thanks!

2

Hello Nathan,

It looks like there is not enough RAM on your computer to load such a large file at once so it runs out of memory.

To circumvent that, you can split the CSV file into multiple small files using the "Split delimited file" action. Then use iterations to process each file one by one.

1 Like
3

Thanks super, thanks @dgudkov , apologies I didn’t see that before asking!

4

You’re welcome!