Appending data to table with different columns

1

Hi Dmitry,

I have to append a big reporting table (2 millions records) every month with data.
The problem is that the data structure has changed throughout the history, so the dataset that is appended has differnt number of columns than the reporting table.

For the moment I have solved this by loading in both tables and using the append action and then export the resulting table.
I think this is not optimal. Is there another way to do this thus increasing the performance ?
Does the append mode in export to CSV does also column mapping ?

Kind regards

2

Hi Nikolaas,

You can use a database table although you will have to modify it’s column structure manually every time there are new columns. You can create a simple project in EasyMorph that will tell you what the new columns are, but altering database table structure should be done manually.