This has been torturing me for the whole afternoon.
I am using EasyMorph to importing data from spreadsheet and export it to Redshift cluster.
After bunch of calculation, now the data is ready to export.
So I did:
- delete matching database rows, based on three keys.
DateKey, TagId, Series
- Export Data.
Every time it will create duplicate rows - double up the records that are exported.
I have ran step 1 by it’s self, and checked to make sure it works.
Doesn’t matter how I do it - Even clean up the records in the database manually, then go to EasyMorph do -> “reload and run” the whole thing, still creating duplicate rows.