Handle Duplicate records in Source file.

Hello All,


I'm using Scribe Online to upload data from .csv file (text as a source). The source files are extracted from ERP System and contains duplicate records. While using these files as a source for another target System, since they contains duplicates the Scribe loads creates duplicate records in target system dispute I've Lookup block and IF condition to check and skip if records are already there in target System. i.e. If source file have two duplicate records and target system haven't this records already created in it, it will create two new records instead of one.


It would be a great help if anyone can guide me on how to handle the duplicates from source file.







(6) Answers