Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Note: You may notice some temporary visual or styling issues in the Community. Our vendor is actively investigating.
cancel
Showing results for 
Search instead for 
Did you mean: 
TharunJoshi
Contributor III
Contributor III

Duplicate data

Hi
I have a question
I have one Excel I loaded it last week
Now again I got the same Excel file they have just copied the old file and sent me that's it now if you load it in to database it will create duplicate
I don't want duplicate data to be filled I don't have any update in my project everything I do is insert but not duplicate
Eg: If I have a file with 100 records where 50 are previous records and 50 are new so this previous data is duplicate I don't want to push this into database what is the way I can follow
Please explain clearly
If you made a job of this kind share at 12e41a0222@gmail.com

Labels (2)
2 Replies
TRF
Champion II
Champion II

You need to read the record from the database, then using a tMap with the proper inner join, exclude records from the Excel file (main row) existing into the database (lookup row).

If the previous is still there, you can also replace the database by this previous file.

This is a very common pattern.

TharunJoshi
Contributor III
Contributor III
Author

Screenshots would have helped me as a beginner