Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
raceberos
Partner - Contributor III
Partner - Contributor III

Remove duplicate and retain the latest items

Good day to all i'm having a challenge in my project i hope you can help me,

I got a 2 qvd file.. please refer to the picture below.

upload 1.JPG

they have a different upload date and price but having the same  item code and ID

i want to remove the duplicate and retain the latest upload and if the deleted field is 1 then in the final output must be remove.

the steps i did is i combine the 2  QVD file which it looks like this.

concat.JPG

and the final output must be like this

final.JPG

thank you in advance to all...

Message was edited by: Reynaldson Aceberos

2 Replies
Anil_Babu_Samineni

Better if you can share sample? You need to show on file base names but when i see concatenate.qvd. There is 2018-1 which is Max but where 2018-2 is 300 but your output seems 180? Can we know the reason behind

Best Anil, When applicable please mark the correct/appropriate replies as "solution" (you can mark up to 3 "solutions". Please LIKE threads if the provided solution is helpful
raceberos
Partner - Contributor III
Partner - Contributor III
Author

Hi mate I already include sample files:

the reason behind why in the expected output the price of ITEMCODE is 180 since it its the latest datecreated...

this is the mechanism in our database it change on a daily basis, so i need to change the data base into the latest DateCreated, i need to retain the old values in case there are items in the old extracted file is not duplicated when i concatenate the latest extracted.