Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Toronto Sept 9th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
MaheswarReddy
Contributor III
Contributor III

Hash in talend


Hi Team,
I'm inserting data from one table to another table and i need to capture only change data on the next run.And the talend job should check all the columns , compare current table column data  with the previous column data available in previous table column to column comparison should happen and all columns should be checked , even if there is insert/change in single column out of 20 columns, we should consider that as changed data and get the whole record into a new table.Please help me how to get only the modified data.
My DB is sql server
Thanks 
 
 
Labels (2)
3 Replies
Anonymous
Not applicable

Hi,

 

   Did you check the CDC architecture available in Talend? 

 

https://help.talend.com/reader/RLnX9FGglgivekyCIUAC3Q/AX_8eo1W6GwYpIOqnM4qAg

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

MaheswarReddy
Contributor III
Contributor III
Author

Hi,

 

Thanks for your reply , but i'm using Talend open studio, 

 

Please let me know any other idea.

 

Thanks,

Mahesh

Anonymous
Not applicable

Hi,

 

    In that case I would recommend you to load the data to a stage table using Talend and then do the data comparison either with a tMap or using a tMSSQLServerRow component. If you are using Row component, then you will have to write SQL commands or stored procedure to do the data difference check.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved