Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
jwilkinson1665370444
Contributor III
Contributor III

Update timestamp for only upserted columns

Hi All,

I have built a pipeline where we are upsetting values in snowflake.

However, when I am upsetting on snowflake, all entries get upserted as I have a column TS = TalendDate.parseDate(

"yyyy-MM-DD hh:mm:ss"

, TalendDate.getDate(

"yyyy-MM-DD hh:mm:ss"

)) which gets the current time.

I just want to update this column when there is an update/insert in table data. How could this be achieved.

Any help is appreciated.

Thanks

Labels (3)
1 Reply
Anonymous
Not applicable

Hi

In this example, the TS value which gets the current time is always updated even though there is no changed data in other columns. The main problem is to find out the data that has not changed. These data do not need to update the TS column. The method I think of is to compare the input data with all the target data, get the data that has not changed, and then filter out the data that has not changed from the input data, but this is not an ideal method, if the amount of data is large.

 

Regards

Shong