Update timestamp for only upserted columns

jwilkinson1665370444 — Fri, 15 Nov 2024 22:19:39 GMT

Hi All,

I have built a pipeline where we are upsetting values in snowflake.

However, when I am upsetting on snowflake, all entries get upserted as I have a column TS = TalendDate.parseDate(

"yyyy-MM-DD hh:mm:ss"

, TalendDate.getDate(

"yyyy-MM-DD hh:mm:ss"

)) which gets the current time.

I just want to update this column when there is an update/insert in table data. How could this be achieved.

Any help is appreciated.

Thanks

Re: Update timestamp for only upserted columns

Anonymous — Tue, 06 Dec 2022 10:28:12 GMT

In this example, the TS value which gets the current time is always updated even though there is no changed data in other columns. The main problem is to find out the data that has not changed. These data do not need to update the TS column. The method I think of is to compare the input data with all the target data, get the data that has not changed, and then filter out the data that has not changed from the input data, but this is not an ideal method, if the amount of data is large.

Regards

Shong

topic Re: Update timestamp for only upserted columns in Talend Studio

Update timestamp for only upserted columns

Re: Update timestamp for only upserted columns