Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I have built a pipeline where we are upsetting values in snowflake.
However, when I am upsetting on snowflake, all entries get upserted as I have a column TS = TalendDate.parseDate(
"yyyy-MM-DD hh:mm:ss"
, TalendDate.getDate("yyyy-MM-DD hh:mm:ss"
)) which gets the current time.I just want to update this column when there is an update/insert in table data. How could this be achieved.
Any help is appreciated.
Thanks
Hi
In this example, the TS value which gets the current time is always updated even though there is no changed data in other columns. The main problem is to find out the data that has not changed. These data do not need to update the TS column. The method I think of is to compare the input data with all the target data, get the data that has not changed, and then filter out the data that has not changed from the input data, but this is not an ideal method, if the amount of data is large.
Regards
Shong