topic tDBSCD component - Addition of extra where clause in Talend Studio

tDBSCD component - Addition of extra where clause

Anjalivnr — Sat, 16 Nov 2024 00:47:03 GMT

Hi Everyone ,

Im using tDBSCD component to implement SCD type 2 dimension. it is working fine. But for some reason. we are suppose to reprocess the old files , which caused the incorrect record to be the most recent one.

So business suggested to use a last updated timestamp field to identify the latest record.

Im not sure how can i include this condition in SCD component. Looking for any help.

Re: tDBSCD component - Addition of extra where clause

Anjalivnr — Thu, 21 Jan 2021 03:15:24 GMT

We are not suppose the delete the records in production and process again. trying to incorporate through logic which can handle this type of scenarios

Re: tDBSCD component - Addition of extra where clause

Anjalivnr — Thu, 21 Jan 2021 04:26:33 GMT

@Shicong Hong . Any thoughts or suggestions.