Postgresql SCD component

sushantk19 — Sat, 16 Nov 2024 02:19:59 GMT

Hi,

I have a scenario regarding SCD2. I have to implement SCD2 based on Deleted field. i.e if deleted timestamp changes, then a new record should be created as active one and earlier record should be end dated. Now, requirement is that valid_from date for new record should be same timestamp as my deleted updated timestamp i.e if you see below, the expected output should have timestamp as 25.05.2020 08:01:00 and NOT 25.05.2020 13:26:00(job run time). But, when i try to change the creation dropdown to "input field", it doesnt allow me to write anything. Also, if i pick up and drop deleted_datetime field in complement section then, i cannot use that field as tracking my SCD2 changes.

Question is : Can the same field be used to track SCD2 changes and pass the value to Valid_from field?

As per "Job start time"

Subscription ID	Deleted	Valid From	Valid To
123	NULL	01.10.2016 10:30:00	25.05.2020 13:26:00
123	25.05.2020 08:01:00	25.05.2020 13:26:00	31.12.9999 23:59:59

Expected Output:

Subscription ID	Deleted	Valid From	Valid To
123	NULL	01.10.2016 10:30:00	25.05.2020 08:01:00
123	25.05.2020 08:01:00	25.05.2020 08:01:00	31.12.9999 23:59:59

Re: Postgresql SCD component

manodwhb — Tue, 26 May 2020 09:22:24 GMT

@sushantk19 , you need to implement SCD2 with out scd component,you need to use tmap.

Re: Postgresql SCD component

sushantk19 — Tue, 26 May 2020 11:32:12 GMT

ok. is it possible to implement the above scenario using the SCD component?

Re: Postgresql SCD component

manodwhb — Tue, 26 May 2020 12:08:54 GMT

@sushantk19, you cannot manage the way you want the dates with SCD component.

topic Postgresql SCD component in Talend Studio

Postgresql SCD component

Re: Postgresql SCD component

Re: Postgresql SCD component

Re: Postgresql SCD component