Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi ,
I am doing SCD1 for my source(both source and target are sqlserver DB). based on key column.(tmap)
There are around 25-30 fields on which I need to perform SCD1.fields are int ,Boolean ,date or Char
There are about 2.3 million records on first run and then every run there are about 50000 records which will be inserted or updated.
But on 2nd run I am getting performance issue. job is not running at all.I increased XMS and other parameter but still getting timeout.
So my question is
1)How can I do SCD1 using MD5 in tmap?will this resolve performance issue?
2)Can the inbuilt SCD Talend component handle this scenario?
Hello,
Are you calling MD5 routine function in your tMap? Could you please show us your job design and setting screenshots which will be helpful for us to address your performance issue?
Best regards
Sabrina