topic Re: Best practices for using SCD in Talend Studio

Best practices for using SCD

dwhdeveloper — Wed, 08 Mar 2017 15:13:34 GMT

I am using tPostgresqlSCD.
The performance is really slow. It inserts 1 row per second or even slower.
Is there anyway to increase the peformance of it?
I tried 'Use memory saving modes'. Which makes it even slower.
I am inserting around 9000 rows in a 5 million rows dimension.
I even have much bigger dimensions also.

Re: Best practices for using SCD

Anonymous — Fri, 10 Mar 2017 09:01:14 GMT

Hi,
Could you please post your current job design screenshots into forum? Did you use any cache component in your work flow?
Best regards
Sabrina

Re: Best practices for using SCD

dwhdeveloper — Mon, 13 Mar 2017 14:15:29 GMT

I am attaching screenshot.
What do you mean by cache component?

Re: Best practices for using SCD

dwhdeveloper — Mon, 20 Mar 2017 13:40:54 GMT

I created an index on my source key it helped a little bit and made it faster.
Does it help to put indexes on SCD 2 columns as well?