tOracleSCDELT component gives slow performance to process comparatively low volume records

Anonymous — Sat, 16 Nov 2024 03:02:35 GMT

I am using tOracleSCDELT to load the dimensions in SCD type 2 method. Using it on a table to deal with 34 columns and on approx 60000 records.

But the performance is too slow as it take 1 and half min to process this small data set. Checking the backend code saw that it uses UPDATE with and EXIST to perform the operation which is

an expensive query on the database. Seems due to this the component is behaving so slow. Ideally for a small data set it should have been done within seconds.

Any suggestion on alternatives to uses or any optimization on this component tOracleSCDELT at talend level?

topic tOracleSCDELT component gives slow performance to process comparatively low volume records in Talend Studio

tOracleSCDELT component gives slow performance to process comparatively low volume records