topic Re: Update in tmssqloutput is taking too much time in Talend Studio

Update in tmssqloutput is taking too much time

NNayal1600240775 — Fri, 15 Nov 2024 21:50:53 GMT

Hi,

I need to update 2 columns of the table for around 5k records but the commit is taking too much longer -approx more than 1 hr. Any suggestion on how to make this process faster as i have around 50k record to update and that takes more than 7-8hrs.

this is advance setting for tmssqloutput & tmssqlconnection:

Re: Update in tmssqloutput is taking too much time

Stephen_Elves1 — Thu, 04 May 2023 11:55:12 GMT

Experiemnt with using the Bulk versions of the output components they are generally MUCH quicker.

Re: Update in tmssqloutput is taking too much time

Anonymous — Fri, 05 May 2023 05:07:07 GMT

Hello,

In your job, there is a tMap component which is a cache component and consuming too much memory.

For a large set of data, please try to store the data on disk instead of memory on tMap.

Bets regards

Sabrina

Re: Update in tmssqloutput is taking too much time

NNayal1600240775 — Tue, 09 May 2023 07:59:35 GMT

Hi @Xiaodi Shi i added Store temp data ='true' in the lookup table.

and in tmap setting i added path of store on disk as i have mentioned below - but still i get the same results . its taking too long to commit the updates same as before.