Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
NNayal1600240775
Contributor III
Contributor III

Update in tmssqloutput is taking too much time

Hi,

I need to update 2 columns of the table for around 5k records but the commit is taking too much longer -approx more than 1 hr. Any suggestion on how to make this process faster as i have around 50k record to update and that takes more than 7-8hrs.

0695b00000hr89dAAA.png 

this is advance setting for tmssqloutput & tmssqlconnection0695b00000hr8ACAAY.png0695b00000hr8A7AAI.png: 0695b00000hr89sAAA.png 

3 Replies
Stephen_Elves1
Contributor
Contributor

Experiemnt with using the Bulk versions of the output components they are generally MUCH quicker.

Anonymous
Not applicable

Hello,

In your job, there is a tMap component which is a cache component and consuming too much memory.

For a large set of data, please try to store the data on disk instead of memory on tMap.

Bets regards

Sabrina

NNayal1600240775
Contributor III
Contributor III
Author

Hi @Xiaodi Shi​ i added Store temp data ='true' in the lookup table.

and in tmap setting i added path of store on disk as i have mentioned below - but still i get the same results . its taking too long to commit the updates same as before.0695b00000hrTk1AAE.png0695b00000hrTjwAAE.png 

0695b00000hrTjmAAE.png0695b00000hrTk6AAE.png