topic Re: mssql update/insert very slow in Talend Studio

mssql update/insert very slow

Anonymous — Sat, 16 Nov 2024 12:52:11 GMT

I am updating/insert data from flat file to mssql database.
flatfileinput->tmap-mssqloutput
It is very slow. 5.9 rows/s.
Is there any suggestion or idea on this issue?
Thanks!

Re: mssql update/insert very slow

Anonymous — Mon, 13 Jun 2011 19:37:13 GMT

Talend will do a SELECT COUNT(*) with the WHERE based on the columns you have selected as the update key. If these columns are not indexed, or a query like that preforms poorly, that could explain the slowness.
Usually its a good idea to make the insert/update decision in a tMap and then do batches of updates and inserts independently.

Re: mssql update/insert very slow

Anonymous — Mon, 13 Jun 2011 21:37:48 GMT

Thanks for the reply. I will check the index.
Can you explain a little bit more in detail about how to make the insert/update decision in a tMap and then do batches of updates and inserts independently?
Thanks for your help.