Talend job to Insert/Update data on SQL Server is very slow

Anonymous — Wed, 09 Dec 2015 01:07:11 GMT

My requirement is to load data from source table and then Insert/Update the records in target table. Both the source and target are SQL Servers but these are on different machines(servers).

I have created the job in talend and its upserting the data correctly, but the issue with this process is that it's very slow. Its processing 917 rows/s. I tried different ways to improve the performance but had no luck.

Here are the process and system details
Records to be processed: around 3 mn
Total records in target table: 125 mn
System RAM:32GB
OS: Windows sever 2012 R2/Windows 7

Approaches I tried
1. Installed Talend V6.1.0
used tMSSQLInput->tMSSQLOutput and JDBC connection
updated the parameters -Xms256M and -Xmx1048M with different values but it didn't improve the performance
2. Installed Talend V5.6.2
used tDBInput-> tDBOutput and odbc connections for source and target databases but still no improvement.

Attached is the screenshot of the talend job.

Please let me know if anyone has any suggestions.”
Thanks in advance!

Re: Talend job to Insert/Update data on SQL Server is very slow

Anonymous — Wed, 09 Dec 2015 06:54:29 GMT

Hi,

Can you upload again the screenshots you wanted to show, please? For some reason it didn't make it to your post.

Best regards
Sabrina

Re: Talend job to Insert/Update data on SQL Server is very slow

Anonymous — Mon, 21 Dec 2015 01:48:31 GMT

Here is the screenshot

Re: Talend job to Insert/Update data on SQL Server is very slow

Anonymous — Mon, 21 Dec 2015 01:56:47 GMT

Please let me know if you are not able to view the attached image.
Thanks!

topic Re: Talend job to Insert/Update data on SQL Server is very slow in Talend Studio

Talend job to Insert/Update data on SQL Server is very slow

Re: Talend job to Insert/Update data on SQL Server is very slow

Re: Talend job to Insert/Update data on SQL Server is very slow

Re: Talend job to Insert/Update data on SQL Server is very slow