My requirement is to load data from source table and then Insert/Update the records in target table. Both the source and target are SQL Servers but these are on different machines(servers).
I have created the job in talend and its upserting the data correctly, but the issue with this process is that it's very slow. Its processing 917 rows/s. I tried different ways to improve the performance but had no luck.
Here are the process and system details
Records to be processed: around 3 mn
Total records in target table: 125 mn
System RAM:32GB
OS: Windows sever 2012 R2/Windows 7
Approaches I tried
1. Installed Talend V6.1.0
used tMSSQLInput->tMSSQLOutput and JDBC connection
updated the parameters -Xms256M and -Xmx1048M with different values but it didn't improve the performance
2. Installed Talend V5.6.2
used tDBInput-> tDBOutput and odbc connections for source and target databases but still no improvement.
Attached is the screenshot of the talend job.
Please let me know if anyone has any suggestions.”
Thanks in advance!
