Data loading from MS SQL Server DB to other MS SQL Server DB is very low compared to SSIS

[Anonymous]

HI All,

My requirement is to synchronize the data between two different MS SQL Servers. My source table has 3.8Million rows.

When I tried to load to data from Source to Target below are my observations with Talend Vs SSIS

   1. With Primary Key on Target Table: SSIS has taken ~6hrs, Talend has taken ~4.5hrs  

   2. Without primary Key on Target Table: SSIS has taken 59Sec only, Talend has taken ~1hr (Max of 350Rows/Sec) and still running

Below are my questions:

A) Why Talend Data load is very slow compared to SSIS even though it is big amount of data?

B) Do we have any components like FastLoad/BulkInsertLoad for SQL Server in Talend?

Note: I am inserting data, there are no updated as it is first time loading. I did not have any blockings on my SQL Servers.  I have used tMSSQLInput, tMSSQLOutput components in Talend job design.

[Anonymous]

Hi,

I have also tMSSQLOutputBulkExec components. But it requires Remote File path where the data from my source table(server) was already loaded.
I tried to load the data into file first and then used tMSSQLSQLBulkEXEC component to load the data. But it throwing error.

Please suggest me on this approach if i am going wrong

[Anonymous]

HI,

Can you please try to keep the file on a different drive? 

Because in Windows the files at Desktop not accessible by some of the programs

The error suggests me that.

Cheers!

Gatha

[Anonymous]

Hi,

Why it takes around 1 hour to load data from one db table to other db table in Azure? Also there is need to change the batch size and JVM argument size for allocating 4 GB space to talend job to execute for 7 million data. While SSIS does the same in just 15 minutes. Do anyone have solution for this? I am using Talend Open Studio V7.0.1

Thanks,

Dhara