Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

[Anonymous]

Hi,

I want to migrate data from an on-premises DB in PostgreSQL to MS SQL Server in Azure. In the job I use the connection components for the connections and the DB components for the querys and inserts. Finally I commit the operations.

In the tDBOutput component for the MS SQL Server DB y set the Batch Size to 1 because the default value causes an error:

 Error: Connection reset Exception in component tDBOutput_1 (asdasdasda) java.sql.SQLException: Invalid state, the Connection object is closed

I run the job but the process was very slow. I share a picture of the job:

 

Thanks

David

[vapukov]

Hi,

not depending is your postgresql on azure as well or it is inhouse Batch Size = 1 will always be extremely slow (in case if server in different networks, much slower)

You need check - what wrong with default value

[Anonymous]

Hi,

Have you tried Connection and ConnectionClose components?

[vapukov]

tCommit - will not work without connection, think it already done

[Anonymous · Accepted solution]

Sorry,

the problem was in the ms sql drivers. I updated and all works

Thanks

[Anonymous]

Hi , 

I am also facing same issue. Can you help what steps you took to update the driver. Or is there any solution for this frustrating issue. Thanks in advanced. 

[Anonymous]

Hello,

You must check in Talend for the updates and install it