topic Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data in Talend Studio

Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

Anonymous — Sat, 16 Nov 2024 07:13:23 GMT

Hi,

I want to migrate data from an on-premises DB in PostgreSQL to MS SQL Server in Azure. In the job I use the connection components for the connections and the DB components for the querys and inserts. Finally I commit the operations.

In the tDBOutput component for the MS SQL Server DB y set the Batch Size to 1 because the default value causes an error:

Error: Connection reset Exception in component tDBOutput_1 (asdasdasda) java.sql.SQLException: Invalid state, the Connection object is closed

I run the job but the process was very slow. I share a picture of the job:

Thanks

David

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

vapukov — Fri, 23 Nov 2018 10:35:49 GMT

Hi,

not depending is your postgresql on azure as well or it is inhouse Batch Size = 1 will always be extremely slow (in case if server in different networks, much slower)

You need check - what wrong with default value

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

Anonymous — Fri, 23 Nov 2018 13:36:44 GMT

Hi,

Have you tried Connection and ConnectionClose components?

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

vapukov — Fri, 23 Nov 2018 13:40:33 GMT

tCommit - will not work without connection, think it already done

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

Anonymous — Wed, 28 Nov 2018 08:08:16 GMT

Sorry,

the problem was in the ms sql drivers. I updated and all works

Thanks

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

Anonymous — Thu, 21 Mar 2019 23:51:52 GMT

Hi ,

I am also facing same issue. Can you help what steps you took to update the driver. Or is there any solution for this frustrating issue. Thanks in advanced.

Re: Data MIgration from PostgreSQL to MS SQL Server (in Azure) - Talend Open Studio for Big Data

Anonymous — Fri, 22 Mar 2019 08:06:34 GMT

Hello,

You must check in Talend for the updates and install it