Load file into Azure DB with MSSQLConnection

gaston_guy — Mon, 05 Dec 2016 17:52:09 GMT

Hello,

I just want to load some files into a Azure DB.
I am using the "Microsoft SQL Server" DB Type for the connection.

The problem is that when I insert like more than 10.000 rows, I have sometimes (90% of the time) an error:


Exception in component tMSSqlOutput_5
java.sql.BatchUpdateException: I/O Error: Connection reset
	at net.sourceforge.jtds.jdbc.JtdsStatement.executeBatch(JtdsStatement.java:1091)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tFileInputDelimited_5Process(extractGC_child2.java:28852)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tFileList_6Process(extractGC_child2.java:32386)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tFileList_5Process(extractGC_child2.java:31540)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tMSSqlRow_1Process(extractGC_child2.java:30657)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tLoop_2Process(extractGC_child2.java:30440)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tFileList_4Process(extractGC_child2.java:29664)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tJava_3Process(extractGC_child2.java:34020)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tMSSqlInput_1Process(extractGC_child2.java:33593)
	at dev_storch.extractgc_child2_0_1.extractGC_child2.tFTPConnection_2Process(extractGC_child2.java:33154)
[FATAL]: dev_storch.extractgc_child2_0_1.extractGC_child2 - tMSSqlOutput_5 I/O Error: Connection reset
[FATAL]: dev_storch.extractgc_child2_0_1.extractGC_child2 - tMSSqlRow_7 Invalid state, the Connection object is closed.

But when the volume of data inserted is lower, I don't receive any error.

My configuration looks like this:

tMSSQLConnection Then I have some components to load files from a folder and load it inside a table.
The error comes at the tMSSQLOutput.
The following of the job are logs filling.

I tried to change the Batch size, to not use a DBConnection, but doesn't work.

I tried with a Generic JDBC component and it seems to work everytime. But I don't want to use the generic JDBC components because on the ouptut components, we can not choose the colume DB type (but maybe someone know how is it possible):

MSSQL:

Generic JDBC:

Thank you in advance...

Re: Load file into Azure DB with MSSQLConnection

Anonymous — Fri, 09 Dec 2016 09:24:27 GMT

Hi,
You have tried to [font=Verdana, Helvetica, Arial, sans-serif] decrease the batch size? W[/font] ith Azure data sources, h[font=Verdana, Helvetica, Arial, sans-serif] ave you tried to u[/font] pdate your MS SQL java driver to see if it works

Could you please indicate what's the build version you are using?
Best regards
Sabrina

topic Re: Load file into Azure DB with MSSQLConnection in Talend Studio

Load file into Azure DB with MSSQLConnection

Re: Load file into Azure DB with MSSQLConnection