[resolved] Errors when loading large data sets to/from Microsoft Azure
Hello,
When trying to use a Microsoft Azure connection in my Talend package (Data Integration v5.6) I get errors like the following:
"I/O Error: Connection reset
Exception in component tMSSqlOutput_1
java.sql.SQLException: Invalid state, the Connection object is closed.
at net.sourceforge.jtds.jdbc.ConnectionJDBC2.checkOpen(ConnectionJDBC2.java:1699)
at net.sourceforge.jtds.jdbc.ConnectionJDBC2.commit(ConnectionJDBC2.java:2085)
at dbservicestest.azure_query_test_0_1.Azure_Query_Test.tMSSqlInput_2Process(Azure_Query_Test.java:1397)
at dbservicestest.azure_query_test_0_1.Azure_Query_Test.tMSSqlConnection_1Process(Azure_Query_Test.java:529)
at dbservicestest.azure_query_test_0_1.Azure_Query_Test.runJobInTOS(Azure_Query_Test.java:1755)
at dbservicestest.azure_query_test_0_1.Azure_Query_Test.main(Azure_Query_Test.java:1540)"
For example, in a job where I send rows from a local SQL database (via tMSSqlInput) to a tMSSqlOutput component connected to Azure, it is successful at loading a small number of rows (1-97), but when loading more rows (more than 98 or so) it fails with an I/O Error.
I will need to send tens of thousands of rows, so batching things in groups of 50 is not practical.
--Porter
Hi robbz23, I am facing the same issue for which your comment is to get it solved. Can you please guide me about the steps to be followed in order to resolve it?
Dear all,
I've noticed the same problem. With the default Talend driver I got 300 rows / second. With the most recent jdbc driver downloade from MS, I get 900 records / second.
