topic Re: talendStats_DB - Closed Connection in Talend Studio

talendStats_DB - Closed Connection

Anonymous — Sat, 16 Nov 2024 09:21:18 GMT

Hello

can anyone help please

when i run a job for hours , if returns failed with

Closed Connection
[ERROR]: sandbox_leapoc_project.jobconductor_prismbb_0_1.JOBCONDUCTOR_PRISMBB - talendStats_DB - Closed Connection

what could be closing the connection

thanks for your help

Re: talendStats_DB - Closed Connection

Anonymous — Wed, 30 Aug 2017 04:31:11 GMT

Hello,

Would you mind posting your current job design screenshots on forum which will be helpful for us to address your issue?

Best regards

Sabrina

Re: talendStats_DB - Closed Connection

Anonymous — Wed, 30 Aug 2017 13:32:24 GMT

I have attached it to this post

regards

Buks

Buks.jpg

Re: talendStats_DB - Closed Connection

Anonymous — Thu, 31 Aug 2017 04:04:06 GMT

Hello,

Have you tried to check out "Die on error" option to see if there is any more error message printed on console?

Best regards

Sabrina

Re: talendStats_DB - Closed Connection

Anonymous — Sun, 03 Sep 2017 10:40:32 GMT

I checked out Die on error and below are the errors i got.

Starting job FW_GZ_HDFS_ORACLE at 09:07 03/09/2017.

[statistics] connecting to socket on port 3635
[statistics] connected
[WARN ]: org.apache.hadoop.io.compress.zlib.ZlibFactory - Failed to load/initialize native-zlib library
[FATAL]: sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE - tOracleOutput_1 IO Error: Connection reset
caused by: IO Error: Connection reset
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
   at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
   at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
   at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
   at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
   ... 2 more
Caused by: java.net.SocketException: Connection reset
   at java.net.SocketInputStream.read(SocketInputStream.java:210)
   at java.net.SocketInputStream.read(SocketInputStream.java:141)
   at oracle.net.ns.Packet.receive(Packet.java:311)
   at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
   at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
   at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
   at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
   at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
   at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
   at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
   at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
   at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
   at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
   at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
   ... 6 more
Exception in component tOracleOutput_1 (FW_GZ_HDFS_ORACLE)
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
   at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
   at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
   at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
   at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
   at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
   ... 2 more
Caused by: java.net.SocketException: Connection reset
   at java.net.SocketInputStream.read(SocketInputStream.java:210)
   at java.net.SocketInputStream.read(SocketInputStream.java:141)
   at oracle.net.ns.Packet.receive(Packet.java:311)
   at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
   at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
   at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
   at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
   at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
   at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
   at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
   at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
   at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
   at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
   at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
   at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
   ... 6 more
[statistics] disconnected
Job FW_GZ_HDFS_ORACLE ended at 10:01 03/09/2017. [exit code=1]

Re: talendStats_DB - Closed Connection

Anonymous — Mon, 04 Sep 2017 05:09:51 GMT

Hello,

Could you please try to use this solution to see if it works?

In tPreJob use Oracle connection component and enable autocommit. Set use connection option in tOracleOutput and check again.

tpreJob-->tOracleConnection

| on subjobOk

Input source -> tmap -> toracleoutput

Best regards

Sabrina

Re: talendStats_DB - Closed Connection

Anonymous — Wed, 06 Sep 2017 07:53:38 GMT

Hi Sabrina

it runs but extremely very slow and at some stage it paused/stopped for about 10mins and could not wait so i killed the job

is it expected to pause or wait like that .

can you please explain what is going on in the background with the tOracleConnection while its waiting and what do we achieve with

tpreJob-->tOracleConnection

| on subjobOk

any reasons why its very slow

thanks

Buks

Re: talendStats_DB - Closed Connection

Anonymous — Wed, 06 Sep 2017 09:14:56 GMT

Hi,

Performance issue is usually cause by the DB connection or the job design.

Are you using talend subscription solution? From your screenshot, we see that there is "jobscript" feature in your studio.

If so, it is recommended that you should create a case on talend support portal. In this way, we can give you a remote assistance(webex) through support cycle with priority.

https://login.talend.com/support-login.php.

Best regards

Sabrina