talendStats_DB - Closed Connection

[Anonymous]

Hello

can anyone help please

when i run a job for hours , if returns failed with

Closed Connection
[ERROR]: sandbox_leapoc_project.jobconductor_prismbb_0_1.JOBCONDUCTOR_PRISMBB - talendStats_DB - Closed Connection

what could be closing the connection

thanks for your help

[Anonymous]

Hello,

Would you mind posting your current job design screenshots on forum which will be helpful for us to address your issue?

Best regards

Sabrina

[Anonymous]

Hi

I have attached it to this post

regards

Buks

Buks.jpg

[Anonymous]

Hello,

Have you tried to check out "Die on error" option to see if there is any more error message printed on console?

Best regards

Sabrina

[Anonymous]

I checked out Die on error and below are the errors i got.

Starting job FW_GZ_HDFS_ORACLE at 09:07 03/09/2017.

[statistics] connecting to socket on port 3635
[statistics] connected
[WARN ]: org.apache.hadoop.io.compress.zlib.ZlibFactory - Failed to load/initialize native-zlib library
[FATAL]: sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE - tOracleOutput_1 IO Error: Connection reset
caused by: IO Error: Connection reset
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
    at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
    at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
    at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
    ... 2 more
Caused by: java.net.SocketException: Connection reset
    at java.net.SocketInputStream.read(SocketInputStream.java:210)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at oracle.net.ns.Packet.receive(Packet.java:311)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
    at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
    ... 6 more
Exception in component tOracleOutput_1 (FW_GZ_HDFS_ORACLE)
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
    at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
    at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
    at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
    ... 2 more
Caused by: java.net.SocketException: Connection reset
    at java.net.SocketInputStream.read(SocketInputStream.java:210)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at oracle.net.ns.Packet.receive(Packet.java:311)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
    at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
    ... 6 more
[statistics] disconnected
Job FW_GZ_HDFS_ORACLE ended at 10:01 03/09/2017. [exit code=1]

[Anonymous]

Hello,

Could you please try to use this solution to see if it works?

In tPreJob use Oracle connection component and enable autocommit. Set use connection option in tOracleOutput and check again.

tpreJob-->tOracleConnection

                   | on subjobOk

Input source -> tmap -> toracleoutput

Best regards

Sabrina

[Anonymous]

Hi Sabrina

it runs but extremely very slow and at some stage it paused/stopped for about 10mins and could not wait so i killed the job

is it expected to pause or wait like that .

can you please  explain what is going on in the background with the tOracleConnection while its waiting and what do we achieve with

tpreJob-->tOracleConnection

                   | on subjobOk

any reasons why its very slow

thanks

Buks

[Anonymous]

Hi,

Performance issue is usually cause by the DB connection or the job design.

Are you using talend subscription solution? From your screenshot, we see that there is "jobscript" feature in your studio.

If so, it is recommended that you should create a case on talend support portal. In this way, we can give you a remote assistance(webex) through support cycle with priority.

https://login.talend.com/support-login.php.

Best regards

Sabrina