while we running jobs , we are receiving below error from job :
FYI : we are able to connect to MDM web UI and server with out issues during this error happens, we also tried to access MDM URL on talend studio we successful connection as well.
we tried restarting mdm servers and created new task and redepolyed job but it works as temporary fix not as permananet , again we recieved below error very shortly.
can anyone help on below errors and permanent fix?
Error deatils:
[ERROR]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - tMDMOutput_1_In - Unexpected error:Could not send Message. [ERROR]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - tMDMOutput_1_In - Unexpected error:Response was of unexpected text/html ContentType. Incoming portion of HTML stream: <!DOCTYPE html><html><head><title>Apache Tomcat/8.0.20 - Error report</title><style type="text/css">H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}.line {height: 1px; background-color: #525D76; border: none;}</style> </head><body><h1>HTTP Status 500 - A non-transactional (auto-commit) operation has an active transaction after operation completion.</h1><div class="line"></div><p><b>type</b> Exception report</p><p><b>message</b> <u>A non-transactional (auto-commit) operation has an active transaction after operation completion.</u></p><p><b>description</b> <u>The server encountered an internal error that prevented it from fulfilling this request.</u></p><p><b>exception</b></p><pre>java.lang.IllegalStateException: A non-transactional (auto-commit) operation has an active transaction after operation completion.
yes we have checked it ,the same file we used to test in test environment during the issue happens it works well but not in production..it happening frequently when we redeploy same job it working as expecting.
Adding log file from test environment, we experience similar issue on test on 07/25/2017 with one of the job ..
ERROR]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - nulljavax.xml.ws.WebServiceException:Could not send Message. (jobInstanceID: 677097871) [WARN ]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - tWarn_14 - Message: Job_Status=MDM Load Failed#femsa_20170724_0017_shipto.csv#MDM. Code: 555 [WARN ]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - tWarn_15 - Message: error_msg=#femsa_20170724_0017_shipto.csv#MDM. Code: 555 [INFO ]: data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To - tMysqlRow_2 - Execute the query: 'update t_audit_file_sub set file_load_status='FAILED' where file_set_id=3987' has finished. [FATAL]: data_management.j_loaddata_a_001_master_1_4.j_LoadData_a_001_master - tRunJob_8 Child job returns 1. It doesn't terminate normally. Jul 25, 2017 5:03:52 PM org.apache.cxf.wsdl.service.factory.ReflectionServiceFactoryBean buildServiceFromClass INFO: Creating Service {http://www.talend.com/mdm}TMDMService from class org.talend.mdm.webservice.TMDMService Jul 25, 2017 5:04:54 PM org.apache.cxf.phase.PhaseInterceptorChain doDefaultLogging WARNING: Interceptor for {http://www.talend.com/mdm}TMDMService#{http://www.talend.com/mdm}putItemArray has thrown exception, unwinding now org.apache.cxf.interceptor.Fault: Could not send Message. at org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:64) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.endpoint.ClientImpl.doInvoke(ClientImpl.java:514) at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:423) at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:324) at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:277) at org.apache.cxf.frontend.ClientProxy.invokeSync(ClientProxy.java:96) at org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:139) at com.sun.proxy.$Proxy41.putItemArray(Unknown Source) at data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To.tMDMOutput_1_InProcess(j_LoadMDM_a_004_Ship_To.java:41143) at data_management.j_loadmdm_a_004_ship_to_1_5.j_LoadMDM_a_004_Ship_To$1tFileInputDelimited_11Thread$1ThreadXMLField_tMDMOutput_1_Out.run(j_LoadMDM_a_004_Ship_To.java:48395) Caused by: java.net.SocketTimeoutException: SocketTimeoutException invoking https://tccc-test-talend-631-mdm-02.tccc-test-datalake.coca-cola.com:8443/talendmdm/services/soap: Read timed out at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.mapException(HTTPConduit.java:1376) at org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.close(HTTPConduit.java:1360) at org.apache.cxf.transport.AbstractConduit.close(AbstractConduit.java:56) at org.apache.cxf.transport.http.HTTPConduit.close(HTTPConduit.java:651) at org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:62) ... 10 more Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
