topic Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1 in Talend Studio

[resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Sat, 16 Nov 2024 11:45:25 GMT

Hello,
My organisation is palnning to use Talend MDM tool suite and for that I installed MDM tool set and doing a demo.
I have installed and working with Talend MDM, also enjoied working MDM_DEMo project.
Now I have created a Data Container, Data Model, Entity and View in Studio. When I am logging in to Web UI then I can see my Entity/table there. Now when I try to load data into that entity, I am getting below error,
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.load_uom_to_mdm_1_0_1.Load_UOM_To_MDM_1.tWriteXMLField_1_InProcess(Load_UOM_To_MDM_1.java:1400)
at mdm_demo.load_uom_to_mdm_1_0_1.Load_UOM_To_MDM_1$1ThreadXMLField_tWriteXMLField_1_Out.run(Load_UOM_To_MDM_1.java:698)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
disconnected
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Can you please guide on whats going wrong ??

Please see attachments for further details

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 12 Feb 2014 05:48:41 GMT

Please see attachments..

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 12 Feb 2014 05:50:19 GMT

further attachments

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 12 Feb 2014 05:54:58 GMT

Model and Entity Details..

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 12 Feb 2014 05:56:19 GMT

Model and Entity Details..

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 12 Feb 2014 05:58:31 GMT

model

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Tue, 25 Feb 2014 14:24:21 GMT

Hi
Please note that it is case sensitive on the element name, I see the first element is 'ID' in the entity, however, it is 'Id' in the XML tree. Also, is the ID element defined as AUTO-INCRESMENT property in the entity? If so, remove Id column from the XML tree and check 'Generate ID' box on tMDMBulkLoad component.
Shong

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Wed, 26 Feb 2014 00:05:38 GMT

thanks Shong.
Actually now I have changed Id to Id and made sure that XML Tree names match with Element Names.
Also, the ID field is not system generated and I have a column called ROW_ID coming from database which is a
system generated key I want to use for ID of entity Unit_Of_Measure. But still I am facing below problem
Starting job Copy_of_Load_UOM_To_MDM at 11:04 26/02/2014.
connecting to socket on port 3432
connected
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM.tWriteXMLField_1_InProcess(Copy_of_Load_UOM_To_MDM.java:1779)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM$1ThreadXMLField_tWriteXMLField_1_Out.run(Copy_of_Load_UOM_To_MDM.java:1001)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
disconnected
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Job Copy_of_Load_UOM_To_MDM ended at 11:04 26/02/2014.
I will email you further details.
We are a customer of Talend and my organisation recently bought enterprise version/licensed version of Talend.
So Better I email you all details.
thanks

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 03:30:55 GMT

Hi
Which version of Talend Studio are you using?
Try to set the first element ID as loop element on tWriteXMLField. In addition, can you check if there exist null or empty value in ID column after tOracleInput component? To debug it, just need to add a tLogRow after tOracleInput to print the result on the console.
Shong

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 04:04:14 GMT

Hello Shong,
I am using Talend Open Studio for MDM (5.4.1r111943).
I have changed loop element to Id.
I dont think that there are null or empty value as I changed my query for test to extract 1 record only with below where condition
Where
ROW_ID=20

this query is working and extracting 1 record with ROW_ID as 20, but still job is failing.
Starting job Copy_of_Load_UOM_To_MDM at 14:49 27/02/2014.
connecting to socket on port 3993
connected
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM.tWriteXMLField_1_InProcess(Copy_of_Load_UOM_To_MDM.java:1780)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM$1ThreadXMLField_tWriteXMLField_1_Out.run(Copy_of_Load_UOM_To_MDM.java:1001)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
disconnected
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Job Copy_of_Load_UOM_To_MDM ended at 14:50 27/02/2014.

I created another job with manually entering data in tFixedFlowInput component and providing that component to tMDMBulkLoad but still that job also failing. Please see screnshots...does something wrong with my model ??

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 04:07:01 GMT

my data model screenshot and actual data model export.

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 04:09:46 GMT

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 06:02:10 GMT

Hi
Do you use RDBMS or XML DB as the MDM hub database? From your screenshot, I see the model name and the container name are different, if RDBMS, the model name and the container name should be the same.
Shong

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Thu, 27 Feb 2014 22:30:39 GMT

Hmn...thanks Shong....I am using XML DB as MDM hub database.
I was not knowing that the container name and model name need to be same.
I changed my data model name same as container name and ...bang...its WORKING !!!
the job is working. thanks alot for your help...appriciated...

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Anonymous — Fri, 28 Feb 2014 00:49:04 GMT

Great! Glad to see you resolve the problem and thanks for your feedback.
Shong