topic Re: Unhandled event loop exception when i am uploading large excel file in Talend Studio

Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 08:04:44 GMT

AS suggested i have changed the TOS_DI-win-x86_64 file values as below

-vmargs
-Xms4096m
-Xmx8192m

i have tried 1024/2048 , 2048/4096 , 4096/8192 but still i am getting the same problem

Logs i am getting from below location

C:\talend\TOS_DI-Win32-20170510_1410-V6.4.0\workspace\.metadata

!ENTRY org.eclipse.ui 4 0 2017-06-14 12:27:08.104
!MESSAGE Unhandled event loop exception
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at org.apache.xmlbeans.impl.store.Cur.createElementXobj(Cur.java:257)
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.startElement(Cur.java:2992)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1413)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1378)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1363)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:370)
at org.apache.poi.POIXMLTypeLoader.parse(POIXMLTypeLoader.java:144)
at org.openxmlformats.schemas.spreadsheetml.x2006.main.WorksheetDocument$Factory.parse(Unknown Source)
at org.apache.poi.xssf.usermodel.XSSFSheet.read(XSSFSheet.java:183)
at org.apache.poi.xssf.usermodel.XSSFSheet.onDocumentRead(XSSFSheet.java:175)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.parseSheet(XSSFWorkbook.java:438)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.onDocumentRead(XSSFWorkbook.java:403)
at org.apache.poi.POIXMLDocument.load(POIXMLDocument.java:190)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:266)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.init(ExcelReader.java:144)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.<init>(ExcelReader.java:93)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.viewExcelFile(ExcelFileStep1Form.java:629)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.access$5(ExcelFileStep1Form.java:604)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form$7.modifyText(ExcelFileStep1Form.java:481)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:179)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1085)

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 09:15:18 GMT

It's not the JVM settings for the Studio you need to worry about so much here, it is the JVM settings for the job. This will show yo where you need to set these (http://garpitmzn.blogspot.co.uk/2013/08/talend-modify-jvm-arguments-for-job.html). By the way, there is no need to set the Xms to such a high value. The Xms is the initial memory allocation pool. This is meant to grow. Upping this will just immediately reserve that memory instead of letting it grow as it is needed.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 09:23:02 GMT

Hi I have changed the VM argument value as -Xms1024M and -Xmx2048M but still i was getting the same problem.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 09:24:35 GMT

Hi I have changed the VM argument value as -Xms1024M and -Xmx2048M but still i was getting the same problem.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 11:05:34 GMT

So you have changed the VM arguments as per the link I posted and ticked the "Use specific JVM arguments" on the "Advanced settings" tab on the "Run" tab of the job? You are running the job from the Studio, right?

If the answer is yes to the above, then how big is your Excel file?

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 11:40:52 GMT

Like i am getting this error when i am uploading excel . Excel has more than 50000 rows.
I think VM argument will work if we are running any job.
But here i am not running the job i am getting this exception when i am creating excel file in Talend.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 12:02:52 GMT

Ah I see, so when you are creating the metadata?

Sorry, I misunderstood. It sounds like a bug. If the file is not that big I would recommend manually creating the metadata for it (build the schema manually) and use that. Are you using the open source edition or the enterprise edition and what version? If you have a support contract, I would raise this.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 12:06:48 GMT

Yes i am creating the file manually only. I am selecting the excel right click from there i am browsing the excel file.
i am using free version of Talend

Talend Open Studio for Data Integration
Version: 6.4.0

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 14 Jun 2017 12:42:01 GMT

@shong, @xdshi have you seen this?

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 15 Jun 2017 03:52:45 GMT

Hello,

Does this issue only occur when you upload a large excel? Is it Ok with you when upload a simple excel? Could you try to use V 6.3 to see if this issue repro?

Best regards

Sabrina

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 15 Jun 2017 04:18:40 GMT

Yes this issue is only occurring when i am uploading large excel file.

I have not try with the v 6.3.
If you have any solution for this problem please let me know as we are doing the POC for our migration. This issue creating problem for us.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 20 Jul 2017 11:38:00 GMT

Hi,

About your "Unhandled event loop exception" issue when create a big excel file in metadata, please create a jira issue on talend bug tracker.

Best regards

Sabrina

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Tue, 21 Nov 2017 10:15:07 GMT

Hi,

I have exactly the same issue, and I wanted to know if that problem was solved or not ?

My excel file is around 46000 rows...

Regards

Flo

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 23 Nov 2017 06:53:03 GMT

Hello Flo,

Have you already tried to changed the VM argument value in your studio to see if it works for you?

Please have a look at my screenshot.

Best regards

Sabrina

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 23 Nov 2017 08:16:21 GMT

Hi Sabrina,

I did it and I put the same option in the .ini files.

I also realisde that I forgot to change to the "event mode" instead of "User mode" and that's solve the problem.

Thanks for your help

Cheers

Florian

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 23 Nov 2017 08:26:55 GMT

Hello Florian,

Thanks for your prompt reply.

Hope this article about:https://community.talend.com/t5/Migration-Configuration-and/OutOfMemory-Exception/ta-p/21669/jump-to/first-unread-message will be helpful for you.

Best regards

Sabrina

Re: Unhandled event loop exception when i am uploading large excel file

HemanthSai — Wed, 30 Jan 2019 10:33:42 GMT

Hi,

is this issue resolved completely, because i am getting a similar error.

After uploading the data into the tfileInputDelimited, I am trying to view the data using the Data Viewer.

Then I am facing this issue.Input file has more than 5 million records and I have tried changing the JVM memory settings that didn't worked out.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Wed, 30 Jan 2019 12:24:45 GMT

Hello,

What is your RAM? How did you set your JVM? More information will be preferred.

Best regards

Sabrina

Re: Unhandled event loop exception when i am uploading large excel file

HemanthSai — Wed, 30 Jan 2019 12:51:56 GMT

Hi Sabrina,

My RAM size is 16GB and JVM settings.

Re: Unhandled event loop exception when i am uploading large excel file

Anonymous — Thu, 31 Jan 2019 08:58:11 GMT

Hello,

The exception with the error message you have here means that java has reached its maximum memory setting, yet it needs more.

Did you create a file metadata for your input excel file? How many columns do you have in your excel ?

Note that window > preferences > talend > run/debug has no effect on creating the metadata. For that, you need to edit the .ini file that matches the .exe you use to run the studio.

Best regards

Sabrina