Unhandled event loop exception when i am uploading large excel file

[Anonymous]

AS suggested i have changed the TOS_DI-win-x86_64 file values as below

-vmargs
-Xms4096m
-Xmx8192m

i have tried 1024/2048 , 2048/4096 , 4096/8192 but still i am getting the same problem

Logs i am getting from below location

C:\talend\TOS_DI-Win32-20170510_1410-V6.4.0\workspace\.metadata

!ENTRY org.eclipse.ui 4 0 2017-06-14 12:27:08.104
!MESSAGE Unhandled event loop exception
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at org.apache.xmlbeans.impl.store.Cur.createElementXobj(Cur.java:257)
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.startElement(Cur.java:2992)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1413)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1378)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1363)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:370)
at org.apache.poi.POIXMLTypeLoader.parse(POIXMLTypeLoader.java:144)
at org.openxmlformats.schemas.spreadsheetml.x2006.main.WorksheetDocument$Factory.parse(Unknown Source)
at org.apache.poi.xssf.usermodel.XSSFSheet.read(XSSFSheet.java:183)
at org.apache.poi.xssf.usermodel.XSSFSheet.onDocumentRead(XSSFSheet.java:175)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.parseSheet(XSSFWorkbook.java:438)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.onDocumentRead(XSSFWorkbook.java:403)
at org.apache.poi.POIXMLDocument.load(POIXMLDocument.java:190)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:266)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.init(ExcelReader.java:144)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.<init>(ExcelReader.java:93)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.viewExcelFile(ExcelFileStep1Form.java:629)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.access$5(ExcelFileStep1Form.java:604)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form$7.modifyText(ExcelFileStep1Form.java:481)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:179)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1085)

[Anonymous]

Yes this issue is only occurring when i am uploading large excel file.

I have not try with the v 6.3.
If you have any solution for this problem please let me know as we are doing the POC for our migration. This issue creating problem for us.

[Anonymous]

Hi,

About your "Unhandled event loop exception" issue when create a big excel file in metadata, please create a jira issue on talend bug tracker.

Best regards

Sabrina

[Anonymous]

Hi,

I have exactly the same issue, and I wanted to know if that problem was solved or not ?

My excel file is around 46000 rows...

Regards

Flo

[Anonymous]

Hello Flo,

Have you already tried to changed the VM argument value in your studio to see if it works for you?

Please have a look at my screenshot.

Best regards

Sabrina

[Anonymous]

Hi Sabrina,

I did it and I put the same option in the .ini files.

I also realisde that I forgot to change to the "event mode" instead of "User mode" and that's solve the problem.

Thanks for your help

Cheers

Florian

[Anonymous]

Hello Florian,

Thanks for your prompt reply.

Hope this article about:https://community.talend.com/t5/Migration-Configuration-and/OutOfMemory-Exception/ta-p/21669/jump-to... will be helpful for you.

Best regards

Sabrina

[HemanthSai]

Hi,

  is this issue resolved completely, because i am getting a similar error.

 After uploading the data into the tfileInputDelimited, I am trying to view the data using the Data Viewer.

Then I am facing this issue.Input file has more than 5 million records and I have tried changing the JVM memory settings that didn't worked out.

   

[Anonymous]

Hello,

What is your RAM? How did you set your JVM? More information will be preferred.

Best regards

Sabrina

[HemanthSai]

Hi Sabrina,

My RAM size is 16GB and JVM settings.

[Anonymous]

Hello,

The exception with the error message you have here means that java has reached its maximum memory setting, yet it needs more.

Did you create a file metadata for your input excel file? How many columns do you have in your excel ?

Note that window > preferences > talend > run/debug has no effect on creating the metadata. For that, you need to edit the .ini file that matches the .exe you use to run the studio.

Best regards

Sabrina