topic having Big excel files as input in Talend Studio

having Big excel files as input

FarCry — Thu, 12 Apr 2018 15:22:21 GMT

I have 2 excel (they have the same schema) files that each one of them have respectivly 2 and 4 sheets with a total size of 11 Mo (around 150000 rows) and i want to load them into a postgresql database using tfileList and i dosen't work but when i delete 2 sheets from the second file it works so i'm wondering if its because of my pc memory(4 GB) or something else??

Re: having Big excel files as input

Anonymous — Fri, 13 Apr 2018 09:28:07 GMT

Hello,

Please try to check out "Die on error" option for tPostgresqlOutput component to see if there is any out of memory issue when build your job with big excel files as input.

You can allocate more memory to the job execution.

Here is a KB article about:https://community.talend.com/t5/Migration-Configuration-and/OutOfMemory-Exception/ta-p/21669

Best regards

Sabrina

Re: having Big excel files as input

TRF — Fri, 13 Apr 2018 15:07:39 GMT

Any error message displayed on the console?