topic Re: How to insert huge flat file -> CLOB column table in Talend Studio

How to insert huge flat file -> CLOB column table

Anonymous — Wed, 19 Feb 2014 10:24:51 GMT

Hello,
I'm trying to insert big files (> 1GB) into a CLOB column of my Oracle table.
I did it by using internal "stringbuffer" variable types...
Now, I'm stuck because I get "out-of-memory : Java heap space" when the file is too big (failure when the file is bigger than 200Mb). It's not a solution for me to extend -Xmx VM parameters to very high values...
Is there a way to have the same result by saving memory somewhere (kind of of CLOB inserting in streaming ?).
Thanks a lot for your feedback,
François,

Re: How to insert huge flat file -> CLOB column table

Anonymous — Wed, 19 Feb 2014 16:28:18 GMT

Currently not unfortunately but I have in the near future the same problem and start currently building a component for it. A component for Oracle what especially writes CLOB and BLOB. It is actually not a big deal but must be done.

Re: How to insert huge flat file -> CLOB column table

Anonymous — Thu, 20 Feb 2014 07:28:12 GMT

Thanks for you reply... Can you stayed in touch with us when you will develop the component...
In the meantime, does someone already have another solution ? I'm stuck -
François,

Re: How to insert huge flat file -> CLOB column table

Anonymous — Fri, 21 Feb 2014 10:11:48 GMT

Hello Francois,
You can create a routine to copy the file as stream into the database. Map that routing using Map component.
Regards
Gopa