Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
rchanda
Contributor II
Contributor II

Large CSV files

Hi,

 

Currently we are using Talend 6.5.1. I have a question regarding CSV file size limit in Talend. We have a requirement to extract data into CSV files using Talend Jobs. These CSV files could be around 1 or 2 GB. Is there any CSV file size limit in Talend? is it possible to generate large CSV files? Is it ok to generate large CSV files using Talend job ?

 

Please suggest.

 

Thank you

Labels (3)
1 Solution

Accepted Solutions
TRF
Champion II
Champion II

There is no size limit for csv files as soon as you don't try to get all the content in memory at once (using a tHashOutput for example).
In this case you need to set the JVM Xmx parameter according to the required memory (see Advanced Execute tab).

View solution in original post

1 Reply
TRF
Champion II
Champion II

There is no size limit for csv files as soon as you don't try to get all the content in memory at once (using a tHashOutput for example).
In this case you need to set the JVM Xmx parameter according to the required memory (see Advanced Execute tab).