Large CSV files

rchanda — Sat, 16 Nov 2024 07:32:05 GMT

Hi,

Currently we are using Talend 6.5.1. I have a question regarding CSV file size limit in Talend. We have a requirement to extract data into CSV files using Talend Jobs. These CSV files could be around 1 or 2 GB. Is there any CSV file size limit in Talend? is it possible to generate large CSV files? Is it ok to generate large CSV files using Talend job ?

Please suggest.

Thank you

Re: Large CSV files

TRF — Wed, 03 Oct 2018 20:20:06 GMT

There is no size limit for csv files as soon as you don't try to get all the content in memory at once (using a tHashOutput for example).
In this case you need to set the JVM Xmx parameter according to the required memory (see Advanced Execute tab).

topic Large CSV files in Talend Studio

Large CSV files

Re: Large CSV files