topic Max limit size for Delimited file in Talend Studio

Max limit size for Delimited file

Anonymous — Sat, 16 Nov 2024 11:20:14 GMT

Hi,
What is the maximum limit of number of records can be inserted into a .csv file using tFileOutputDelimited component.. ?
I am using Talend Enterprise Big Data 5.5.1 edition.

Re: Max limit size for Delimited file

Anonymous — Mon, 26 Jan 2015 13:49:22 GMT

Errr, there is a limit? I didn't know there was one. I've done 74 million recently, that's my largest I think - Not sure if that helps answer your question but if there is an upper limit I would also like to know that.

Re: Max limit size for Delimited file

Anonymous — Mon, 26 Jan 2015 14:07:09 GMT

Thanks Pem. I am just trying to insert 9 million records. I just wanted to know whether there is a limit.
Does anyone know whether there is a limit.

Re: Max limit size for Delimited file

Anonymous — Mon, 26 Jan 2015 19:45:24 GMT

at talend com the only limit is yourself!
There is no built-in limit to the number of records you can output with a tFileOutputDelimited. Once you get into really HUGE (1B+) numbers of records, you do need to start considering resources on the server and may find that your particular job and hardware configuration imposes a limit on the number of records you can process ( disk space, memory, etc... )