tFileInputDelimited cannot read big csv (Error: "Java exceeding 65535 bytes limit")

[Anonymous]

Hi

I have to manage csv files with more then 2000 columns, I don't need all of them, but I can't filter them because the tFileInputDelimited component that I have put before FilterColumn give me the "Java exceeding 65535 bytes limit" error.

I don't know how I can select a subset of columns in advance, from metadata tab I cannot select only the first n columns..

Thanks in advance

Daniele

[Anonymous]

It depends on the task, is variable time to time.

Of course I won't analyze more than 100 columns together.

[Anonymous]

Has anybody a solution to this problem?

Given the fact that I don't need all 3000 columns but my files have, and that I have to choice different columns each time?

[TRF]

Hi,

Maybe can you use a tFileInputFullRow to read the file then, using a piece of Java code with regex, extract the desired columns to generate the data flow limited to these columns.