topic Re: Splitting the input files into multiple files in Talend Studio

Splitting the input files into multiple files

Anonymous — Sat, 16 Nov 2024 07:22:40 GMT

I am new to talend and I have scenario where I have csv file with 250 columns with more records i need to split one input file into two o/p files based on the columns but all the columns are unique i.e I need to split first 150 columns into one output and rest in the other output file. can you please help or suggest me some option for this scenario

Re: Splitting the input files into multiple files

TRF — Wed, 31 Oct 2018 09:14:53 GMT

Use a tMap with 2 or more output flows with the desired columns selected from the input flow

Re: Splitting the input files into multiple files

Anonymous — Wed, 31 Oct 2018 09:48:12 GMT

Thanks. But I don't need manually selection of columns to output field.

Is there any way for automatically picking the first 150 columns from the input file and mapping into the output file??

Re: Splitting the input files into multiple files

TRF — Wed, 31 Oct 2018 09:53:37 GMT

In this case, a tJavaRow with String.split() should be the solution

Re: Splitting the input files into multiple files

David_Beaty — Wed, 31 Oct 2018 15:28:38 GMT

You probably want to use the tFileInputFullRow component as well to read in the entire line as one string.

Exercise care on what the input file is delimited on - dont use a delimiter that's possible to also appear within the data itself.

Thanks

David