topic Re: Reading a Pipe Delimited file with variable columns in Talend Studio

Reading a Pipe Delimited file with variable columns

Udaya1 — Wed, 07 Oct 2020 03:24:53 GMT

Hi,

I have a Pipe Delimited file with variable columns like shown below.

Row1 --column1|column2|column3|

Row3--colum1|column2|column3|column4|

Tried with different ways to read this file, able to read the file, but not able to do any further filter.

My requirement is based on column3 value, a different file to be created.

Any thoughts how to achieve this in Talend.

Thanks,

Uday

Re: Reading a Pipe Delimited file with variable columns

manodwhb — Wed, 07 Oct 2020 09:03:22 GMT

@udaya paduchuri , you can use tfilterrows component and you can filter and generate the required output file.

Thanks,

Manohar

Re: Reading a Pipe Delimited file with variable columns

Udaya1 — Wed, 07 Oct 2020 10:36:50 GMT

@Mano--I tried that way, but the problem is the columns are not consistent, hence tfilter is not working.

Re: Reading a Pipe Delimited file with variable columns

Ani1 — Wed, 07 Oct 2020 16:16:17 GMT

Hi Uday,

If you have the headers for all the 5 columns, then after reading the file you can use a tMap to split according to column 3 and output the result to separate files.

Re: Reading a Pipe Delimited file with variable columns

Udaya1 — Thu, 08 Oct 2020 06:07:12 GMT

@Ani--Unfortunately, there are no headers for the columns.

Thanks,

Uday