topic Re: remove non static header from a file in Talend Studio

remove non static header from a file

Anonymous — Tue, 24 Apr 2018 22:31:21 GMT

Hi,

I have a use case where a file comes to my system daily has multiple headers.

The no. of header counts are not same for each file. They can be 1,5,10, etc but there is an identification that says where the header ends.

E.g Inside the file, here in the below example the record begins with "Cards_14Q1_1" then headers, end of header(EOH), actual data header followed by actual data elements

EOH

AccId|Branch Address|Legal Entity|Cross Border

XB124|920|100|N

67894|920|110|N

B1000|857|100|Y

Expected output after removing the headers:

XB124|920|100|N

67894|920|110|N

B1000|857|100|Y

Please advise.

Thanks,

Brat

Re: remove non static header from a file

vboppudi — Tue, 24 Apr 2018 23:04:52 GMT

Hi,

Are you looking for the following output?

flag: row2.line.equals("Cards_14Q1_1")?false:row2.line.equals("AccId|Branch Address|Legal Entity|Cross Border")?true:Var.PreFalg

Regards,

Re: remove non static header from a file

Anonymous — Tue, 24 Apr 2018 23:19:05 GMT

Hi Veera,
Thanks for your quick reply. Yes that is my expected output.

I have further query what if the first record for each file does not start with value “Cards_14Q_1” meaning the first record can be any value which is unknown.

Will the below provided solution work?

Thanks for the help!

Re: remove non static header from a file

Anonymous — Tue, 24 Apr 2018 23:20:50 GMT

Also I would like to remove the header from my output.

Re: remove non static header from a file

vboppudi — Tue, 24 Apr 2018 23:40:42 GMT

try with this

flag=row2.line.equals("AccId|Branch Address|Legal Entity|Cross Border")?true:Var.PreFalg==null?false:Var.PreFalg

Regards,

Re: remove non static header from a file

vboppudi — Tue, 24 Apr 2018 23:45:24 GMT

Please try below for removing header

Regards,

Re: remove non static header from a file

Anonymous — Wed, 25 Apr 2018 01:51:34 GMT

thanks Veera. It went through!

Re: remove non static header from a file

Anonymous — Wed, 02 May 2018 02:58:11 GMT

Hi,

I have same issue and I am new to Talend. The way we are hard coding the Header Record is not going to solve my problem. The logic I want to implement is remove all the records preceding EOH and one record after EOH. Is there any dynamic Solution? I am thinking of the following, but not able to design.

1. Assign Record Number to each Record.

2. Find out the Record Number with "EOH" Say EOHRECNUM (Any other record having EOH in between field will not qualify, eg GEOHYDRO)

3. Write an expression to filter record number less than equals to EOHRECNUM + 1

Best,

Dhiren