I have a use case where a file comes to my system daily has multiple headers.
The no. of header counts are not same for each file. They can be 1,5,10, etc but there is an identification that says where the header ends.
E.g Inside the file, here in the below example the record begins with "Cards_14Q1_1" then headers, end of header(EOH), actual data header followed by actual data elements
Hi Veera, Thanks for your quick reply. Yes that is my expected output.
I have further query what if the first record for each file does not start with value “Cards_14Q_1” meaning the first record can be any value which is unknown.
I have same issue and I am new to Talend. The way we are hard coding the Header Record is not going to solve my problem. The logic I want to implement is remove all the records preceding EOH and one record after EOH. Is there any dynamic Solution? I am thinking of the following, but not able to design.
1. Assign Record Number to each Record.
2. Find out the Record Number with "EOH" Say EOHRECNUM (Any other record having EOH in between field will not qualify, eg GEOHYDRO)
3. Write an expression to filter record number less than equals to EOHRECNUM + 1
