topic Re: How to filter multiple row dynamically on the basis of String contents in Talend Studio

How to filter multiple row dynamically on the basis of String contents

Anonymous — Mon, 08 Oct 2018 07:15:13 GMT

Hi All,

I have a repository based delimited metadata, used as a schema for mapping a delimited file using tFileInputRegex component(use this component because using regular expression filter record related to gd_header, header, data, trailer from a input source file). schema is as follows:

account_gd_header

date_gd_header

branch_header

debitDetails_header

userValue_data

userdata_data

name_data

name_trailer

userdata_trailer

So i have schema in which every record type (gd_header, header, data, trailer) along with respective column name ism present. So i have to filter above schema. As i am mapping this schema to tMap for filtering purpose. All the records came in as a separate row value. I am unable to filter the record on the basis of record type. How can i achieve this?

Re: How to filter multiple row dynamically on the basis of String contents

Anonymous — Mon, 08 Oct 2018 11:33:35 GMT

Hi,

Could you please provide screen shots of your jobs and components so that Talend community members will get more insight about your query?

Warm Regards,

Nikhil Thampi

Re: How to filter multiple row dynamically on the basis of String contents

Anonymous — Tue, 09 Oct 2018 05:31:27 GMT

Hi NIkhilthampi,

Thanks for your response. I am giving details of my job:

(1) Sample extract file(extractSample.txt):

GH|UAT|10819|20180806|12345
H|GB |0.000|43256.78
R|15439|GEC |StaffAccount|239089.00|CB1|Equity|10095
R|16542|NEC |AccountSave|239213.00|CB2|Fund|10096
T|S706 |-66453829.00
GT|DL 0000002576327845|3053|0.00

(2) Metadata File describing above text file:

where,

ORD : order of particular record type in above extract sample file

COL_ALIAS: name of column used is above extract sample file

RECORD: record type identifier for extract sample file

SEQ: sequence of record

Each time this metadata will keep on changing as per the extract sample file. My requirement is how to map this metadata for above sample file to match data with respective COL_ALIAS. Any help in this regard will helpful.

Re: How to filter multiple row dynamically on the basis of String contents

Anonymous — Tue, 09 Oct 2018 08:00:34 GMT

Hi,

From current description, I am assuming that you would like to change the schema details in tMap dynamically. Unfortunately, you cannot dynamically change the schema structure on the fly in tMap component.

I am afraid, the query is still vague from your current description. Could you please share the current job screen shot you have created, the sample input files and output files so that we can help you better.

Warm Regards,

Nikhil Thampi

Re: How to filter multiple row dynamically on the basis of String contents

Anonymous — Thu, 11 Oct 2018 08:03:15 GMT

Hi Nikhil,

Thanks for your suggestion. see i am not able to process or design a job for my query. I am seeking guidance. As this is the file

(1) Sample extract file(extractSample.txt):

(2) Metadata File describing above text file:

my expected output is:

DATA|RECORD|COL_ALIAS

GH|gd-header|User Defined Value

UAT|gd-header|extname

10819|gd-header|extid

20180806|gd-header|date

12345|gd-header|accesscode

like that for every record type.

it means, I have to map GH record data form extract sample file with gd-header COL_ALIAS. Looking for a job design suggestion.