topic [resolved] Dynamic Column Mapping in Talend Studio

[resolved] Dynamic Column Mapping

Anonymous — Tue, 15 Jul 2014 12:52:31 GMT

Hi,
I want to perform mapping of column dynamically.
Basically, i have a fixed output Column structure. The incoming column names can be different.
eg:
Output columns: Name, Sex, Age
Input 1 Columns : Name, Gender, Age
Input 2 Columns : Names, Sex, Ages
Input 3 Columns : Names, Gender, Ages
and so on..
I want the Name to be Mapped with Name, Names, ..
Sex to mapped to Sex, Gender, ..
Age to be mapped to Age, Ages, ..
how to work around to get this done? (I tried using tMap but it allows kind of fixed mapping, can we make it dynamic?)

Re: [resolved] Dynamic Column Mapping

Anonymous — Wed, 16 Jul 2014 03:19:32 GMT

Hi,
Your input files column order is not fixed? Could you please upload your tMap editor screenshot into forum?
Best regards
Sabrina

Re: [resolved] Dynamic Column Mapping

Anonymous — Wed, 16 Jul 2014 05:09:56 GMT

Yeah, it is not fixed.
Can we make it work if it is fixed?
In the screenshot columns are in order but it may not be in order sometimes.

Re: [resolved] Dynamic Column Mapping

Anonymous — Wed, 16 Jul 2014 07:56:28 GMT

Hi,
Talend Dynamic Schema allows you to design schema with an unknown column structure (unknown name and number of columns), however, the output Column structure should be dynamic as well not fixed.
How many input files need to be loaded into a fixed output Column structure file? Could you use several input components to read your input files then mapping them in tMap?
Such as: tfileinputdelimited_1(Name, Gender, Age)-->tMap-->output(Name, Sex, Age)
tfileinputdelimited_2(Names, Sex, Ages)
tfileinputdelimited_3(Names, Gender, Ages)
Best regards
Sabrina

Re: [resolved] Dynamic Column Mapping

Anonymous — Thu, 24 Jul 2014 09:57:49 GMT

Hi ksultania,
Here is a response for your issue, could you please check it?
http://www.talendforge.org/forum/viewtopic.php?id=37314
Best regards
Sabrina

Re: [resolved] Dynamic Column Mapping

AbiJeev — Mon, 15 Sep 2014 14:22:58 GMT

Hi,
I have the same requirement, I have defined column as dynamic in both input and out. Both my input and out is dynamic. When I run with same column name am able to run the code properly and getting output. But if the incoming column name(from Oracle DB) and output table column names (MySQL DB) are different then am getting error like unknown field list.
Kindly help me how to resolve this.
Regards,
AbiJeev

Re: [resolved] Dynamic Column Mapping

Anonymous — Tue, 16 Sep 2014 09:07:16 GMT

Hi AbiJeev,
Here is a response for your situation

the incoming column name(from Oracle DB) and output table column names (MySQL DB) are different

on forum :http://www.talendforge.org/forum/viewtopic.php?id=37314
Could you please have a look at it?
Best regards
Sabrina

Re: [resolved] Dynamic Column Mapping

AbiJeev — Thu, 18 Sep 2014 12:31:49 GMT

Hi Sabarina,
The link you have provided was useful. Thank you.

Re: [resolved] Dynamic Column Mapping

Anonymous — Wed, 24 Feb 2016 08:40:43 GMT

hi,
I have source file with dynamic columns which means it may come with 50 columns or 100 columns or "n" columns
i have to read this file and apply transformations based on column number provided by input. can we achieve this in talend?
Please help me out.