topic Re: Dynamic column generation in TOS in Talend Studio

Dynamic column generation in TOS

sumJ16233 — Fri, 11 Jun 2021 07:01:42 GMT

I am a beginner in Talend. Please help me to design a job in TOS for the qstn below:

Qstn: Implement the job to achieve below logic. If age_group is added newly in input file then that should be automatically handled in the output with respective Boolean values – Put 1 if the person belongs to that age group and put 0 if he doesn’t belong to that age group (

Dynamic column generation)

Input:

Name age_group(in yrs)

Aa 10-20

Bb 50-60

Cc 20-30

Output:

Name 10-20 50-60 20-30

Aa 1 0 0

Bb 0 1 0

Cc 0 0 1

Note:Depending on the age_grp added in the input only,output column must generate. Output fields are not static. (if a person Dd is added in the i/p then that corresponding age_grp field must be generated in the o/p with value '1')

Re: Dynamic column generation in TOS

gjeremy1617088143 — Fri, 11 Jun 2021 07:22:41 GMT

Hi, dynamic schema is a feature of the licence version not the open source one.

Maybe you have to look for custom component.

Send me Love and Kudos

Re: Dynamic column generation in TOS

sumJ16233 — Fri, 11 Jun 2021 07:55:19 GMT

How to achieve this in open studio is the task given for me. It is possible with the available components in TOS, But I don't have much idea on designing the job with that.

Re: Dynamic column generation in TOS

gjeremy1617088143 — Fri, 11 Jun 2021 08:04:45 GMT

It's not possible with the available components in TOS.

Re: Dynamic column generation in TOS

Anonymous — Tue, 15 Jun 2021 04:10:35 GMT

Hello,

If you want to capture the changed data, you can compare tables by using tMap and then do the further processing with respective Boolean values.

The comparing tables work flow should be:

Target DB-->tMap(make inner join on your input and set the "Catch lookup inner join reject" as true)-->output

Source DB-->

The output will be the changed data.

Let us know if it is OK with you.

Best regards

Sabrina

Re: Dynamic column generation in TOS

sumJ16233 — Tue, 15 Jun 2021 06:32:43 GMT

Hi, Note:Depending on the age_grp added in the input only, output column must be generated. Output fields are not static. How many age_grp are there in input, that should generate as columns in output.