topic Dynamically add new column to my file. in Talend Studio

Dynamically add new column to my file.

Anonymous — Sat, 16 Nov 2024 04:53:39 GMT

Hi Community,

I'am facing a problem in the design of a new job.

My input file structure is :

Product Price

I have too many files as input each file refer to one month. The price is not fixed , it change from month to month what i am asked to do is to create 1 file with this schema

Product FileName1 FileName2 FileName3 . . .

Product 1 PriceintheFile1 PriceintheFile2 PriceintheFile3 ...

Product 2 PriceintheFile1 PriceintheFile2 PriceintheFile3 ...

etc

The File Name is the date of each month by the way.

what i have dont so far is :

TfileList=>TFileInputDelimited=>Tmap=>TFileInputDelimited

in the Tmap i coudnt make the column's name dynamic.

Is this can be done with Talend ?

Thanks a lot for your time.

Re: Dynamically add new column to my file.

tnewbie — Fri, 23 Aug 2019 15:39:15 GMT

Hi Rami,

This is a very interesting scenario and I guess you may have to approach the issue as below:

Step :1

Push your output to a file where you include the filepath as one of the columns (like below)

file_path,prod_code,prod_price
C:\filepath\month_jan.txt,1001,100
C:\filepath\month_jan.txt,1002,105
C:\filepath\month_feb.txt,1001,100
C:\filepath\month_feb.txt,1002,105

Step :2

Use a component tUnpivotRow (you can find this component on Talend Exchange for free) this helps you convert your rows in to columns

I think this may solve your issue...good luck

Re: Dynamically add new column to my file.

Anonymous — Mon, 26 Aug 2019 12:02:11 GMT

Thank you so much for your help.