topic Re: Adding an extra column to the delimited input file in Talend Studio

Adding an extra column to the delimited input file

Anonymous — Sat, 16 Nov 2024 13:11:38 GMT

Hi,
I download tab delimited files from an ftp server. The number of columns in the files vary and are between 5 and 15 columns. Some of the files are as below.
YAHOO_keyword_20101127.txt --- contains 5 columns
YAHOO_detail_20101127.txt --- contains 8 columns
I am using tInputFileDelimited to read these files and change the encoding and delimiter of the file and writing to another file using tOutputFileDelimited.
I would like to add another column to the file created by tOutputFileDelimited component. The extra column will be the date (20101127)in the name of the file itself.
Here is an example of what I need to do.
Input File:
col1 col2 col3 col4 col5
a b c d e
b c d e a
Output File wanted:
col1 col2 col3 col4 col5 date_created
a b c d e 20101127
b c d e a 20101127
The date value comes from the file itself.
I would really appreciate if someone can help me with this. I was also trying to use the tmap component but was not able to achieve what I described above.
Thank you,
Santhosh.

Re: Adding an extra column to the delimited input file

Anonymous — Wed, 01 Dec 2010 19:26:36 GMT

In the tMap, add a column to the output table and use the following for the expression: TalendDate.getCurrentDate()
Make sure the that you select 'OK' for propagating changes. Or in the Output component, click on 'Edit Schema' to ensure the column is there (if not, then add it). Also, make sure the data types are consistent. Hope this helps!

Re: Adding an extra column to the delimited input file

_AnonymousUser — Wed, 22 Feb 2012 05:05:22 GMT

Hi,
Using a source file we created a job and got the output. Next time when the updated source file comes with following updations:
1. with an extra column
2. names of 2 columns are different.

Can we use the same Job again using the same schema so that extra column is updated dynamically and no impact with 2 differing column names.
as it's an irritating and monotonous task to create the same job again.
Can any 1 help
Thanks in advance,
Anchit

Re: Adding an extra column to the delimited input file

Anonymous — Wed, 22 Feb 2012 05:08:38 GMT

Hi Anchit
Welcome to Talend Community!
Dynamic Schema is only supported by Talend Integration Suite(Commercial Version).
In TOS, you have to set schema manually.
Next time, please create a new topic for your question. Thanks.
Regards,
Pedro

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 05:27:12 GMT

Hi all,
I have tab seperated input files and I'm using tFileInputDelimited to read them. I want to add some columns to the output file,for which I've to do some caluculations.For that I'm using tmap.
But I don't know how to add new columns and do caluculations for those columns.
For example I've 4columns
col1            col2          col3            col4
1                  2              3                4
The output file should be as
col1            col2          col3            col4 col5=col1*col3             col6=col1*col2*col3
1                  2              3                4             3 6
How could I acheive it? Please anyone provide the solution to me.
Thanks in advance.

Re: Adding an extra column to the delimited input file

Anonymous — Tue, 12 Aug 2014 09:20:00 GMT

Hi,
Please check the example given in documentation below
http://www.talendforge.org/tutorials/tutorial.php?idTuto=7
In tMap output metadata below add new column and use row1.col1*row1.col3 for value in output column.
Vaibhav

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 12:15:30 GMT

Thanks for your reply vaibav,
I tried as mentoned in the link only.But I could not get want I want. While adding newcolumn it is showing like column5 cannot be resolved to be a variable.
What could I do?

Re: Adding an extra column to the delimited input file

Anonymous — Tue, 12 Aug 2014 12:39:41 GMT

Please show the screenshot of your tMap
Vaibhav

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 12:57:21 GMT

Thanks for your prompt reply.
If I map the new column with input columns I'm getting output. But my doubt is I want to do the caluculation on previous column output
for example column4(output)=couln3*50
And one more thing I need to execute some if else conditions in my job for new columns
How could I do this?

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 13:02:34 GMT

One more is
For example I've marks list
if(marks<35)
status=30%;
else if(50>marks>35)
status=50%
where status is new column which I have to create.
how to do it?

Re: Adding an extra column to the delimited input file

Anonymous — Tue, 12 Aug 2014 13:14:31 GMT

where status is new column which I have to create.
how to do it?
Inside output column you can write expression
input_row.marks < 35 ?"30%" input_row.marks > 35 & input_row.marks < 50)?"50%":some condition
This is cascaded if-then-else
previous column output = input column for that column, take that directly...
Thanks
vaibhav

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 13:18:59 GMT

previous column output = input column for that column, take that directly.
When I'm using that directly it is showing me as error.

Re: Adding an extra column to the delimited input file

Anonymous — Tue, 12 Aug 2014 13:27:54 GMT

Something is wrong... can you show the screenshot of tMap..

Re: Adding an extra column to the delimited input file

soujanyam — Tue, 12 Aug 2014 14:00:34 GMT

Sorry I could not able to add the screenshots.

Re: Adding an extra column to the delimited input file

Anonymous — Tue, 12 Aug 2014 14:06:00 GMT

Use Post reply and keep the size of your screenshot as per their instruction... now it is very simple..
Click and paste your screenshot..

vaibhav

Re: Adding an extra column to the delimited input file

soujanyam — Wed, 13 Aug 2014 07:51:19 GMT

Sorry I could not get to attach screenshot.

Re: Adding an extra column to the delimited input file

soujanyam — Wed, 13 Aug 2014 07:53:35 GMT

I'm getting error when there is no mappaing to the new column which I've created in output columns and adding expression.

Re: Adding an extra column to the delimited input file

Anonymous — Wed, 13 Aug 2014 09:56:43 GMT

That is not an issue, can you show the expression used in additional column?
vaibhav

Re: Adding an extra column to the delimited input file

soujanyam — Wed, 13 Aug 2014 10:45:33 GMT

Thanks for your reply Vaibav,
Example I'm using newcolumn=column5*100
where column5 is previous column in output.
Not only the multiplication I could not get any expression.It is showing me error as
Newcolumn cannot be resolved or not a field.

Re: Adding an extra column to the delimited input file

Anonymous — Wed, 13 Aug 2014 11:13:01 GMT

You must have added newcolumn in metadata in tMap output
- remove newcolumn= from expression and i assume that column5 is your name of previous column in metadata...
I am not sure why you can't display the screenshot of tMap, you can hide the fields if you have security issue... This way you can save time and efforts of many people.
thanks
vaibhav