topic Re: Add column with CSV name in Talend Studio

Add column with CSV name

Anonymous — Sat, 16 Nov 2024 06:30:49 GMT

I have been tasked to perform ETL on a data set that has 10 CSV files with the same information, its just from different countries.

My Question is, how would you populate an extra column in your Dimension table with the name of the CSV file.

Thank You

Re: Add column with CSV name

akumar2301 — Fri, 22 Feb 2019 20:31:13 GMT

Can you please explain your query wih example? There could be different understandings of your query.

Are you using tfilelist in your job?

Re: Add column with CSV name

Anonymous — Fri, 22 Feb 2019 20:37:58 GMT

I have different CSV files with their name being different countries, i am using a tfilelist and them connecting tat to a tFileInputDelimited them mapping to my dimensinon table, where i want to create a new row titles country and populate it with the csv file name, e.g. Canada.csv to a column where all the records belonging to the Canada table had Canada in that column.

Re: Add column with CSV name

akumar2301 — Fri, 22 Feb 2019 20:50:07 GMT

Add a tjavarow or tmap after your inputfilecomponent.

Add additional col filename , map it to expression of filename which you
used in input component.

Output_row.Filename = globalvar of tfilelist_1_CURRENT_FILE

You could remove extensions but split command
Filename.split(“.”)[0]

Re: Add column with CSV name

sonalijagtap — Fri, 22 Feb 2019 21:00:01 GMT

Hi Shriya,

Please refer below similar solution to add file name for record.

tMap Setting:

Add below global Variable of tFileList to get the current file name

tMap Setting

Kindly let me know whether it answers your question or not.

Thank You,

Sonali Jagtap

Re: Add column with CSV name

Anonymous — Sat, 23 Feb 2019 11:14:06 GMT

I did that but I am outputting to a tMsSqlOutput, it is populating the row with a null.

Re: Add column with CSV name

akumar2301 — Sat, 23 Feb 2019 11:33:07 GMT

Can you please put tlogrow before tmssqloutput and check if it is coming
null.

And put sceenshot of your job. It must be small issue

Re: Add column with CSV name

Anonymous — Sat, 23 Feb 2019 15:09:31 GMT

This is the error I am Getting.

I used ((String)globalMap.get("tFileList_1_CURRENT_FILE")) and the error, how ever when i used

((String)globalMap.get("tFileList_1_CURRENT_FILEPATH")) it did output the file name.

NAME.PNG

Re: Add column with CSV name

akumar2301 — Sat, 23 Feb 2019 15:58:27 GMT

thats correct

current_filepath should be used in tfileinput component as it has absolute filename including path.below link will help.

https://help.talend.com/reader/mjoDghHoMPI0yuyZ83a13Q/s88XQGiwRClewQ1MPT6I2A

however to get only file name , you could use current_file globalvar.

Re: Add column with CSV name

Anonymous — Sat, 23 Feb 2019 19:13:02 GMT

Thanks for the help.

I'm fairly new to Talend can you please explain how i would use current_file globalvar to give the column name just the file name and not the path.