topic Re: [resolved] Dynamic filename in tFileOutputDelimited component in Talend Studio

[resolved] Dynamic filename in tFileOutputDelimited component

Anonymous — Sat, 16 Nov 2024 13:35:35 GMT

Hi,
I need help trying to dynamically specify the name of the file to create in tFileOutputDelimited. I have attached some images showing a simplified job:
tFileInputDelimited --> tMap --> tFileOutputDelimited
When I use the value of a field that's flowing into tMap (row1.fileName), I get only null value for the variable. So, in my example, when the contents of the input file is
file1,content1
file2,content2
I get the output filename as <full path>dynamicFileNamingOutputnull.txt. I expected to get two files:
dynamicFileNamingOutputfile1.txt, and
dynamicFileNamingOutputfile2.txt
Any help will be greatly appreciated.
Thanks,
Yuan

Re: [resolved] Dynamic filename in tFileOutputDelimited component

Anonymous — Tue, 26 Jan 2010 02:41:03 GMT

Hello
You should use tFlowToIterate+tFixedFlowInput to iterate each row, your job looks like:
tFileInputDelimited--row1---tFlowToIterate--iterate---tFixedFlowInput--main--tMap--tFileOutputDelimited
On tFixedFlowInput, generate one row of input flow, eg: define two fields on the schema: filename and content
set the value of filename column as: (String)globalMap.get("row1.filename")
set the value of content column as: (String)globalMap.get("row1.content")
on tFileOutputDelimited, set dynamically the file name like:
"D:/file/"+(String)globalMap.get("row1.filename")+".txt"
About usage of tFlowToIterate component, see 5827.
Best regards
shong

Re: [resolved] Dynamic filename in tFileOutputDelimited component

Anonymous — Tue, 26 Jan 2010 10:54:17 GMT

Thanks Shong for the quick response.
I did revise the flow as you suggested. However, I'm only getting a single (last) line of output when there are supposed to be multiple lines.
Input:
file1,content1_1
file1,content1_2
file1,content1_3
file2,content2_1
file2,content2_2
I expected to see
file1
content1_1
content1_2
content1_3
file2
content2_1
content2_2
However, I'm getting
file1
content1_3
file2
content2_2
It appears the Number of lines in tFixedFlowInput is the culprit. Am I missing something?
Thanks,
Yuan

Re: [resolved] Dynamic filename in tFileOutputDelimited component

Anonymous — Tue, 26 Jan 2010 11:13:20 GMT

I also tried using the tRowGenerator and the result is the same - only a single line (from the last row) is output in each file.
I expected it to generate a row for each incoming row. What am I missing?
Thanks for your help,
Yuan