topic Re: create output file with rolling file name in Talend Studio

create output file with rolling file name

Anonymous — Sat, 16 Nov 2024 13:20:41 GMT

Hi ,
I need to create a job which will create a new output file(rolling file name) for every time I run the job. some thing like
out_001.xml
out_002.xml
out_003.xml
do you have any idea to achieve this using Talend?
Thanks in advance.

Re: create output file with rolling file name

Anonymous — Wed, 21 Jul 2010 23:07:17 GMT

keep a count on a DB/file for this job
so everytime, job starts you read this value and set it in a variable (used in the output file)
good?

Re: create output file with rolling file name

alevy — Thu, 22 Jul 2010 05:01:36 GMT

Or you can use tFileList --> IterateToFlow --> tMap (to parse file numbers) --> tAggregateRow (to find the max) --> tSetGlobalVar and then use the global variable in your file name.

Re: create output file with rolling file name

_AnonymousUser — Thu, 22 Jul 2010 15:35:20 GMT

Or you can use tFileList --> IterateToFlow --> tMap (to parse file numbers) --> tAggregateRow (to find the max) --> tSetGlobalVar and then use the global variable in your file name.

can you discuss the process in more details , like select bla bla from bla bla then connect to bla bla ..
thx

Re: create output file with rolling file name

alevy — Fri, 23 Jul 2010 02:20:30 GMT

See screenprint

Re: create output file with rolling file name

Anonymous — Sun, 25 Jul 2010 04:58:45 GMT

thanks alevy.. I tried another way..

Re: create output file with rolling file name

Anonymous — Tue, 27 Jul 2010 09:09:30 GMT

thx alevy
@ashu : will you please discuss your way here too ..

Re: create output file with rolling file name

Anonymous — Tue, 27 Jul 2010 12:13:10 GMT

I have one approach where I appended date and time in outputfile like dd-mm-yyyy_hh_MM_ss

Re: create output file with rolling file name

Anonymous — Wed, 28 Jul 2010 03:13:17 GMT

it was so simple.. I just created a table with one row.. two columns.. FileName and Sequence... i will be querying that table to get the filename and sequence number.. after that increment the sequence number..
here I'm attaching my job but its different from what I explained.. in tjavarow I'm doin some condition checks...