topic Re: [resolved] Seeding tFileList a list of files from database in Talend Studio

[resolved] Seeding tFileList a list of files from database

Anonymous — Sat, 16 Nov 2024 12:17:46 GMT

I am trying to seed tFileList a list of files that I pulled from a table using Talend java. How can I dynamically set this up? It looks like I have to manually add in the file names to tFileList. Can I feed in a csv file?
In example:
Grab file names from a database >> store it in a csv file >> feed it to tFileList

Re: [resolved] Seeding tFileList a list of files from database

Anonymous — Tue, 15 May 2012 03:46:07 GMT

Hi
Just store the csv file into an empty directory. Then use tFileList to locate this directory and set Filemask "*".
Regards,
Pedro

Re: [resolved] Seeding tFileList a list of files from database

Anonymous — Tue, 15 May 2012 15:28:17 GMT

This doesnt actually process the raw data files. It only processes the csv file which holds the name of each file to be processed.
I am trying to feed tFileList a csv which contains targeted set of files for processing.

Re: [resolved] Seeding tFileList a list of files from database

_AnonymousUser — Tue, 15 May 2012 19:22:43 GMT

give this a try:
tFileInput--row-->flowToIterate-->tFileInput---row--->(rest of job)
the first file input should contain your filenames. you retrieve them from the iterate with a call to the globalMap.

Re: [resolved] Seeding tFileList a list of files from database

Anonymous — Tue, 15 May 2012 21:07:14 GMT

Yeah this is a lot better solution.

Re: [resolved] Seeding tFileList a list of files from database

Anonymous — Wed, 16 May 2012 03:33:51 GMT

Hi
If you pull the file name (or file path) from database, not the file itself, you can iterate each file name directly without tFileList component. For example:
tMysqlInput--row1--tFlowToIterate---iterate-->the rest of job.
On the rest of job, you can access the current file name (or file path), use this expression:
(String)globalMap.get("row1.filename")
//filename is the column name;
Best regards
Shong