Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Iterating through files

I have a job right now that loads three CSV files into a DB and then run a series of jobs against that to build out a data warehouse. In the future there may be as many as 5 or 10.
Right now I have a separate job running for each CSV file. What I would like is a single job that goes through a folder running on each CSV that it finds. Does someone have a sample on this?
Thanks,
Luke
Labels (3)
4 Replies
Anonymous
Not applicable
Author

The component you want is tFileList. In that component you can specify a file mask and hook the iterate output to the rest of your processing.
Anonymous
Not applicable
Author

Hi, does anyone know if there is a way I can pass the output from tFileList into a tRunJob component?
Anonymous
Not applicable
Author

Ah, looks like you can add a context variable in the job, then set it as a parameter to the tRunJob and then pass this through an iteration between the tFileList and tRunJob:
((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))
Anonymous
Not applicable
Author

I've set up a cron job that pulls AppStore Sales reports to a folder,
which I then let a reoccurring Talend job:
looking in, pulling out files, extracting, loading into a staging table, moves the used files.

-- Update --
Hmm, can't see the files I uploaded...