Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
BN1
Contributor
Contributor

I have to process N number of files 2 in parallel and 10 can be in queue

I have to process N number of files from directory and I have to do  2 files processing in parallel. How do I make sure that every time different files are picked up from directory for processing, when I process these files in parallel.

Labels (2)
6 Replies
aashish_21nov
Creator
Creator

by Debug Run-->Traces Run.

manodwhb
Champion II
Champion II

@BN,in tFileList, you can specify filemask and get the n. number of files to iterate the next process by taking the global map current filename from tFileList.

David_Beaty
Specialist
Specialist

If you use tFileList and iterate through each file, on the iterate connection between the tFileList and the next component, click the "Enable parallel execution" and set the number to 2.

BN1
Contributor
Contributor
Author

Thanks David,

   For some reason my "Enable parallel execution" is greyed out. Have to check why.

 

David_Beaty
Specialist
Specialist

Maybe check the job parameters tab, Extra, Multi thread execution.

ragraw22
Contributor
Contributor

Do we have any solution to this problem? I also want to process N files at the same time. So if the 1st file processing by the 1st subjob the second file should be processed by 2nd subjob and so on.