Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
welshsteve
Creator
Creator

tFileList not reading all files in a folder

I have a simple job set up that reads all files in a directory (including subfolders) using a tFileList, and using tFileProperties, outputs the Directory and Filenames to a table.

I know from simply looking at he properties of the folder in Windows that there are 49000 files in this folder. However, my Talend job is only putting 43000 filenames into the output table, so is clearly not reading all the files in the folder.

Is there any reason why this would be the case?

Is there any "rejects" logging I can get out of the tFileList component? Or any other way I can find out what files it is rejecting?

See attachments showing the job design and the settings for the components.

Labels (2)
1 Reply
Anonymous
Not applicable

never tried with a big number of files using tFileList, there is a global variable that counts the total number of files are found, can you simply print the value of this variable to see what it is?

tFileList.....baba

|onsubjobok

tJava

on tJava:

System.out.println(((Integer)globalMap.get("tFileList_1_NB_FILE")));

 

Regards

Shong