Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I have a simple job set up that reads all files in a directory (including subfolders) using a tFileList, and using tFileProperties, outputs the Directory and Filenames to a table.
I know from simply looking at he properties of the folder in Windows that there are 49000 files in this folder. However, my Talend job is only putting 43000 filenames into the output table, so is clearly not reading all the files in the folder.
Is there any reason why this would be the case?
Is there any "rejects" logging I can get out of the tFileList component? Or any other way I can find out what files it is rejecting?
See attachments showing the job design and the settings for the components.
never tried with a big number of files using tFileList, there is a global variable that counts the total number of files are found, can you simply print the value of this variable to see what it is?
tFileList.....baba
|onsubjobok
tJava
on tJava:
System.out.println(((Integer)globalMap.get("tFileList_1_NB_FILE")));
Regards
Shong