topic Re: Read file if file name contains in Talend Studio

Read file if file name contains

mobmsc2 — Thu, 22 Nov 2018 10:41:05 GMT

I have a folder of excel files, there is a common file naming scheme which indicates what schema should apply to the file.

I am trying to use this Run If condition to connect the tFileList1 to an appropriate tFileInputExcel

((String)globalMap.get("tFileList_1_CURRENT_FILE")).contains("FileType1")

but the contents are not read, the if condition is returned false even though the filename contains the string.

I have tried

tFileList ------tIterateToFlow --if- tFileInput

and

tFileList ---if--tFileInput

Any ideas what I am doing wrong?

Re: Read file if file name contains

vapukov — Fri, 23 Nov 2018 02:54:10 GMT

why You just not use filename pattern for tFileList?

"*FileType1*"

and then iterate over all matched files

Re: Read file if file name contains

mobmsc2 — Fri, 23 Nov 2018 10:44:15 GMT

If you mean using the filemask to only select files to be read? I need to process all the files but I need to process some differently depending on their structure (there is a reason why they are in the same folder). Wouldn't having multiple tFileLists on the same folder open the possibilities of file locks?

Re: Read file if file name contains

mobmsc2 — Fri, 23 Nov 2018 10:45:04 GMT

If you mean using the filemask to only select certain files to be read? I need to process all the files but I need to process some differently depending on their structure (there is a reason why they are in the same folder). Wouldn't having multiple tFileLists on the same folder open the possibilities of file locks?

Re: Read file if file name contains

vapukov — Fri, 23 Nov 2018 11:08:20 GMT

ok, in this case:

tJavaFlex - empty

RunIf - Your condition

tFixedFlowInput - replace with tExcelInput

Re: Read file if file name contains

mobmsc2 — Fri, 23 Nov 2018 11:38:18 GMT

My 1st problem is that my If condition doesn't evaluate to True. Any advice how i debug that?

Re: Read file if file name contains

vapukov — Fri, 23 Nov 2018 11:44:04 GMT

as you can see from screenshot - it work

so, check your condition and real filenames pattern,

is it really contain -

FileType1

Re: Read file if file name contains

mobmsc2 — Fri, 23 Nov 2018 17:17:53 GMT

What is the purpose of the tJavaFlex? The run if works now (copied from my original process) but I swear it doesn't if you have the tFileList ---RunIf--tFileInputExcel

Re: Read file if file name contains

vapukov — Sat, 24 Nov 2018 01:39:03 GMT

just connection for iterate from tFileList

normally RunIf fire when component finish work, so on each iteration when empty tJavaFlex finish it zerro work it fire a trigger for each iteration, but not once when tFileList finish it work

Re: Read file if file name contains

mobmsc2 — Mon, 26 Nov 2018 16:29:18 GMT

Can I ask a follow up how you could join (Unite) the flows into 1 flow once any custom processing had been completed?

Re: Read file if file name contains

vapukov — Mon, 26 Nov 2018 22:37:52 GMT

if data not too big - you could use tHash components for store intermediate result, if data big - better to store in local csv (or staging tables)

after this - create new subjob for read data from hash or csv/tables and combine them