topic compare Directory files with table files in Talend Studio

compare Directory files with table files

Anonymous — Thu, 28 Jan 2016 01:36:28 GMT

I am trying to find out if files that are listed in directory exists in ms sql server table.
Please help.

Re: compare Directory files with table files

Anonymous — Thu, 28 Jan 2016 13:55:04 GMT

Please help me with this question. I really need to complete this.
Thanks

Re: compare Directory files with table files

Anonymous — Thu, 28 Jan 2016 14:18:21 GMT

1. Iterate each file with tFileList and merge all the file name.
2. Read all the file names from database.
3. Do an inner join on tMap and generate two outputs, one for existing files, another one for non existing file.
The job looks like:
tFileList--iterate--tFixedFlowInput--main--tUnite--tMap---
|
tMssqlInput
on tFixedFlowInput: define one column called filename and set its value as:
((String)globalMap.get("tFileList_1_CURRENT_FILE"))

Please refers to this article to learn how to do an inner join on tMap.

Re: compare Directory files with table files

Anonymous — Thu, 28 Jan 2016 19:38:45 GMT

This solution worked perfect. Now I'm trying to put all the filename into variable from tMap.please help.

Re: compare Directory files with table files

Anonymous — Fri, 29 Jan 2016 04:07:14 GMT

Now I'm trying to put all the filename into variable from tMap.please help.

Hi
I don't understand what you want to do? Can you please explain it with more details?

Re: compare Directory files with table files

Anonymous — Fri, 29 Jan 2016 15:34:05 GMT

tMap has a column called 'FileName'.
Currently I am printing tMap filenames on the screen using tLogRow.
I want to collect all the filenames and put it into a variable for later use.
Thanks,

Re: compare Directory files with table files

Anonymous — Sat, 30 Jan 2016 10:54:56 GMT

Hi
You can add all the filenames to a list or append it to a string on tJavaFlex, eg:
...tMap--out1--tJavaFlex

begin part of tJavaFlex, define a lst:
java.util.List list=new java.util.ArrayList();

main part: add each filename to the list:
list.add(out1.filename);

end part: put the list to a global variable for used later:
globalMap.put("list",list);

In the next subjob, you can get the list from the global variable with this expression:
(java.util.List)globalMap.get("list")