topic Re: Problem in tFileList and tFileProperties in Talend Studio

Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 09:13:07 GMT

I am trying to get tFileProperties through itration of tFileList and getting result in tLogRow. when I get properties of single file its OK and I can see properties in tLogRow but when processing through ((String)globalMap.get("tFTPFileList_1_CURRENT_FILE")) of tFileList it is showing null values in output of all individual files as shown below:

Below is job details:

Re: Problem in tFileList and tFileProperties

manodwhb — Tue, 20 Mar 2018 09:47:36 GMT

Can you share the preoperties of tFileList and tFileProperties? i was thinkng that the pattren of file in tFileList

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 09:52:29 GMT

I don't believe the tFileProperties will have access to the filenames returned by your tFTPFileList. Are you meaning to be using that component or did you mean to use the tFileList? If you are looking at files in an FTP location use the tFTPFileProperties.

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 10:06:19 GMT

Hi ,

Instead of using "tFileProperties" use "tFTPFileProperties" component in your job flow.

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 10:29:35 GMT

I have changed tFileProperties to tFTPFileProperties as shown below with properties but result is same.

Re: Problem in tFileList and tFileProperties

manodwhb — Tue, 20 Mar 2018 10:43:11 GMT

Since do you have the same kind of files starting with "*uplink*" in ftp location ?,the filemask is case sensitive.

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 10:44:00 GMT

You have hardcoded your Remote Directory and then used the CURRENT_FILEPATH globalMap value to point to the file. Have you tried the CURRENT_FILE globalMap value? You only want to name the file and not provide the complete url. Also, are your sure that your username and password do not take you straight to the path you have specified in your Remote Directory? Basically I think you are not actually pointing at the file.

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 11:01:00 GMT

I am trying to understand your answer but at the same time attached is the text file with output of job which shows there is no problem with credentials because file names and path is successfully parsed. But same path and file name present in tFilelist should be parsed by fileproperties for its values and shown in tLogRow.

Can you explain little bit more where am I doing wrong and what should be the actual way of doing same.

talend.txt

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 11:14:14 GMT

Basically can you try this code for the file name in your tFTPFileProperties....

((String)globalMap.get("tFTPFileList_1_CURRENT_FILE"))

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 11:32:58 GMT

I have repeated the same process with single file mentioning its name in the file name and its successful as shown below and attached in the text file but I am not able to develop the logic to get the same list of files in the same folder.

talend.txt

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 11:44:29 GMT

Did you try my last suggestion? What you have done with a single file is hard code JUST the filename in the file field. In your previous version you were supplying the filepath AND filename in the file field. My last post showed you what to change I believe.

Re: Problem in tFileList and tFileProperties

Anonymous — Tue, 20 Mar 2018 12:17:20 GMT

I simply attached tFTPFillelist again and changed single file with ((String)globalMap.get("tFTPFileList_1_CURRENT_FILE")) it worked very well as shown below: thank you for providing the guideline its great

+--------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+
| key | value |
+--------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+
| abs_path | /export/home/sysm/opt/oss/server/var/fileint/pm/pmexport_20180315/pmresult_1275071424_60_201803151200_201803151300_UFM Assignment MEasurement (Per Cell).csv |
| dirname | /export/home/sysm/opt/oss/server/var/fileint/pm/pmexport_20180315 |
| basename | pmresult_1275071424_60_201803151200_201803151300_UFM Assignment MEasurement (Per Cell).csv |
| size | 592776 |
| mtime | 1521108187 |
| mtime_string | Thu Mar 15 15:03:07 PKT 2018 |
+--------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+