topic Error in tFTPInput in Talend Studio

Error in tFTPInput

Anonymous — Tue, 20 Mar 2018 14:49:10 GMT

Hi All,

I am facing an issue in a talend job which does ftp a file. Even though this is a file it says "

No match file exist!".

Attached is a screen shot of the job.

Please let me know if i am doing something wrong.

Regards

Murali

Re: Error in tFTPInput

Anonymous — Tue, 20 Mar 2018 14:58:16 GMT

I think I might know what is causing this, but I'll need to see the hole job. I need to know where you are setting your VarFilename globalMap value and whether you can actually see the file that has been output?

Re: Error in tFTPInput

Anonymous — Tue, 20 Mar 2018 15:25:14 GMT

Thanks for your response. I am able to see the file in the server which is created by the job. Somehow tFTP is not able to see it.

I am setting the file name in the beginning of the program in t_Java component.

globalMap.put("varFilename", context.DMP_ROOT_PATH + context.DMP_COUNT_FILE + TalendDate.getDate("yyyyMMDD").toString() + ".csv" );

The strange thing here is tFTPInput is not giving any error because OnComponentOk it is printing the value of tJava_3

Re: Error in tFTPInput

Anonymous — Tue, 20 Mar 2018 15:40:58 GMT

This might not be your issue, but it is AN issue. You are specifying your file path in the component AND also providing it in the VarFilename. If your file is called myfile.csv and the filepath is c:\my\file\path then when you try and FTP it you would be looking for a file called c:\my\file\path\myfile.csv in this filepath c:\my\file\path. Essentially trying to find this file....

c:\my\file\path\c:\my\file\path\myfile.csv

....which does not exist.

Your globalMap needs to be set to .....

globalMap.put("varFilename", context.DMP_COUNT_FILE + TalendDate.getDate("yyyyMMDD").toString() + ".csv" );

Re: Error in tFTPInput

Anonymous — Tue, 20 Mar 2018 16:02:40 GMT

See below log

I am printing the varFilename /oracle/edprd8history/dmp_extracts/Transfer_details_20180315.csv

Checking ports...

Sending job 'WF_DMP_PROCESS_UPD' to server (talend3-01.bo3.e-dialog.com:8001)...

File transfer completed.

Deploying job 'WF_DMP_PROCESS_UPD' on server (10.100.5.55:8000)...

Running job 'WF_DMP_PROCESS_UPD'...
Starting job WF_DMP_PROCESS_UPD at 10:28 15/03/2018.

Picked up _JAVA_OPTIONS: -Djava.security.egd=file:///dev/urandom
[statistics] connecting to socket on port 3381
[statistics] connected
2018-03-15 10:28:14 -- DMP_PROCESS STARTED
Email Address DL-ZetaCRM-PYXIS_DMP_Notification@zetainteractive.com
Remove all files in /oracle/edprd8history/dmp_extracts/
The File Generated is : /oracle/edprd8history/dmp_extracts/Transfer_details_20180315.csv
2018-03-15 10:28:16 -- FILL DMP_EXPORT_EVENT_LOG

FIRSTDAYLASTMONTH-LASTDAYLASTMONTH 20180201 20180228
2018-03-15 10:28:17 -- DMP EXTRACT STARTED

DMP_ROOT_PATH : /oracle/edprd8history/dmp_extracts/
DMP_MAX_RECORDS : 5000000
DMP_EXPORT_FETCH_SIZE: 300
DMP_PARALLEL_THREADS : 6
DMP_PART_TABLE : DMP_EXPORT_EVENT_LOG
DMP_LIMIT :
Processing the keys: (11891)
Client *** GSI_SPCK Client_key *** 39 Records to export *** 2847787
DMP_EXTRACT_START 20180201 DMP_EXTRACT_END 20180228
rm -fr /oracle/edprd8history/dmp_extracts/GSI_SPCK
GSI_SPCK T_MASTER rows *** 2030600
976seconds DMP Extract Completed GSI_SPCK 976222 milliseconds
[ tChronometerStop_3 ] 986seconds Program completed 986514 milliseconds
2018-03-15 10:44:43 DMP EXTRACT COMPLETED
2018-03-15 10:44:43 -- SFTP UPLOAD STARTED
dmp_extracts/
dmp_extracts/GSI_SPCK/
dmp_extracts/GSI_SPCK/GSI_SPCK_DMP_EVENTS_20180201_20180228_0.csv.gz
dmp_extracts/GSI_SPCK/GSI_SPCK_DMP_EMAIL_20180201_20180228_0.csv.gz
2018-03-15 10:44:47 -- SFTP UPLOAD COMPLETED
Transfer Message Client
/oracle/edprd8history/dmp_extracts/Transfer_details_20180315.csv
0 files have been uploaded.

/oracle/edprd8history/dmp_extracts/Transfer_details_20180315.csv
No match file exist!
[statistics] disconnected
Job WF_DMP_PROCESS_UPD ended at 10:45 15/03/2018. [exit code=0]

Re: Error in tFTPInput

Anonymous — Thu, 22 Mar 2018 21:38:27 GMT

Hi @rhall

Yes are you right regarding where the issue is. In the tFTPInput component

context.DMP_COUNT_FILE = "Transfer_details_"

globalMap.put("varFilePrefix", context.DMP_COUNT_FILE );

tFPTInput => Filemask = (String)globalMap.get("varFilePrefix") // is not working

tFPTInput => Filemask = "Transfer_details_*.csv" // is working

Would you please help me how to fix this issue?

Re: Error in tFTPInput

Anonymous — Thu, 22 Mar 2018 21:53:17 GMT

Created a new variable and used that in Filemask and it worked.

globalMap.put("varFilePrefix", context.DMP_COUNT_FILE + TalendDate.getDate("yyyyMMDD").toString() + ".csv" );

Re: Error in tFTPInput

Anonymous — Thu, 22 Mar 2018 22:01:49 GMT

Sorry, I only just saw your last post. Glad you managed to figure it out yourself though. The more you struggle with this sort of stuff, the more you learn 🙂