topic Re: cFile is picking up file even file is still being downloaded in Talend Studio

cFile is picking up file even file is still being downloaded

nmodi — Sat, 16 Nov 2024 08:04:40 GMT

I have created 2 routes

Route 1 - download file from FTP using cFTP (cFTP-->cFile)

Route 2 - pick up file that was downloaded using cFTP & pass it on to DI job for further processing (cFile-->cTalendjob)

my issue is that for large file, cFile is even picking up the file that are still being downloaded from first route.

I have below setting on cFile since I want to be able to process same file again in case client post the same file again for any reason:

noop - true

"idempotentKey" : "${file:name}-${date:now:yyyyMMddHHmmssSSS}"

"delete" : "True"

nmodi — Tue, 19 Jun 2018 19:37:40 GMT

Is it just me getting this issue or is it a bug?

I would really appreciate any response on this.

we are using enterprise version 6.4

Jesperrekuh — Wed, 20 Jun 2018 00:11:58 GMT

Do you use OnComponentOk ? or OnSubjobOk? Could make a difference.
Suggest using OnSubjobOk and please post a screenshot of your jobFlow

nmodi — Wed, 20 Jun 2018 00:46:03 GMT

these are ESB route components, it has only route option. not like DI that has all those options

nmodi — Wed, 20 Jun 2018 00:47:13 GMT

these are ESB route components, it has only route option. not like DI that has all those options

i will try to post some scree shot tomorrow

nmodi — Wed, 20 Jun 2018 20:43:17 GMT

here is some screenshot

route 1 - FTP pickup that pick up input file from FTP & copy that only shared location

route 2- pick up file from shared location & pass it on to DI job for further processing