topic Re: tWaitForFile doesn't work as expected on UNIX in Talend Studio

tWaitForFile doesn't work as expected on UNIX

mra802003 — Thu, 07 Sep 2017 21:08:37 GMT

Hi,

I created a simple job using 'tWaitForFile' and 'tFileCopy'. The file watcher is set to run infinitely and iterate every 10 seconds. If matching file arrives in the directory, the file gets copied to destination directory using 'tFileCopy'. This job is working as expected on Windows.

Upon deploying this job to UNIX env and executing the ".sh" file, the job doesn't even pick the file from the directory. The 'ps' command shows the job is running continuously as expected. Can anyone help in this regard?

Thanks

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Thu, 07 Sep 2017 21:18:41 GMT

Hi,
Something about the permissions for the source/target folder or the file itself?

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Thu, 07 Sep 2017 21:51:30 GMT

There are no permission issues on either the folder and files. I am placing the file manually in the source directory and then expecting this job to do the rest.

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Thu, 07 Sep 2017 22:02:35 GMT

Double check the permissions for the target folder.
Also, try to trace the file pathname at the différent steps.

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Thu, 07 Sep 2017 22:09:00 GMT

I created another job without 'tWaitForFile' component to make sure there's no permission issue. The file gets copied into the target directory successfully.

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Thu, 07 Sep 2017 22:33:56 GMT

Can you share the component configuration? Maybe a problem with file mask or the source folder path.
Else, perhaps Talend guys will be most inspired.

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Thu, 07 Sep 2017 22:40:22 GMT

PFA

Test_0.1.zip

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Fri, 08 Sep 2017 08:14:27 GMT

Hum... seems to be a $1,000,000 question!

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Fri, 08 Sep 2017 19:26:44 GMT

Is this something to do with Open Studio Vs Enterprise edition? I read somewhere over web that trigger functionality is available only in Enterprise edition.

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Fri, 08 Sep 2017 20:43:44 GMT

Based on the documentation there is no limitation for this component https://help.talend.com/reader/hm5FaPiiOP31nUYHph0JwQ/9NaCQViWaqc8tnoxlpM6HA
What you have on the Enterprise edition is the capability to start a job as soon a file is detected.
Maybe Sabrina @xdshi could help on this topic

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Fri, 08 Sep 2017 21:34:55 GMT

Meanwhile, I was trying another approach as tinfiniteloop -> twaitforfile -> tCopyFile (on Windows)

The moment I manually copy the file in the source directory, the job fails with the following error:

The basic setting for

1. tinfiniteloop "Wait at each iteration = 1000ms"

2. twaitforfile "Time between iterations = 1s", "Max number of iterations = 1" and "Trigger action when - a file is created". The file mask is "*.txt".

Any idea what would cause this error?

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Fri, 08 Sep 2017 21:43:17 GMT

Can you share the tfilecopy configuration?

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Fri, 08 Sep 2017 21:47:12 GMT

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Fri, 08 Sep 2017 22:38:24 GMT

Well, I can't try for the moment.
What if you change the delay of tInfiniteLoop for example to 1300ms?

Re: tWaitForFile doesn't work as expected on UNIX

TRF — Sat, 09 Sep 2017 07:25:15 GMT

As you have introduced a tInfiniteLoop you may also replace tWaitForFile by tFileExists (if you know the name) or tFileList. You should have the expected result.

Re: tWaitForFile doesn't work as expected on UNIX

mra802003 — Mon, 11 Sep 2017 20:33:23 GMT

Thanks, it worked using tFileList approach.