topic Re: File polling till specific time in Talend Studio

File polling till specific time

Anonymous — Thu, 17 Jan 2019 14:42:02 GMT

Hi All,

I have a requirement for polling a directory for files and I am using tWaitforFile Components but facing one issue. Actually tWaitforFile provides option for seconds between iterations and no of iterations to exit out of infinite loop but I want to do file polling till specific time, suppose if job starts at 8 then till 10 I need to do file polling.

If would be great if anyone worked on the same scenario and share their approach.

Re: File polling till specific time

David_Beaty — Thu, 17 Jan 2019 16:05:38 GMT

Hi,

In this scenario, you could use the tLoop component, tFileExists & tSleep.

However generally, I wouldn't recommend a Talend start and stay running, looping for an indefinite period of time - could you not just trigger the job to run every few minutes externally (from CRON or something) between 8 & 10?

Re: File polling till specific time

vapukov — Fri, 18 Jan 2019 00:07:41 GMT

as variant - combination

tLopp + tSleep + compare time from start:

at the begin in tJava save StartTime:

context.StartTime=TalendDate.getCurrentDate();

and compare it with current time for each iteration:

TalendDate.compareDate(TalendDate.getCurrentDate(),TalendDate.addDate(context.StartTime,2,"HH")) <=0

similar logic could be about absolute time

and also you can add in tLoop criteria && additional parameter - is FileReceived and put this to 1 for exit loop earlier