Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
kleinmat
Contributor III
Contributor III

[resolved] DI job with "file exists" trigger?

Hi everyone,
is it possible for a DI job to continuously watch a directory and start its job once a file with the right pattern has been delivered?
After all, "time" should not be the only trigger for a DI job. Especially when file processing has to be performed in "near real time" AND the file delivery can't be pinned to a certain time, a "file exists" trigger is much better. Can that be done with Talend?
If so:
1. How?
2. What if the file is being delivered with its final name (instead of transfer with a temporary name and rename once the file has been fully transferred)? How does Talend make sure that the file is not being processed before it has been fully transferred?
3. Will such DI jobs run continuously? Or will they end after they processed one file?
Thanks
Matt
Labels (2)
1 Solution

Accepted Solutions
Anonymous
Not applicable

5 Replies
Anonymous
Not applicable

hi,
have a look at tWaitForFile
https://help.talend.com/search/all?query=tWaitForFile&content-lang=en
regards
laurent
kleinmat
Contributor III
Contributor III
Author

Oh, cool, thanks!
But what if 1 file has been delivered and the DI job has finished processing it? Will the DI job end? Or can a DI job be deployed in a way that it keeps watching the directory 24/7 and process every file that arrives when it arrives?
Thanks
Matt
Anonymous
Not applicable

Select what to do with the iteration loop after the next component is triggered:
continue loop: continues iterating until the number of iterations reaches the defined maximum value.
exit loop: stops iterating immediately.

0683p000009MA9p.png
Anonymous
Not applicable

have a look at Scenario 2 !
kleinmat
Contributor III
Contributor III
Author

Thanks a lot 🙂