Periodic execution of jobs and passing of parameters
Hi all.
My company is developing an ETL solution, and we are looking into Talend as our main ETL product.
I have a few questions about what is possible to do in Talend, and how.
We have already developed some prototype jobs (MySQL production database to an Oracle 9i data warehouse)
What we would need to be able to do:
* Create "stand alone" packages for these jobs, and launch them periodically (once a day)
* Be able to pass parameters to these jobs (Typically, the reason for the launch of the job, and the date of execution)
Ideally, if the job is launched manually, the user would have to enter data (the reason of the job). If the job is launch without user operation (automatically once a day), a default value would be used.
Our restrictions:
* As of now, we use Talend as testing only; so we must use Talend Open Studio, with its limitations.
Because of the limitations of Talend Open Studio, we realize we may have to develop our own application to launch the job, and pass parameters to it. That's fine, as long as we have some info on how to do it.
Thank you all, and thanks for developing and maintaining such a useful tool.
Louis.
Edit: i forgot to mention our prototype jobs are in Java
Please use the scheduler comes along with the OS like windows schduler or open sourse/free schedulers like "Solway's Task Scheduler". The "Solway's Task Scheduler" is good and I have used that. Thanks and Regards, Pravu Mishra.
Thanks for all the replies. For the moment I'll stick with the windows scheduler, using an intermediary java program to pass parameters (via a text file, most likely).
Thanks again.
Simonlourson
Your request looks a lot like "job conductor", available in Talend Integration Suite, the charged subscription product from Talend. You can contact sales@talend.com for details.
Hi,
I am also looking for an answer to
* Be able to pass parameters to these jobs
Can someone point me to where that's described?
essentially, I'm trying to do something very simple: scan a directory and call a job when a file arrives in it. The filename will be different every time, so I'd like to use tWaitForFile to get the filename and pass it to the job that processes it.
Many thanks in advance,
Mihai