topic Re: TALEND JOB SCHEDULING in Talend Studio

TALEND JOB SCHEDULING

Anonymous — Mon, 16 Jul 2018 17:04:45 GMT

Hi,

I would like to know how to go about scheduling a job on Talend using the open source studio.

The job would run periodically. i.e i want Talend to run automatically at a particular time scheduled.

Kindly assist with the steps to take.

Thanks.

Re: TALEND JOB SCHEDULING

iamabhishek — Mon, 16 Jul 2018 17:52:53 GMT

For community version, you could export the job as standalone program and make a schedule from window task scheduler.

Reference - https://www.talendbyexample.com/talend-job-deployment-reference.html

Re: TALEND JOB SCHEDULING

Jesperrekuh — Tue, 17 Jul 2018 12:44:45 GMT

Check this:
https://community.talend.com/t5/Migration-Configuration-and/Exporting-a-Job-script-and-executing-it-outside-of-Talend-Studio/ta-p/21686

The job you want to schedule, trigger it from like crontab or a different scheduler.

if you want to pass on parameters you have to define context variables in this particular job... cronEndDate and cronStartDate

From (unix) command line you could run it like this in background and return to prompt, redirect stdout and errors to a log file.

nohup sh CRONTAB_TALENDJOBS_run.sh --context_param cronStartDate='2018-07-10' --context_param cronEndDate='2018-07-12' > /data/log/CRON.log 2>&1 </dev/null &

Re: TALEND JOB SCHEDULING

Anonymous — Mon, 23 Jul 2018 12:48:58 GMT

Thank you very much. It works.

But the how do i change the output file name for every time the job runs?

Remember we cannot generate two output files with the names.

Please help. Thanks

Re: TALEND JOB SCHEDULING

iamabhishek — Mon, 23 Jul 2018 13:22:43 GMT

@daescada - what kind of output file?

Just for illustration purpose let's take an example using tJava.

You derive with your logic on what filename you would like to achieve using Java code and assign the same to global variable -

globalMap.put("NewFilename", <derived filename>);

And then in your subsequent tFileOutputXXXXX component reuse this variable as the filename using this expression:

((String)globalMap.get("NewFilename"))

Ex: to get current date timestamp you could use this code and then append the same to your filename prefix/suffix if any:

TalendDate.formatDate("yyyyMMddHHmmss",TalendDate.getCurrentDate())

Re: TALEND JOB SCHEDULING

Anonymous — Mon, 23 Jul 2018 13:34:19 GMT

tFileOuputExcel is the output file that the name needs to be changed each time the scheduled job runs.

please help.

Re: TALEND JOB SCHEDULING

iamabhishek — Mon, 23 Jul 2018 15:40:01 GMT

A fairly simple scenario explained -

Have a global variable using tSetGlobalVar, use the same in tJavaRow to put your dynamic excel filename using your required logic. Once done use the same global variable in tFileOutputExcel component "File Name"

Re: TALEND JOB SCHEDULING

Jesperrekuh — Mon, 23 Jul 2018 22:14:12 GMT

Easy.... tFileOuputExcel where you put the file name make sure you add pid variable to its name:

TalendDate.getCurrentDate("yyyyMMddHHmmssSSS")+"_" + pid + "_" + "your readable name.xlsx"

pid = process id, is also used in logging components like tLogCatcher.

I always put this in my dynamic file generation so I can simply find corresponding files, think about clearing / archiving ... finding corresponding files by date-time is a mess when running your job x times.

Re: TALEND JOB SCHEDULING

Anonymous — Mon, 23 Jul 2018 23:02:06 GMT

If date/time is not sufficiently unique, you can use java.util.UUID. Something like this:

java.util.UUID.randomUUID().toString() + "_your_readable_name.xlsx"

Re: TALEND JOB SCHEDULING

Anonymous — Thu, 26 Jul 2018 14:15:28 GMT

Thanks for this.

where in the talend open studio do i input the code. i.e

TalendDate.getCurrentDate("yyyyMMddHHmmssSSS")+"_" + pid + "_" + "your readable name.xlsx"

Re: TALEND JOB SCHEDULING

iamabhishek — Thu, 26 Jul 2018 14:17:48 GMT

look for "File Name" property in tFileOutputExcel component, that is where you put your configurable code.

Re: TALEND JOB SCHEDULING

Anonymous — Thu, 26 Jul 2018 14:34:34 GMT

Where would the destination file path now be?