topic Log progress of tasks in Talend Studio

Log progress of tasks

Anonymous — Sat, 16 Nov 2024 11:50:26 GMT

Hello everyone,
I have a "super" job that runs 7 or 8 subjobs, and all together it takes like 30 minutes to run everything (as expected).
This job is to run outside talend studio so i wanted a way to log the progress of the tasks of each job (to the console or file) similar to what talend studio does when we run a job.

I have tried tStatisticsCatcher but it doesnt give much info about the current progress.
tFlowmeterCatcher forces me (i think) to add a tFlowMeter after almost every component.
Does anyone has any ideia about what is the better aproach to do this?

Re: Log progress of tasks

Anonymous — Thu, 14 Nov 2013 03:17:33 GMT

Hi,
Have a look at TalendHelpCenter:Logs & Errors components in talend.
Usually tStatisticsCatcher and tFlowmeterCatcher will record begin Time, End Time and the number of rows processed in the defined flow. You need both of them in your job if your requirement is to log the progress of the tasks of each job.
For Talend Enterprise Subscription Version, there is Real time statistics in Talend Administration Center.
Best regards
Sabrina

Re: Log progress of tasks

Anonymous — Thu, 14 Nov 2013 09:35:01 GMT

Hi,
Have a look at TalendHelpCenter:Logs & Errors components in talend.
Usually tStatisticsCatcher and tFlowmeterCatcher will record begin Time, End Time and the number of rows processed in the defined flow. You need both of them in your job if your requirement is to log the progress of the tasks of each job.
For Talend Enterprise Subscription Version, there is Real time statistics in Talend Administration Center.
Best regards
Sabrina

Thank you very much Sabrina.

Re: Log progress of tasks

Anonymous — Thu, 14 Nov 2013 09:38:11 GMT

Hi,
Is it sufficient for your case? Don't hesitate to post your issue on forum.
Best regards
Sabrina