topic Re: Getting the progress bar-during runtime- in Talend Studio

Getting the progress bar-during runtime-

_AnonymousUser — Mon, 30 Sep 2013 07:31:40 GMT

hi all,
Is der any component is give us the progress of the load, (upart from the debug run).
i have a trigger job, consisting of 5 Trunjob components- which triggers 5 different jobs
and each job loads huge data around 3 4 million records into the database.
but, the problem is i m unable to see any progress in percentage at the runtime, when i run trigger job.!!
help needed,
thnkx in advance,
Roni

Re: Getting the progress bar-during runtime-

Anonymous — Mon, 30 Sep 2013 17:01:28 GMT

inside your flow, you can insert a tJavaRow to output progress information-- the code inside would look something like this:

if( (Integer)globalMap.get("tFileInputDelimited_1_NB_LINE") != null && (Integer)globalMap.get("tFileInputDelimited_1_NB_LINE") % 10000 == 0) {
System.out.println("Processed "+ globalMap.get("tFileInputDelimited_1_NB_LINE") + " rows...";
}

Re: Getting the progress bar-during runtime-

Anonymous — Mon, 30 Sep 2013 20:29:15 GMT

Unfortunately this does not work, because the mentioned counter will only set after the flow is finished.
But the suggestion with tJavaRow is the correct start for solving this requirement. You should create your own counter but avoid writing every dataset as log to the console.
Talend mostly generates int variables like tos_count_<comp_name>. These variables will be incremented every dataset.

Re: Getting the progress bar-during runtime-

Anonymous — Tue, 21 Mar 2017 14:37:40 GMT

Hi All,
I would like to reopen this topic.
I am performing a migration in Talend Data Integration Studio. The migration process consists of several grand job, which hold subjobs. Unfortunately, when the migration is running, I cannot follow the actual progress because Talend show that only one row was migrated between subjobs.
I need to have an ability to follow the actual progress in Talend by receiving information at runtime like: the number of rows, which have been already migrated, the number of errors, which subjob of the subjob is currently running etc.
Can anyone advise me, how this can be done?
Best regards,
Kapi

Re: Getting the progress bar-during runtime-

Anonymous — Sun, 31 Mar 2019 17:26:00 GMT

Kapi, did you ever come up with a solution for this problem?