topic Re: How to get logging information in Talend in Talend Studio

How to get logging information in Talend

Anonymous — Sat, 16 Jan 2016 11:36:56 GMT

I am trying to get logging of talend jobs (eg. no. of rows processed, no. of rows committed start_time_of_job, end_time_of_job etc.) How do I'll get this information?
I'm using Talend 6.1. I've enabled tLogCatcher, tStatCatcher, tFlowMeterCatcher in PROJECT SETTINGS but that's giving me logging details after completion of the job.
If I am running job through command line and if I want to check logging then I won't get that information.
How I'll get this information? tLogCatcher only writes data in the file or table if any error occurred. But if job completed successfully then it don't write any information to the log file.
Please help me to tackle this issue.

Re: How to get logging information in Talend

Anonymous — Mon, 18 Jan 2016 07:44:41 GMT

Hi,
If you want to check the log message when building your job on commandline, it is very convenient to set the log in job view to output the record into file or table.
Statistics table records details like begin Time, End Time which is generated by any job.
Logs table records the messages from Java Exception, tDie and/or tWarn (prerequisite: there must be an error in your job).
Flow Meter table records the number of rows processed in the defined flow(prerequisite: you have to use tFlowMeter in your job).
Please see my screenshot
Best regards
Sabrina

Re: How to get logging information in Talend

Anonymous — Mon, 18 Jan 2016 09:15:44 GMT

Thank you for the solution.

Re: How to get logging information in Talend

Anonymous — Wed, 20 Jan 2016 10:39:50 GMT

Hi Sabrina,
tFlowCatcher returns count of rows only after completion of the job. But if I want to check number of processed rows during execution of the job then how I'll get that count?

Re: How to get logging information in Talend

Anonymous — Thu, 21 Jan 2016 07:36:02 GMT

Hi,

I want to check number of processed rows during execution of the job

Are you looking for "Tracks debug mode"?
Could you please take a look at document about: TalendHelpCenter:How to run a Job in Traces Debug mode to see if it is what you are looking for?
Best regards
Sabrina

Re: How to get logging information in Talend

Anonymous — Thu, 28 Jan 2016 11:32:52 GMT

Thank you.
But my question is as follows:
I am trying to push data from oracle table to cassandra table. I've exported that job and executed .sh file to run that job through command line. Now it will indicate me start of job but I want to check how many rows have been pushed to cassandra table. I've used tFlowMeter and tFlowMeterCatcher but it will return me no. of rows inserted in cassandra table after completion of the job. But if I want to check how many rows have been inserted before completion of that job then how I'll get to know that?

Re: How to get logging information in Talend

Anonymous — Fri, 29 Jan 2016 05:24:26 GMT

Hi,
It seems you want to get the number of data extracted from your source oracle DB?
Best regards
Sabrina

Re: How to get logging information in Talend

Anonymous — Fri, 29 Jan 2016 06:46:09 GMT

Hi,
Yes.

Re: How to get logging information in Talend

Anonymous — Fri, 29 Jan 2016 07:28:03 GMT

Hi,
There is a global variable nb_line of txxxInput component which counts the total number of selected rows. For example:
((Integer)globalMap.get("tOracleInput_1_NB_LINE"))
Best regards
Sabrina