Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] How can I know the number of records processed by a Talend Job?

Hi,
I have a job which loads data from file to a database and it is scheduled daily @10 PM.
I don't want to login into database and see how many records were processed.
How can I know the record count or the number of records processed by the job on that particular day?
If this information is logged somewhere, where can I see it in Talend?
Labels (2)
1 Solution

Accepted Solutions
Anonymous
Not applicable
Author

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong

View solution in original post

3 Replies
Anonymous
Not applicable
Author

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong
Anonymous
Not applicable
Author

Hi ,
In which component, I can use this below global variable. So, that the record count information will be available in my log.
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
Anonymous
Not applicable
Author

Hi 
In next subjob, you can generate this data on a tfixedFlowInput and write them to a log file, eg:
tFileInputDelimited--main--tMysqlOutput
   |
onsubjobok
  |
tFixedFlowInput--main--tFileOutputDelimited