topic Capture record count processed in flow at particular interval during execution in Talend Studio

Capture record count processed in flow at particular interval during execution

BTomar1623403079 — Sat, 16 Nov 2024 00:04:06 GMT

Hi all,

I have few long running jobs which unloads data from oracle and writes to file. I want to capture the record count processed in flow during execution at fixed intervals like each 5 or 10 min.

I tried tStatCatcher and tflowMeter as well but all show count after completion of that flow not during the processing.

Really appreciate if anyone can guide me

Re: Capture record count processed in flow at particular interval during execution

Anonymous — Tue, 15 Jun 2021 04:44:59 GMT

Hello,

It seems you are looking for real time statistics.

Please refer to this documentation about: TalendHelpCenter: What are real time statistics to see if it is what you are looking for.

This feature is available in talend subscription solution.

Without using real time statistic, we could write a job to get the data in usual and set it to append 1 row to a CSV file for each run. Then schedule the job to run every 5-10 minutes.

Best regards

Sabrina