topic Re: NB_LINE and tFlowmeterCatcher in Talend Studio

NB_LINE and tFlowmeterCatcher

Anonymous — Fri, 26 Jun 2015 10:45:39 GMT

Does anyone know if it is possible to manually (and elegantly) send row counts to tFlowMeterCatcher?

I am working with the ELT components for Oracle and I dont see any possibilities to collect row count information other than by using the global variables NB_LINE. Is it possible to send NB_LINE directly to tFlowMeterCatcher or eventually via tFlowMeter or how would you do it?

Maybe somehow it is possible to raise the event that triggers tFlowMeterCatcher ?

Kind regards, Lise

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Fri, 26 Jun 2015 16:32:02 GMT

Hi Lise
Why do you want to send manually the number of rows to tFlowToMeterCatcher? This component only works when the connection is monitored.
Best regards
Shong

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 07:17:26 GMT

Hi Shong
Actually my goal is to put row count information in the tFlowMeterCatcher table. If I have the row count information in e.g. NB_LINE, what is the easiest way to put this information, along with the other informations needed (e.g. user, job id) in the table?
Best regards, Lise

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 14:23:09 GMT

hi,
click on the row you want to manage & and advanced setting of component.
check option 'monitor this connection'
that normally writes informations you need in flow meter table

regards
laurent

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 14:58:59 GMT

Hi kzone
Thanks! I wasn't aware of this option. I will definitely use this 🙂
But when I use ELT component this option is not available. But NB_LINE and NB_LINE_INSERTED is available from e.g. the component tELTOracleOutput.
Can this somehow be sent to the tFlowMeterCatcher table (without too much effort)?

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 15:05:17 GMT

fix NB_LINE and NB_LINE_INSERTED in tFixedFlow and propagate infos in a tFlowMeter.
it should normally do the 'job'.

regards

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 15:14:31 GMT

Hi kzone
I think it is the part "propagate infos in a tFlowMeter" that I am not quite sure how to do 😉 Could you give an example?

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 01 Jul 2015 15:44:36 GMT

apologize Line, i've made my reply too fast ...
could you try to put tFlowMeter between tELTOracle and Oracle output. Never done before, and i'm not realy confident ...

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Fri, 03 Jul 2015 14:23:20 GMT

Nope that is not possible - the ELT components are special that way. No data actually flows through, all activity is performed by the database. The ELT components are only used to descriebe the metadata, and then Talend generates the SQL statement that is sent to the database.
But your suggestion to catch NB_LINE and NB_LINE_INSERTED in a separate subjob would work. I am just not sure how to propagate the infos into a FlowMeter 😉

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Tue, 14 Jul 2015 19:05:50 GMT

Can anyone help with this?

Re: NB_LINE and tFlowmeterCatcher

Anonymous — Wed, 15 Jul 2015 04:22:47 GMT

Hi Lise
As kzone suggested, try this
...tELTOracleMap....
|
onsubjobok
|
tFixedFlowInput--main--tFlowMeter--tLogRow
tFlowMeterCatcher--main--insert into DB or File.
on tFixedFlowInput, get the value of NB_LINE variable and output it so that it can be monitored by tFlowMeter component. Define one column with Integer/int type, and set its value as:

((Integer)globalMap.get("tELTOracleOutput_1_NB_LINE"))

Best regards
Shong