Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Reg: How to capture no.of insert,update and delete for a table in TIS

Hi All,
The option of capturing total no.fo records affected in TIS is available. I want to capture how many no.of records inserted, updated and deleted for a particular table through TISEE 3.2.3. Is there any metadata table supported by Talend to capture these statistics information at table level. Also in my designer window I can see no.of records inserted into a table/sec, when I check statistics option while executing a job. How can I capture these information into a table.
Thanks
Najeeb
Labels (2)
10 Replies
Anonymous
Not applicable
Author

Hello
Add a tFlowMeter component between input component and output component, and then using tFlowMeterCatcher to catch the no of records. For example:
tFileInput--->tFlowMeter--->tMysqlOutput_1
tFlowMeterCatcher---tLogRow
There is one column called count on the schema of tFlowMeterCatcher which counts the no. of records pass by the specify flow.
Best regards
Shong
_AnonymousUser
Specialist III
Specialist III

Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?
Anonymous
Not applicable
Author

Hello All,
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

Any response for this yet? I need this also 0683p000009MPcz.png
Btw, I am using TOS-Win32-r41260-V4.0.1
Kindly help. Tnx in advance
Anonymous
Not applicable
Author

Hi
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.
Best regards
Shong
Anonymous
Not applicable
Author

Sir sHong,
The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.

what about in TOS? 0683p000009MPcz.png
Anonymous
Not applicable
Author

Hi
In TOS, we only count the number of rows are inserted/updated/deleted, not the rows. For examle:
tFileInputDelimited---tMysqlOutput_1
There are some global variables counts the number of row are inserted/updated/deleted. Such as:
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))

Best regards
Shong
Anonymous
Not applicable
Author

Hi Shong,
I have used ((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED")) in tFileInputDelimited---tMysqlOutput_1 mapping also I have tried tFileInputDelimited---tmap---tMysqlOutput_1 .
But I am getting nothing except NULL.
Could you guide me?
Thanks in Advannce
Santhosh
Anonymous
Not applicable
Author

Hi Santhosh,

Have your data been inserted into MySql DB successfully? Could you please share your job design screenshot with us?
Best regards
Sabrina
_AnonymousUser
Specialist III
Specialist III

Hi,
I am also using the globalmap to get the number of inserseted/rejected rows.
But it return null only.
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_INSERTED")
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_REJECTED")
Thanks