Qlik Replicate KPIs

[sumitdongre]

Hi All,

We are replicating data from SAP HANA application to Azure Synapse Analytics. We would like to analyze the CDC processing performance in case of bulk inserts/updates/deletes. We would like to capture parameters like Incoming changes, Applied Changes, Avg Throughput and Avg Latency say during a 24 hour window or any other KPIs that Qlik would recommend. We used the Qlik Enterprise Manager to extract this but it shows throughput only in case of high latency.

Our goal is to baseline this data and perform high change activity in lower environments to observe any deviations or performance drop.

Request you all to suggest on this.

Note: We are using Version 2021.11.0.106

[Steve_Nguyen]

all the information are collected from that QEM analytic .

you can check the schema of  QEM, and see that we have such info: example:

https://help.qlik.com/en-US/enterprise-manager/November2021/Content/EnterpriseManager/Main/Analytics...

cdc_evt_applied_insert_count

Integer

The number of INSERTs since the last retrieval time or since the task was started.

cdc_evt_applied_update_count

Integer

The number of UPDATEs since the last retrieval time or since the task was started.

cdc_evt_applied_delete_count

Integer

The number of DELETEs since the last retrieval time or since the task was started.

cdc_evt_applied_ddl_count

Integer

The number of DDLs since the last retrieval time or since the task was started.

full_load_tables_completed_count

Integer

The number of completed tables loaded to the Target at retrieval time.

full_load_tables_loading_count

Integer

The number of tables being loaded to the target at retrieval time.

full_load_tables_queued_count

Integer

The number of tables waiting to be loaded to the target at retrieval time.

full_load_tables_with_error_count

Integer

The number of tables that could not be loaded to the target at retrieval time due to an error

[Dana_Baldwin]

Hi @sumitdongre 

If you would like to suggest enhancements to the KPI's, please submit your idea here:

https://community.qlik.com/t5/Ideas/idb-p/qlik-ideas

Thanks,

Dana

[sumitdongre]

Hi Steve,

Thanks for the response. We executed the script as you suggested but we are getting similar results as of Enterprise Manager Analytics.

We would like to capture the parameters to see CDC performance in case of 3x or 5x increase in source changes. Our goal is to capture the average throughput to see the number of records being processed under normal and stressed (high incoming changes) conditions. As of now, we can see throughput only in case of high latency.

Please let us know your thoughts.

[Steve_Nguyen]

@sumitdongre,

sound like you would need a feature request.