topic Re: Qlik Replicate KPIs in Qlik Replicate

Qlik Replicate KPIs

sumitdongre — Thu, 06 Oct 2022 16:17:18 GMT

Hi All,

We are replicating data from SAP HANA application to Azure Synapse Analytics. We would like to analyze the CDC processing performance in case of bulk inserts/updates/deletes. We would like to capture parameters like Incoming changes, Applied Changes, Avg Throughput and Avg Latency say during a 24 hour window or any other KPIs that Qlik would recommend. We used the Qlik Enterprise Manager to extract this but it shows throughput only in case of high latency.

Our goal is to baseline this data and perform high change activity in lower environments to observe any deviations or performance drop.

Request you all to suggest on this.

Note: We are using Version 2021.11.0.106

Re: Qlik Replicate KPIs

Steve_Nguyen — Thu, 06 Oct 2022 17:09:35 GMT

all the information are collected from that QEM analytic .

you can check the schema of QEM, and see that we have such info: example:

https://help.qlik.com/en-US/enterprise-manager/November2021/Content/EnterpriseManager/Main/Analytics/Analytics_repository.htm

cdc_evt_applied_insert_count

Integer

The number of INSERTs since the last retrieval time or since the task was started.

cdc_evt_applied_update_count

Integer

The number of UPDATEs since the last retrieval time or since the task was started.

cdc_evt_applied_delete_count

Integer

The number of DELETEs since the last retrieval time or since the task was started.

cdc_evt_applied_ddl_count

Integer

The number of DDLs since the last retrieval time or since the task was started.

full_load_tables_completed_count

Integer

The number of completed tables loaded to the Target at retrieval time.

full_load_tables_loading_count

Integer

The number of tables being loaded to the target at retrieval time.

full_load_tables_queued_count

Integer

The number of tables waiting to be loaded to the target at retrieval time.

full_load_tables_with_error_count

Integer

The number of tables that could not be loaded to the target at retrieval time due to an error

Re: Qlik Replicate KPIs

Dana_Baldwin — Thu, 06 Oct 2022 17:32:41 GMT

Hi @sumitdongre

If you would like to suggest enhancements to the KPI's, please submit your idea here:

https://community.qlik.com/t5/Ideas/idb-p/qlik-ideas

Thanks,

Dana

Re: Qlik Replicate KPIs

sumitdongre — Fri, 07 Oct 2022 15:47:33 GMT

Hi Steve,

Thanks for the response. We executed the script as you suggested but we are getting similar results as of Enterprise Manager Analytics.

We would like to capture the parameters to see CDC performance in case of 3x or 5x increase in source changes. Our goal is to capture the average throughput to see the number of records being processed under normal and stressed (high incoming changes) conditions. As of now, we can see throughput only in case of high latency.

Please let us know your thoughts.

Re: Qlik Replicate KPIs

Steve_Nguyen — Mon, 10 Oct 2022 15:12:33 GMT

@sumitdongre,

sound like you would need a feature request.