idea Re: Compose for DW: Update all the stats on DW and DM tables - Status changed to: Partially Delivered in Suggest an Idea

Compose for DW: Update all the stats on DW and DM tables

sharmamanishv — Tue, 25 Jan 2022 18:27:51 GMT

Currently Compose does not have a mechanism to provide its customers the options on how the statistics should be collected on each of the tables generated via Compose (Hubs, Satellites, Facts and Dimensions).

Providing this options would help to configure, update different statistics on each of the tables created via Compose.

Updating all the statistics on the table would not only help in performance improvement during loads but will also help in efficient query optimization as part of data virtualization or visualization.

Re: Compose for DW: Update all the stats on DW and DM tables

jtompkins — Tue, 25 Jan 2022 19:44:58 GMT

I would add to this and request that the TSTG_ tables be analyzed. Since the TSTG tables are truncated as opposed to dropped, stats are gathered when there are 0 rows in the table and are not updated when they are populated with data.

Re: Compose for DW: Update all the stats on DW and DM tables - Status changed to: Open - On Roadmap

TimGarrod — Wed, 26 Jan 2022 22:34:03 GMT

Managing statistics for internal tables and hubs, sats, facts, dims is on the roadmap for the Azure Synapse platform.

If there are any comments related to other Compose target platforms, please provide them in the comments.

Thanks!

Re: Compose for DW: Update all the stats on DW and DM tables

jtompkins — Tue, 01 Feb 2022 15:08:41 GMT

I would suggest this for Oracle as well.

Re: Compose for DW: Update all the stats on DW and DM tables - Status changed to: Partially Delivered

TimGarrod — Wed, 30 Mar 2022 18:09:42 GMT

This feature was delivered for Azure Synapse Analytics in the Qlik Compose 2021.8 SP12 release.

Re: Compose for DW: Update all the stats on DW and DM tables

sharmamanishv — Thu, 31 Mar 2022 13:26:02 GMT

@TimGarrod

What does "Status changed to: Partially Delivered" mean?

Can you please elaborate on what is delivered and what is pending in terms of stats collection to DW and DM tables?

Re: Compose for DW: Update all the stats on DW and DM tables

TimGarrod — Thu, 31 Mar 2022 13:30:51 GMT

Apologies for the confusion -

I set this to partially delivered due to the common related to Oracle.

(The request did not specify a DW platform)

For Azure Synapse - creation and update of statistics for DWH and DM tables has been delivered fully with stats being created on full load, and updated with sampling based on MSFT best practices for incremental load.

Hope that clarifies.

Re: Compose for DW: Update all the stats on DW and DM tables

sharmamanishv — Thu, 31 Mar 2022 13:32:29 GMT

Thank you Tim!!!

Re: Compose for DW: Update all the stats on DW and DM tables

sharmamanishv — Thu, 14 Apr 2022 14:04:53 GMT

@TimGarrod ,

For this ideation request, can you please help me with the exact process step number in the DWH and DM task statements/instructions where these are implemented?

I believe these are implemented for Hubs, Satellites, Dimensions and Facts. So for every table in this category, there should be a process number or process step assigned to them in the set of instructions for the DWH or DM Task statements which will update statistics after the table is loaded.

I'm looking for those process steps so I can verify them in the instructions post generation.