Suggest an Idea

[sharmamanishv]

Currently Compose does not have a mechanism to provide its customers the options on how the statistics should be collected on each of the tables generated via Compose (Hubs, Satellites, Facts and Dimensions).

Providing this options would help to configure, update different statistics on each of the tables created via Compose. 

Updating all the statistics on the table would not only help in performance improvement during loads but will also help in efficient query optimization as part of data virtualization or visualization.  

[jtompkins]

I would add to this and request that the TSTG_ tables be analyzed. Since the TSTG tables are truncated as opposed to dropped, stats are gathered when there are 0 rows in the table and are not updated when they are populated with data.

[TimGarrod]

Managing statistics for internal tables and hubs, sats, facts, dims is on the roadmap for the Azure Synapse  platform. 

If there are any comments related to other Compose target platforms, please provide them in the comments.

Thanks!

[jtompkins]

I would suggest this for Oracle as well.

[TimGarrod]

This feature was delivered for Azure Synapse Analytics in the Qlik Compose 2021.8 SP12 release.

[sharmamanishv]

@TimGarrod 

What does "Status changed to: Partially Delivered" mean?

Can you please elaborate on what is delivered and what is pending in terms of stats collection to DW and DM tables?

[TimGarrod]

Apologies for the confusion -

I set this to partially delivered due to the common related to Oracle. 

 (The request did not specify a DW platform)

For Azure Synapse - creation and update of statistics for DWH and DM tables has been delivered fully with stats being created on full load, and updated with sampling based on MSFT best practices for incremental load. 

Hope that clarifies.

[sharmamanishv]

Thank you Tim!!!

[sharmamanishv]

@TimGarrod ,

For this ideation request, can you please help me with the exact process step number in the DWH and DM task statements/instructions where these are implemented?

I believe these are implemented for Hubs, Satellites, Dimensions and Facts. So for every table in this category, there should be a process number or process step assigned to them in the set of instructions for the DWH or DM Task statements which will update statistics after the table is loaded.

I'm looking for those process steps so I can verify them in the instructions post generation.