idea Re: Incremental Rebuild of Data Marts in Compose - Status changed to: Open - In Development in Suggest an Idea

Incremental Rebuild of Data Marts in Compose

Carlo_P — Thu, 20 May 2021 17:27:44 GMT

We would like to see an incremental rebuild or selective rebuild feature in compose for data marts. Currently when we make a simple change to a data mart such as adding a field or a new table it forces us to rebuild the entire set of data mart tables. Our target is snowflake so there is incurred costs to rebuilding the entire data mart and as our data grows over time our outages will grow longer and longer and drive up costs. We would like the ability to be able to rebuild single tables or have compose determine only the objects which need to be rebuilt instead of everything. It also increases our storage cost because it keeps the old version of the data mart tables in snowflake time travel to be able to recover them.

Re: Incremental Rebuild of Data Marts in Compose - Status changed to: Open - On Roadmap

TimGarrod — Tue, 18 Jan 2022 21:10:18 GMT

Changes to how data mart changes are / can be controlled when deploying to upper environments are on the roadmap.

Re: Incremental Rebuild of Data Marts in Compose - Status changed to: Open - In Development

TimGarrod — Mon, 11 Apr 2022 22:17:18 GMT

@Carlo_P - this feature is available for feedback in the Tech Preview of our Qlik Compose May 2022 release.

Please review the docs related to "Reloading Data Marts" and CLI support for marking objects to reload.

Please review the Tech preview - available here - https://community.qlik.com/t5/Technical-Preview/Qlik-Compose-May-2022-Tech-Preview-Now-Available/td-... .

Feedback on the technical preview can be posted to that community board post.

Thanks!

Re: Incremental Rebuild of Data Marts in Compose - Status changed to: Delivered

TimGarrod — Wed, 11 May 2022 18:05:40 GMT

This feature is available in May 2022 release of Compose - now GA.

https://help.qlik.com/en-US/compose/May2022/Content/ComposeDWDL/Main/DW/Data%20Marts/validate_the_data_mart.htm#Validating%20and%20adjusting%20the%20data%20mart

https://help.qlik.com/en-US/compose/May2022/Content/ComposeDWDL/Main/DW/Data%20Marts/reload-datamart.htm