Group by Performance tuning

krishna20 — Thu, 01 Jul 2021 11:20:08 GMT

Hi Folks,

I am trying to optimize the Datamodel reload time.

As I am using Group by function for few calculations in the script, datamodel is taking around 38mins to complete the load for entire application. Where as I have 80+ fields including Dimensions and Measures in my fact table. I need to include all fields into group by as those are using in the UI and also tried the below logic, but there is no change in the loading time .

App Size: Around 1GB

Data: 2yrs 6Months

Facts: 1 Fact.

Flat Sources: 4 ( Using Mapping load )

https://community.qlik.com/t5/Documents/Optimize-Group-By-Performance/ta-p/1481470/page/2/show-comments/true

Could anyone tell me how to reduce the loading time by using any technique.

@sunny_talwar , @Anil_Babu_Samineni , @tresB

Thanks in advance !!

Krishna

Re: Group by Performance tuning

krishna20 — Fri, 02 Jul 2021 07:36:02 GMT

Can anyone throw any clue ?

Re: Group by Performance tuning

krishna20 — Fri, 02 Jul 2021 14:45:26 GMT

I have reduced the reload time by 10mins.

Created a separate table for group by calculations and created composite key to link fact .

Still working on optimizing the reload time.

topic Re: Group by Performance tuning in QlikView

Group by Performance tuning

Re: Group by Performance tuning

Re: Group by Performance tuning