topic Re: QlikView Performance in QlikView

QlikView Performance

RaduM — Thu, 17 Mar 2022 13:59:13 GMT

I have a qvd file that i load with some data. I need to redistribute some of the values from this loaded table based on a combination of dimensions.

what i have done is the following

1. load qvd table (around 3 milion rows)

2 create mapping tables with the combination of dimensions needed for the calculation (around 30 rows)

3 foreach loop with the combinations

preceding load with mapping and calculations

load from resident table

drop resident table

the calculations are corect. the point is that is taking to much time to reload the data (40 minutes)

i have 30 steps in the foreach loop but all the data is coming from a resident table from qvd with is loaded in 2 seconds.

after that a read from resident with the where clause to limit the number of rows

please let me know how can i debug this performance issue. It is a better way to do this?

Re: QlikView Performance

RaduM — Fri, 18 Mar 2022 10:22:02 GMT

I just found a solution and i think will help others also

creating a temporary table with only the data that you need (from resident table with the where clause to limit the number of rows ) will dramaticaly cut the time of processing

my resident table was having around 3.5 milion rows and all this rows was processing inside a foreach loop.

the time was about 1.5 minutes per iteration

creating a diferent table with only the data that i needed to calculate generated a table with only 3000 rows and now the time inside each iteration is 2 seconds

so be careful with the amount of data that you process. is all the data neded?

Re: QlikView Performance

MarcoWedel — Fri, 18 Mar 2022 19:19:06 GMT

There might be a solution without any loops as well that improves the script performance.