Reloading qvw much slower when using Autonumber

[jjordaan]

Hello QlikView addicts,

I have a relative large qvw (4 gb without compression) and a fact table with 120.000.000 records.

The reload duration of the qvw takes around 40 minutes.

To connect the dimension tables with the fact tables I use composed keys that are quite large. See the example below.

'$(vStoreRowPrefix)' & '-' & [Store No_] & '-' &  [POS Terminal No_] & '-' & [Transaction No_].

It was time to created some modifications to the qvw so I thought I will also add Autonumbers to the dashboard.

Autonumber('$(vStoreRowPrefix)' & '-' & [Store No_] & '-' &  [POS Terminal No_] & '-' & [Transaction No_], 'header')

The size of the qvw did became much smaller but that reload time is greatly increased!

The reload duration is now about 2 hours.

Is this a normal behaviour or am I doing something wrong?

Thanks in advance for all the help

[Anonymous]

Jereon

Can you share the log files from the original 40 min and new 2 hour loads ?

Best Regards,     Bill

[Nicole-Smith]

What is in the variable that you're using in the autonumber?

[jjordaan]

Nicole,

First off all thanks for your reaction.

The variable is representing the store number.

The script is looping over a number of stores

[jjordaan]

Bill,

Thanks for your reply.

Do you mean the generated log files from the qvw?

[Anonymous]

Yup

[swuehl]

I've seen a dramatic slow down when using autonumber in its two argument version (using labels to create separate autonumber ranges) and using quite a lot distinct labels (e.g. using an input field value), but it seems you are using a constant here ('header'), right?

Could you compare to using autonumber() without that label (though I assume you need this label to create a private range for the autonumber, but just to see the impact on the loading time)?

[jjordaan]

I need to create it. So I will get back to you on that.

Thanks again

[jjordaan]

Swuehl,

Thanks for the reply.

I will test it and get back to you

[#10]

Jeroen,

Did you try AutoNumberhash256() ? I have read they are quicker than the other AutoNumber. I cannot say if it true or not.

AutoNumberHash256(arg1, arg2, arg3, arg4) as xxx. So no need to create a concatenated key.

Fabrice