Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Highlighted
Not applicable

Load from Resident table or Disk?

Hello,

Recently I was advise not to use the Resident feature in the Load script and instead use writes and reads from the Disk instead.

I was told that the resident mechanism is less efficient when it comes to large tables.

This fact surprised me as I was sure that to use Resident is best practice as it should make the loads much faster.

Is this fact true? Can someone explain why?

Thanks,

Boris

5 Replies
Partner
Partner

Re: Load from Resident table or Disk?

Not applicable

Re: Load from Resident table or Disk?

Thanks, looked at the link.

couldn't understand a bottom line.

Re: Load from Resident table or Disk?

Bottom line is: it depends.

Factors that impact the speed of an optimised QVD load vs Resident Load:

- availability of RAM

- RAM speed

- I/O channel bandtwidth

- HD type and speed

- what you do during this load

- etc.;.

Bottom-bottom-line is: do perfomance tests with a representative amount of data on your particular hardware. Only then make your choice.

Peter

Not applicable

Re: Load from Resident table or Disk?

I have a problem creating a representative amount of data due to several issues. I have big amounts of data but they do not simulate production data (We work with vendors with strict legislation).

Are there rough benchmarks I can use?

shawn-qv
Contributor

Re: Load from Resident table or Disk?

I'll also mention that if you're reading/writing files across network drives/storage (i.e. NAS, SAN, etc...), that you should also take into consideration the network speed (i.e. 100Mbps or 1Gbps), as this can add a considerable amount of time to your load time.

S.