Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Announcements
QlikView Fans! We’d love to hear from you.
Share your QlikView feedback with the product team… Click here to participate in our 5-minute survey.
Rules, plus terms and conditions, can be found here.
Not applicable

Load from Resident table or Disk?

Hello,

Recently I was advise not to use the Resident feature in the Load script and instead use writes and reads from the Disk instead.

I was told that the resident mechanism is less efficient when it comes to large tables.

This fact surprised me as I was sure that to use Resident is best practice as it should make the loads much faster.

Is this fact true? Can someone explain why?

Thanks,

Boris

5 Replies
manojkulkarni
Valued Contributor II

Re: Load from Resident table or Disk?

Not applicable

Re: Load from Resident table or Disk?

Thanks, looked at the link.

couldn't understand a bottom line.

Re: Load from Resident table or Disk?

Bottom line is: it depends.

Factors that impact the speed of an optimised QVD load vs Resident Load:

- availability of RAM

- RAM speed

- I/O channel bandtwidth

- HD type and speed

- what you do during this load

- etc.;.

Bottom-bottom-line is: do perfomance tests with a representative amount of data on your particular hardware. Only then make your choice.

Peter

Not applicable

Re: Load from Resident table or Disk?

I have a problem creating a representative amount of data due to several issues. I have big amounts of data but they do not simulate production data (We work with vendors with strict legislation).

Are there rough benchmarks I can use?

shawn-qv
Contributor

Re: Load from Resident table or Disk?

I'll also mention that if you're reading/writing files across network drives/storage (i.e. NAS, SAN, etc...), that you should also take into consideration the network speed (i.e. 100Mbps or 1Gbps), as this can add a considerable amount of time to your load time.

S.

Community Browser