Qlik Community

Ask a Question

Connectivity & Data Prep

Discussion board where members can learn more about Qlik Sense Data Connectivity.

Announcements
Our next Qlik Insider session will cover new key capabilities. Join us August 11th REGISTER TODAY
cancel
Showing results for 
Search instead for 
Did you mean: 
nchevaux
Contributor
Contributor

Upgrading RAM on physical server

Our BI resource has brought to our attention that when creating an app within Qlicksense he must load a heavy amount of data from our Salesforce environment.  At times this data load can take anywhere from 5 to 20 minutes.  Each time he makes changes to the code he must perform another load.  He's spending a lot of time waiting for the data load.  Currently our server has 16GB of RAM.  Would upgrading the RAM have a significant improvement on his data load times?  Thanks in advance for any suggestions.

4 Replies
petter
MVP
MVP

Very unlikely. He could however use QVD-files to have a staging layer for the data and that can siginificantly speed up the reload process - up to 20 times the speed when it comes to relation databases and probably more with Salesforce.

petter
MVP
MVP

Another option that can be used is the BUFFER prefix for the LOAD statement that will buffer/cache the content from Salesforce automatically.

Have a look here: https://help.qlik.com/en-US/sense/April2018/Subsystems/Hub/Content/Scripting/ScriptPrefixes/Buffer.h...

JustinDallas
Specialist II
Specialist II

How does buffer know which field is the timestamp field?  And is 'Buffer' another way of doing an incremental load, cause that's what it looks like.

petter
MVP
MVP

Buffer is a cache mechanism so you can specify the update frequency. It will not use any timestamp field - it is not an alternative to incremental load. It makes you less dependent on reading the source and speeds up the development significantly.