Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Upgrading RAM on physical server

Our BI resource has brought to our attention that when creating an app within Qlicksense he must load a heavy amount of data from our Salesforce environment.  At times this data load can take anywhere from 5 to 20 minutes.  Each time he makes changes to the code he must perform another load.  He's spending a lot of time waiting for the data load.  Currently our server has 16GB of RAM.  Would upgrading the RAM have a significant improvement on his data load times?  Thanks in advance for any suggestions.

4 Replies
petter
Partner - Champion III
Partner - Champion III

Very unlikely. He could however use QVD-files to have a staging layer for the data and that can siginificantly speed up the reload process - up to 20 times the speed when it comes to relation databases and probably more with Salesforce.

petter
Partner - Champion III
Partner - Champion III

Another option that can be used is the BUFFER prefix for the LOAD statement that will buffer/cache the content from Salesforce automatically.

Have a look here: https://help.qlik.com/en-US/sense/April2018/Subsystems/Hub/Content/Scripting/ScriptPrefixes/Buffer.h...

JustinDallas
Specialist III
Specialist III

How does buffer know which field is the timestamp field?  And is 'Buffer' another way of doing an incremental load, cause that's what it looks like.

petter
Partner - Champion III
Partner - Champion III

Buffer is a cache mechanism so you can specify the update frequency. It will not use any timestamp field - it is not an alternative to incremental load. It makes you less dependent on reading the source and speeds up the development significantly.