topic Re: Upgrading RAM on physical server in Connectivity & Data Prep

Upgrading RAM on physical server

Anonymous — Mon, 14 May 2018 13:36:15 GMT

Our BI resource has brought to our attention that when creating an app within Qlicksense he must load a heavy amount of data from our Salesforce environment. At times this data load can take anywhere from 5 to 20 minutes. Each time he makes changes to the code he must perform another load. He's spending a lot of time waiting for the data load. Currently our server has 16GB of RAM. Would upgrading the RAM have a significant improvement on his data load times? Thanks in advance for any suggestions.

Re: Upgrading RAM on physical server

petter — Mon, 14 May 2018 20:27:03 GMT

Very unlikely. He could however use QVD-files to have a staging layer for the data and that can siginificantly speed up the reload process - up to 20 times the speed when it comes to relation databases and probably more with Salesforce.

Re: Upgrading RAM on physical server

petter — Mon, 14 May 2018 20:29:04 GMT

Another option that can be used is the BUFFER prefix for the LOAD statement that will buffer/cache the content from Salesforce automatically.

Have a look here: https://help.qlik.com/en-US/sense/April2018/Subsystems/Hub/Content/Scripting/ScriptPrefixes/Buffer.htm

Re: Upgrading RAM on physical server

JustinDallas — Tue, 15 May 2018 20:43:59 GMT

How does buffer know which field is the timestamp field? And is 'Buffer' another way of doing an incremental load, cause that's what it looks like.

Re: Upgrading RAM on physical server

petter — Wed, 16 May 2018 09:35:29 GMT

Buffer is a cache mechanism so you can specify the update frequency. It will not use any timestamp field - it is not an alternative to incremental load. It makes you less dependent on reading the source and speeds up the development significantly.