topic Re: Server with 2 sets of CPU's in Scalability

Server with 2 sets of CPU's

pover — Thu, 26 May 2011 21:56:32 GMT

Hello,

We're reviewing a server with 2 sets of CPU's. Each set is on a different card and has 4 CPU's. Anyone ever have problems with this hardware configuration?

Thanks and regards.

Server with 2 sets of CPU's

StefanBackstrand — Tue, 07 Jun 2011 20:55:16 GMT

Can you elaborate a bit more? What do you mean with sets? Cards? Are there any tech specs?

I haven't seen such convoys myself, if I don't misunderstand the description. But that's only me. 🙂

Re: Server with 2 sets of CPU's

pover — Thu, 16 Jun 2011 20:02:05 GMT

Hello Stefan,

The machine is a HP ProLiant DL980 G7 with 8 8-core Intel X7560 processors on 2 separate trays and 1 TB of RAM. I've attached more detailed specifications. We were seeing poor performance a couple weeks ago, but HP seems to have fixed it because the performance has improved.

Regards.

Server with 2 sets of CPU's

Mon, 20 Jun 2011 10:37:08 GMT

cpu hyper-threading is enabled ?

Server with 2 sets of CPU's

pablolabbe — Fri, 10 Feb 2012 12:52:49 GMT

Hi Karl,

Did you solved the performance problem ?

Regards,

Pablo

Server with 2 sets of CPU's

pover — Fri, 10 Feb 2012 21:42:42 GMT

Pablo,

Sadly, the performance improved without knowing what the hardware provider did. We improved by a couple more seconds using info from tip #8 http://community.qlik.com/docs/DOC-2362

My advice to anybody who believes they have a server performance issue is to look at the QV app itself. I've seen response times reduced 50-60% by changing the RAM configuration or BIOS, but that never seems to be enough for user that expects 1-2 second response times. To achieve those type of response times, you probably need to reduce the data volume or the complexity of the expressions.

Karl

Server with 2 sets of CPU's

pablolabbe — Sun, 12 Feb 2012 14:14:02 GMT

Hi Karl !

The referenced document are part of a valuable section of the Qlikview Scalabity Group that I´ve seen it before. Thank you.

However, can you share with us how large are your environment that requires this kind of hardware ? A server with 1 TB of RAM isn't a common one.

Best Regards,

Pablo Labbe

Qlikview Consultant

www.visiongi.com.br

Server with 2 sets of CPU's

pover — Sun, 12 Feb 2012 17:12:03 GMT

Hi Pablo,

It's not so much that the environment is large. I've only ever seen 120 GB being used at one time. I haven't analyzed the log data, but there are 138 Named CAL's and 600 Document CAL's. The source data has billions of rows of data, but we're using QV apps with weekly aggregated data reduced to the last 2 years in most cases.

The server is so large because of the potential number of users and data in the next couple of years. Looking back on the whole evolution of QV, in my opinion, it would have been better to purchase a server half that size and add an additional clustered in the future.

Karl

Server with 2 sets of CPU's

Sun, 12 Feb 2012 18:50:37 GMT

Hi Karl,

Yes clustering two servers with 512gb of RAM would have been better choice. Because, some days back we just had a discussion with someone from Qliktech and he suggested that performance does not go well with more than 512gb of RAM, so in these cases he suggested clustered enviornment.

Just my 2 cents.

Ashutosh

Re: Server with 2 sets of CPU's

Fri, 02 Mar 2012 14:57:26 GMT

Clustering would only help you if you have multiple dashboards.

From what you have said above , it seems you have one large dashboard , clustering would not improve the performance.

If performance is an issue when you have 64 Cores and 1TB of RAM, you need to look at how the charts and tables in the dashboard have been defined.

Are you doing complex calculations in the dashboard in multiple charts / tables ? Could these calculations be done on the Database before the data set is extracted ?

Are you using nexted if statements ? could you replace these with flags ?

It might not be a server scalablity issue at all ...

Server with 2 sets of CPU's

StefanBackstrand — Fri, 02 Mar 2012 15:03:18 GMT

ParmGupta wrote:
If performance is an issue when you have 64 Cores and 1TB of RAM, you need to look at how the charts and tables in the dashboard have been defined.

Amen to that, brother.

Server with 2 sets of CPU's

pover — Tue, 06 Mar 2012 01:24:41 GMT

I agree with you, Parminder. When I have performance issues it is usually based on the fact that the application is faster in my laptop than in the server. I know there is some overhead with so many CPU's, but I would hope that this is minimal. Set analysis is usually the guilty suspect that makes everything so slow.

Everything is now running as expected.

Karl

Server with 2 sets of CPU's

vgutkovsky — Wed, 18 Apr 2012 15:22:42 GMT

Hi, Karl. I'm experiencing the exact same issue at a client. HP Blade G7 server, massive processing power + memory, terrible performance. I changed all BIOS settings to what's recommended in Tip 8, changed the power mode to Max in Windows, and no luck. Do you still happen to have the HP ticket # from your support request?

Thanks,
Vlad

Re: Server with 2 sets of CPU's

vgutkovsky — Mon, 30 Apr 2012 21:52:48 GMT

For all those interested, this turned out to be an acknowledged QV defect in versions 10 SR4, v11 IR and v11 SR1. The attached PDF provides instructions on how to fix.

Cheers,

Vlad

Re: Server with 2 sets of CPU's

Fri, 05 Oct 2012 20:11:13 GMT

We are running QV 11.0.11307.0 on two HP ProLiant DL980`s G7 with 8 64-core Intel X7560 processors with 1 TB of RAM. As compared to our version 10 SR5 setup. We are noticing very poor performance opening documents via the accesspoint using Ajax and slower reload times. Let me of know of any settings that can be changed to improve performance.

Re: Server with 2 sets of CPU's

Thu, 11 Oct 2012 10:36:30 GMT

11307, sounds like a customer patch.

are you able to install SR2?

Re: Server with 2 sets of CPU's

Tue, 25 Jun 2013 14:28:46 GMT

Karl, Did you figureout the issue?

Re: Server with 2 sets of CPU's

Wed, 25 Sep 2013 23:12:35 GMT

Hi everyone,

I am having same issue, poor perfomance with the following server.

QlikView Version 11.20 SR2.

IBM HX5 BLADE in COMPLEX Mode

SSD 50GB RAID 1

128GB DDR3

Windows 2008 R2 Enterprise (All fix pack/updated) & Tried Windows 2012 Standard (All fix pack/updated)

CPU E7-4807 1.86 X 4 CPU (6 Cores) = (24 Cores total) with Hyper threading deactivated

http://ark.intel.com/products/53569/Intel-Xeon-Processor-E7-4807-18M-Cache-1_86-GHz-4_80-GTs-Intel-QPI

Simple statistic calculation from a file size of 600MB Test took 4.30 Minutes

Over a less powerful blade it's took 30% less time to achieve same operation.

IBM HS22 Blade

SAS 146GB RAID 1

48GB DDR3

Windows 2008 R2 Enterprise (All fix pack/updated)

E5530 2.40 X 2 CPU (4 Cores) = (8 Cores total) with Hyper threading deactivated

http://ark.intel.com/products/37103/

Simple statistic calculation from a file size of 600MB Test took 3:06 Minutes

I followed all the possible document online about hardware setting and so on but wasn't able to improve the performance.

Quick tips #8 - Server Settings For Best Performance

I even tried running a VM on the HX5 over the SAN to rule out the internal SSD drive but that made absolutly no difference at all.

Any suggestion will be welcomed.

Thanks in advance!

Re: Server with 2 sets of CPU's

Jason_Michaelides — Thu, 26 Sep 2013 12:48:42 GMT

I recently heard from a reliable source that 4-socket G7s may have a serious performance issue with QV. This could well go for other 4xCPU boxes. Try halving the CPU affinity in QMC (System > Setup > QVS > Performance) by unticking half the boxes, restart QVS and see how that goes.

Re: Server with 2 sets of CPU's

ggerber — Thu, 26 Sep 2013 12:51:33 GMT

I had similar experience on SR2. Performance is much better after I had upgrade to SR3