topic Re: 8 node limit for Qlik Sense architecture in Management & Governance

8 node limit for Qlik Sense architecture

Anonymous — Wed, 24 Jan 2018 13:41:44 GMT

After reading several documents, I have now formulated what I believe is the best possible Qlik Sense architecture (illustration below).

By this I mean best practices recommended by Qlik via various documents have been incorporated. For example the deployment guide for AWS mentions the benefits of having a external load balancer (nginx or haproxy) and it makes a lot of sense. The STT published in October mentions the possibility of having a active secondary node.

It would be nice to get some feedback on this illustration. I'm however wondering if the "8 node maximum" limit is going to stay long because with that my architecture would not scale horizontally. ie. I can only have two proxy nodes and two engine nodes and not more.

If I make the secondary node also a scheduler, I could add another engine node but that's about it.

Is the 8 node limit therefore hard coded or is it just a soft limit defined by qlik support. In the beginning the above configuration will be more than sufficient for my client, but before I propose this I would like to know if scaling beyond 8 nodes would be a reality in the future.

I have also seen some hints suggesting an architecture based on containers would be available in the near future which suggests that we would be able to scale beyond 8 nodes. Would be nice to hear some thoughts from the experts on this board.

References

1. STT - Failover in Qlik Sense.

2. Qlik Sense on AWS - Deployment Guide

3. Plan Qlik Sense deployments for version 3

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Fri, 26 Jan 2018 00:12:30 GMT

8 (engine) nodes was the tested limit likely at the time.

As of 3.2.x or higher, the tested number is 12 (engine) nodes.

Re: 8 node limit for Qlik Sense architecture

Anonymous — Fri, 26 Jan 2018 11:43:43 GMT

Thanks Levi. Here is a screenshot from the Nov 2017 Plan and deploy guide. Clearly says 8 nodes is the supported limit.

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Fri, 26 Jan 2018 12:01:54 GMT

Please provide the link, because it is wrong on two levels (vetted limit of Engine nodes and lack of specificity of what counts towards that limit). The limit has always been about Engine services not nodes as such: https://youtu.be/2OIvZvaNGN4?t=17m25s

Re: 8 node limit for Qlik Sense architecture

Anonymous — Fri, 26 Jan 2018 13:00:09 GMT

ok good to know that you work for Qlik Support. And you right that there is a faint mention of the node limit being that for engine nodes, in the youtube video where you present shared persistence.

I would look at the plan and deploy guide which is available via the product download page. I'm adding the link here but if you are unable to access it please find it from the product download page and by selecting Qlik Sense and November 2017 as the options in the filter.

https://da3hntz84uekx.cloudfront.net/QlikSense/11.24/2/Plan%20and%20deploy%20Qlik%20Sense.pdf

Other than the difference of opinion on the node limit - do you have some feedback on this architecture diagram?

I have combined information from a variety of documentation and STT videos to come up with that diagram. The qlik documentation unfortunately does not seem to catch up with the developments. For example STT for failover clearly mentions that any node could be designated as a secondary node (active-active) but the Plan and Deploy guide does not seem to capture this change in stance.

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Fri, 26 Jan 2018 13:25:10 GMT

ok good to know that you work for Qlik Support. And you right that there is a faint mention of the node limit being that for engine nodes, in the youtube video where you present shared persistence.

I mean I was the person who did those presentations

Grazie. I'll log that as a doc bug.

For example STT for failover clearly mentions that any node could be designated as a secondary node (active-active) but the Plan and Deploy guide does not seem to capture this change in stance.

Can you specifically mention what is misaligned? I'd prefer the specificity about what you find issue with rather than what my eyes find off.

Re: 8 node limit for Qlik Sense architecture

jaisoni_trp — Fri, 26 Jan 2018 15:06:00 GMT

Even i was under the impression that 8 is the limit for whole architecture. We were planning to include more scheduler in our architecture but couldn't do so because of this misconception. Thanks for clarifying ltu‌

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Fri, 26 Jan 2018 15:31:46 GMT

Yeah the messaging was imprecise. The limit has always been about Engines. Ultimately due to concerns about coordinating file locking at scale.

Re: 8 node limit for Qlik Sense architecture

amien — Wed, 06 Jun 2018 22:58:32 GMT

Any update on this one Levi? Max is still 12 in April release?

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Thu, 07 Jun 2018 12:00:59 GMT

It's still 12 nodes, yes.

Re: 8 node limit for Qlik Sense architecture

jaisoni_trp — Thu, 07 Jun 2018 12:19:03 GMT

Hi Levi,

12 nodes is the limit for Engine nodes. What about scheduler and proxy? Or is it we can have 12 nodes max in overall architecture.

Thanks,

Jai

Re: 8 node limit for Qlik Sense architecture

Levi_Turner — Fri, 08 Jun 2018 13:36:06 GMT

The current feedback from the R&D team is 12 nodes, period.

Re: 8 node limit for Qlik Sense architecture

LeonardoSilva_CODEX — Mon, 20 May 2019 20:23:34 GMT

Hi, my name is Leonardo, and im planning a very big archtecture at this moment, and woud like to know if your archtecture worked fine. How is the behaviour, what were the difficulties, why didnt you propouse a deployment and a consumer node?

I'am planning to use fallover as master and replica, if master falls down replica assumes all the roles, but not for all the nodes, just for central and DB PostgreSQL.

Re: 8 node limit for Qlik Sense architecture

ilias_fytrakis — Tue, 21 May 2019 06:51:36 GMT

Dear Leonardo,

Regarding your question, we have set up the following environment:

1 H/A virtual machine node which hosts the repository DB as well as the shared folder (encrypted & h/a storage)
2 external (DMZ) Proxy Nodes - (accessed by external users)
2 internal Proxy Nodes - (accessed by internal users) - the NLB feature of Windows Server O/S was utilized
2 nodes for Central & Failover
6 Engine Nodes (1 per Customer Department)

In this case we faced the following:

Extensive network & firewall configuration. (URL: https://help.qlik.com/en-US/sense/September2018/Subsystems/PlanningQlikSenseDeployments/Content/Sense_Deployment/Ports.htm)
Creation of custom security rules to create different user types (e.g . developers, consumers).
Creation of custom load balancing rules to serve certain applications on specific Nodes of the deployment.
Creation of custom properties for the Department as well as User Types.
Enable only TLS v.1.2.
Removal of Qlik service account from the Local Administrators group on each machine.
Use of 3rd party certificate by the Proxies.
Use of Qlik-Cli to automate certain administrative tasks (e.g. automatically move applications between test & production environment).
Installation & configuration of 3rd parth ODBC drivers to access specific data sources.
Creation of a stress test plan by utilizing Qlik Scalability Tools and Hardware Benchmarking Package.

According to the following documentation entry:

Title: Persistence

URL: https://help.qlik.com/en-US/sense/September2018/Subsystems/PlanningQlikSenseDeployments/Content/Sense_Deployment/Persistence.htm

The requirements for the share are:

The Qlik Sense nodes in the cluster must have network latency below 4 milliseconds to connect to the file share server. Performance can degrade if this is not the case.
The bandwidth to the file share must be appropriate for the amount of traffic on the site. The frequency and size of the apps being saved after reloading, and opened into memory, drives this requirement. 1 Gigabit networking is suggested.

I wish you an error-free Qlik Sense deployment!

Best regards,

iLiAS

Re: 8 node limit for Qlik Sense architecture

LeonardoSilva_CODEX — Thu, 23 May 2019 17:14:27 GMT

Thanks for your replay and help Ilias,

Its a great archtecture you have!

I have some questions about it:

1 - Why didnt you use a local network storage as the shared folder?

2 - These proxyes are HA? using Windows NBL?

3 - these 6 engine nodes... how are they organized, like 2 for external user access panels, 1 develeper, 1 scheduler... ?

Thanks for your help!

Best Regards,

Leo

Re: 8 node limit for Qlik Sense architecture

ilias_fytrakis — Fri, 24 May 2019 09:22:23 GMT

Hi Leo,

Regarding your questions:

1. The customer has attached the UNC Shared Folder on a Highly Available, encrypted storage mechanism.

2. We have two Proxy nodes, which receive user requests via Windows NLB Feature. So, end-users access a virtual IP and then redirected to one of those nodes.

3. The Engine Nodes are assigned on the following way: 1 node per department (# of Depts = 5) + 1 spare node.

Finally, we have separate / isolated Qlik Sense Servers for development purposes of each department.

Thanks,
iLiAS