topic Re: Load Balancing for specific streams in Management & Governance

Load Balancing for specific streams

Myke — Sat, 16 Nov 2024 06:56:30 GMT

I have a multi-node set up with one Rim node that handles Engine/Scheduler tasks. The goal is to have this Rim node handle all the work/reloads from a specific stream, and have all other streams continue to use the Central node.

I've set up a virtual proxy for that load balances usage only to the Rim node, and when using the virtual proxy apps work where expected.

The issue is I also want to prevent all other streams from using the Rim node, ie forcing them to always be sent to Central for their scheduled tasks/reloads.

I disabled the default "ResourcesOnNonCentralNodes" rule, and added the following rules.

Setup 1

Rule for Load Balancing Specific Stream
((node.name="RimNode" and resource.stream.@CustomProperty="XYZ"))

Rule for Any Other Stream Load Balancing
((node.iscentral="false" and resource.stream.id!="a70ca8a5-1d59-4cc9-b5fa-6e207978dcaf" and resource.stream.@CustomProperty!="XYZ"))

With this setup, reloads occurred on both nodes

Setup 2

Rule for Load Balancing Specific Stream
((node.name="RimNode" and resource.stream.@CustomProperty="XYZ"))

Rule for Only Central Load Balancing
((node.iscentral="true" and resource.stream.@CustomProperty!="XYZ"))

With this set up, all reloads have happened on Central.

Re: Load Balancing for specific streams

Bastien_Laugiero — Fri, 04 Jan 2019 07:26:37 GMT

Hello,

If I understand correctly you have a 2 nodes setup:

- Central node: Scheduler/Engine Master and Slave

- Rim node: Scheduler/Engine Slave only

And you wish the rim node to reload all the application published to Stream A and let the Central node reload all the other application.

If that's correct, the challenge here is the rule ResourcesOnCentralNodes that gives the central node access to every application and that cannot be modified. So you won't be able to prevent the central node to reload an application published to Stream A.

To achieve what you are looking for, I believe you will need a 3 nodes setup:

- Central node: Scheduler Master only

- Rim node 1: Scheduler/Engine Slave only (reloading only apps published to Stream A)

- Rim node 2: Scheduler/Engine Slave only (reloading the apps published to other streams)

Hope this helps

Re: Load Balancing for specific streams

rohitk1609 — Fri, 04 Jan 2019 07:26:46 GMT

Hi,

For All reload tasks on Non central, you may let ResourcesOnNonCentralNodes enabled and set Central scheduler as MASTER only and RIM node scheduler as SLAVE.

Consumption of resources on which RIM node or central node, depends on your virtual proxy load balancing.

Rest looks fine in your security rules.

For any help drop comment on:

https://community.qlik.com/t5/Qlik-Sense-Enterprise-Documents/Best-Practices-for-Qlik-Sense-Multi-Node-Setup-amp-Load/tac-p/1525826

Thanks,

Rohit