Qlik Sense Enterprise on Windows Share Storage options and requirements

Sonja_Bauernfeind — Tue, 22 Oct 2024 11:29:56 GMT

Qlik Sense Enterprise on Windows is reliant on the availability and performance of its server cluster share, where the Qlik Sense apps are stored.

In some instances, the file storage maybe not be compatible with the requirements of Qlik Sense, and this can lead to app corruption. An example of this may be a Distributed File System (DFS) managed share with replication enabled, which can have side effects such as app corruption, apps being removed from disk, and/or not correctly replicated.

In a Qlik Sense Enterprise on Windows site, a file share is used to store the binary app data including the data models and dashboard sheets. It can be located on one of the nodes in the Sense site or located on a dedicated file server for better resilience and performance.

Note: Each Qlik Sense Enterprise on Windows site requires its own file share with its own set of binaries, archives, extensions, etc. If two mirrored environments are configured to use the same files in only one share, besides potentially experiencing file locking issues, the Qlik Sense database will not have the correct references (metadata) pertaining to the information stored in the share. So you will have two Qlik Sense environments updating files on the shares and which are not aware of updates performed by the other environment(s). Performing such action is highly unsupported and will cause malfunction.

See Qlik Sense for Administrators: Persistence for more details on requirements for a file share.
In the case of DFS managed shares, the replication feature on file level can lead to inconsistency with the Qlik Sense apps stored on disk.

Qlik has identified a compatibility challenge in Qlik Sense Enterprise on Windows on November 2023 and February 2024 releases, which causes unexpected results when using a NetApp as storage. See QMC Reload Failure Despite Successful Script in Qlik Sense Nov 2023 and above for details.

Fix versions:

May 2024 Initial Release

February 2024 Patch 4

November 2023 Patch 9

SAN vs. NAS:

Provided that the requirements detailed in this document are met, Qlik Sense will not know the difference between one and the other, but choosing the wrong storage solution can result in bad performance and instability that can be very difficult to troubleshoot.

When your storage is on-premise, Qlik recommends relying on enterprise SAN solutions that can be managed and configured according to your needs. A NAS is better suited for serving files to client machines, while a SAN can be relied upon by multiple servers to give adequate throughput and latency to large blocks of storage. These are typically set up with a fiber channel backbone that can sustain the demand of a large and busy Qlik Sense environment.

For Virtual Private Cloud (VPC) deployments, be aware of multiple instance types and what type of workloads they are suitable for. A Windows-based File Server will run better in a Storage-Optimised virtual machine than a general purpose instance. Consider using block storage services instead of Windows-based, to take advantage of scaling and resilience offered by those providers.

Performance: For any network storage resource, the network backbone throughput and latency will directly influence performance of all file-based operations performed by the Qlik Sense platform on the configured file shares. Examples: first-time loading of apps from file share into Engine memory; saving and refreshing of app changes; log archiving, etc.

For Windows-hosted file shares, the sizing of the File Server machine will directly influence performance of those file shares. Using Administrative Shares instead of UNC paths can severely impact performance, upwards of 50% and causing other issues, such as File Locking.

BAD path example: \\FILESERVER\C$\QlikSenseServiceCluster

GOOD path examples: \\FILESERVER\QlikSenseServiceCluster or \\FILESERVER\QlikDataFiles

It is recommended to remove / disable Administrative shares to prevent unauthorised access to resource and potentially avoid configuration issues between these shares and Qlik Client Managed products.

Qlik recommends a maximum latency of 4 ms between Qlik Sense servers and any file shares. 10 Gbit networking is recommended, considering many parallel file read/write operations can be requested from multiple file share clients (Qlik Sense servers).

Note: Qlik cannot verify support for all storage vendors and Qlik recommends that customers test their preferred infrastructure. In the event of an issue arising that is attributed to storage, Qlik Support may request that customers attempt to replicate the issue on a Windows hosted file share.

Deployment Examples:

Conventional Windows File Share (on-premise)

A windows host is used to serve a file share with storage from local disks (NAS) or SAN.

Resilience:

Use virtualization (e.g. VMware) for the file share OS and benefit from features in the platform to keep the node up or return to use quickly (RTO of 4 hours is simple here)
If available, using Windows clustering to provide HA for a file share. (requires AD and suitable SAN)
Otherwise, backup and restore

Tested by Qlik.

Conventional Windows file share but hosted in AWS

As above but using Amazon EBS volumes mounted to Windows

Resilience:

Use virtualization (VMware) for the file share OS ie benefit from features in the platform to keep the node up or return to use quickly (RTO of 4 hours is simple here)
If available, using windows clustering to provide HA for a file share. (requires AD and suitable SAN)
Otherwise, backup and restore
Amazon EBS volumes feature snapshot capabilities to aid restore process and the failover process can be automated to have a rapid recovery. EBS volumes can be mounted to new instances quickly

Tested by Qlik.

SMB file share served by a Physical NAS

A physical NAS device server an SMB share, such as:

NetApp ONTAP 8.2
Dell Fluid FS
FreeNAS

Resilience:

High availability handled by the individual hardware vendor

Protocol support:

SMB 3.0 required, older versions have known security issues
TLS cipher match between client and server required
Opportunistic Locking (op_lock) enabled on SMB server

Qlik periodically runs network file share performance tests on Qlik Sense using WinShare, and FreeNAS with SMB 3.0. For more information on network file share solutions, contact your Qlik representative.

Re: Qlik Sense Share Storage options and requirements

fmarvnnt — Tue, 19 Mar 2024 09:37:54 GMT

Please review this article according to limitations of later release about NAS..

Regards,

Francesco Mora

Re: Qlik Sense Share Storage options and requirements

Sonja_Bauernfeind — Tue, 02 Apr 2024 11:21:10 GMT

Hello @fmarvnnt

Thank you for your feedback. Can you point me at the specific section in this article that does not align? We have compared it to current releases, and the information was still largely up to date. What was missing was a note that Qlik does perform regular testing on non-Windows NAS devices (which support SMB 3.0).

All the best,
Sonja

Re: Qlik Sense Share Storage options and requirements

fmarvnnt — Tue, 02 Apr 2024 13:47:02 GMT

Yes, Are you sure latest releases support

NetApp ONTAP 8.2

FMa

Re: Qlik Sense Share Storage options and requirements

Sonja_Bauernfeind — Wed, 03 Apr 2024 09:07:27 GMT

Hello @fmarvnnt!

The devices listed in this article are only meant as examples. The importance is to follow the requirements, such as latency, SMB 3, TLS ciphers.

All the best,
Sonja

Re: Qlik Sense Share Storage options and requirements

fmarvnnt — Wed, 03 Apr 2024 09:17:05 GMT

But FreeNAS at the moment is not compatible with the latest "bugged" releases: https://community.qlik.com/t5/crmsupport/casepage/issue-id/00148020/issue-guid/5003z00002oLDQiAAO/issue-provider/salesforce +

Re: Qlik Sense Share Storage options and requirements

Sonja_Bauernfeind — Wed, 03 Apr 2024 11:09:48 GMT

Hello @fmarvnnt

Thank you for the additional context! Could you send me the case number in a direct message, as I am unable to access this link?

All the best,
Sonja

Re: Qlik Sense Share Storage options and requirements

Sonja_Bauernfeind — Wed, 03 Apr 2024 11:49:16 GMT

@fmarvnnt Disregard my last request, I know what you mean now and am investigating internally on how to best proceed.

All the best,
Sonja

Re: Qlik Sense Share Storage options and requirements

BoB_Qlik_Support — Tue, 18 Jun 2024 11:46:18 GMT

Does qlik sense support NetApp E 2824 Santricity storage as physical NAS device server as SMB share.

Bob Support

article Qlik Sense Enterprise on Windows Share Storage options and requirements in Official Support Articles

Qlik Sense Enterprise on Windows Share Storage options and requirements

SAN vs. NAS:

Deployment Examples:

Conventional Windows File Share (on-premise)

Resilience:

Conventional Windows file share but hosted in AWS

Resilience:

Tested by Qlik.

SMB file share served by a Physical NAS

A physical NAS device server an SMB share, such as:

Resilience:

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements

Re: Qlik Sense Share Storage options and requirements