topic Re: Can Qlik Replicate use HugePages in Linux in Qlik Replicate

Can Qlik Replicate use HugePages in Linux

TForrest — Tue, 01 Apr 2025 18:59:39 GMT

Hello All.

Our Linux Admin has enabled HugePages on the Linux Server that is hosting our Replicate instance. Does anybody know how, or if it is even possible, to configure Qlik Replicate to use HugePages to make better use of the available memory on the Server? I looked through the install guide and do not see any mention of HugeFiles but google searches will give several different examples but none of them seem to apply. Any Help would be appreciated.

Thanks,

Tim

Re: Can Qlik Replicate use HugePages in Linux

DesmondWOO — Wed, 02 Apr 2025 04:38:07 GMT

Hi @TForrest ,

Thank you for reaching out to the Qlik Community.

If you use Transparent HugePages (THP), it should operate seamlessly with Qlik Replicate, as the operating system handles memory management. However, I am not aware of any customers currently using this technology. Please ensure thorough testing to confirm compatibility and performance.

Regards,
Desmond

Re: Can Qlik Replicate use HugePages in Linux

SushilKumar — Wed, 02 Apr 2025 07:30:45 GMT

Hello @TForrest

THP can offer performance improvements for Oracle databases by reducing TLB misses and simplifying memory management as they have to align memory to various Memory continors namely SGA and PGA.

In terms of Qlik, replicate memory is allocated via below mentioned parameters

"stream_buffers_number"
: xx, "stream_buffer_size"

Refer below Community article on how memory allocation is done in the Qlik replicate. And we also observed Qlik may occupy a large sample of memory deepand upon the infrastructure.

Qlik Replicate: Outgoing stream is full. Forwarding events to target is postponed

Regards,
Sushil Kumar

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!

Re: Can Qlik Replicate use HugePages in Linux

TForrest — Thu, 03 Apr 2025 17:41:07 GMT

Desmond, Thank you for the reply. I think you may have shed a light on where our confusion lies. Our Linux admin was setting the system for Huge Pages and as I am finding out (thanks to your reply) is that Qlik works with Transparent Huge Pages, and there is a difference. Since THP are done at the OS level I do not think it is what our admin was looking for. He wanted to set up Huge Pages and Just allow the Replicate service to use huge pages. And that I am not sure is possible.

Re: Can Qlik Replicate use HugePages in Linux

TForrest — Thu, 03 Apr 2025 17:46:33 GMT

Thank you SushilKumar. I looked through the doc you set and determined that our buffer was set to 4 x 100mb so we should be good. But now I know where to go to adjust. Thanks.