Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello All.
Our Linux Admin has enabled HugePages on the Linux Server that is hosting our Replicate instance. Does anybody know how, or if it is even possible, to configure Qlik Replicate to use HugePages to make better use of the available memory on the Server? I looked through the install guide and do not see any mention of HugeFiles but google searches will give several different examples but none of them seem to apply. Any Help would be appreciated.
Thanks,
Tim
Hi @TForrest ,
Thank you for reaching out to the Qlik Community.
If you use Transparent HugePages (THP), it should operate seamlessly with Qlik Replicate, as the operating system handles memory management. However, I am not aware of any customers currently using this technology. Please ensure thorough testing to confirm compatibility and performance.
Regards,
Desmond
Hello @TForrest
THP can offer performance improvements for Oracle databases by reducing TLB misses and simplifying memory management as they have to align memory to various Memory continors namely SGA and PGA.
In terms of Qlik, replicate memory is allocated via below mentioned parameters
"stream_buffers_number" : xx, "stream_buffer_size"
Refer below Community article on how memory allocation is done in the Qlik replicate. And we also observed Qlik may occupy a large sample of memory deepand upon the infrastructure.
Qlik Replicate: Outgoing stream is full. Forwarding events to target is postponed
Regards,
Sushil Kumar
Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
Desmond, Thank you for the reply. I think you may have shed a light on where our confusion lies. Our Linux admin was setting the system for Huge Pages and as I am finding out (thanks to your reply) is that Qlik works with Transparent Huge Pages, and there is a difference. Since THP are done at the OS level I do not think it is what our admin was looking for. He wanted to set up Huge Pages and Just allow the Replicate service to use huge pages. And that I am not sure is possible.
Thank you SushilKumar. I looked through the doc you set and determined that our buffer was set to 4 x 100mb so we should be good. But now I know where to go to adjust. Thanks.