Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
QlikWorld 2023, a live, in-person thrill ride. Save $300 before February 6: REGISTER NOW!

Replicate - Better Compression processing for Log Stream component

RanLupovich
Contributor III
Contributor III

Replicate - Better Compression processing for Log Stream component

While moving our use case to log stream we found out that there is hidden parameter that allows to disable compression while writing to internal log stream component while turning off the compression we see a very high increase in the throughput , we tried to understand with support what causing this difference between using compression on lowest ratio of 2 compared to turning it off , the support suggested that a feature request should be raised for tuning the more the compression of the log stream , thanks

 

 

02003938  Koby Ariely (QlikTech)

Actions for this Feed Item

Hi Ran,

 

Note: for some reason, this case was marked as closed. Not sure why. I am re-opening it now.

 

We did some additional discussions with R&D.

From what it looks like to us,  from product preceptive, the only thing that could be done is add a feature request to improve the compression process (there could be several options , for example, have compression be done in a separate thread than the processing the changes)

So right now, we can only see the following solutions: either finding some solution on the OS side , like file systems that support compression as we wrote in the previous comments, or request for a feature request to improve the compression process)

 

 

3 Comments
Shelley_Brennan
Employee
Employee
 
Status changed to: Open - Collecting Feedback
Anonymous
Not applicable

I would be interested in knowing this parameter is in disabling the compression feature of log stream, is it possible that can be shared?

Shelley_Brennan
Employee
Employee

@Anonymous  - If you open a support case they should be able to review your use case and then provide the instructions on disabling the compression parameter.  Thanks!