Skip to main content

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
This page is no longer in use. To suggest an idea, please visit Browse and Suggest.

Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup)

j_james
Employee
Employee

Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup)

Opening this idea on behalf of a customer. 

It seems Qlik Replicate is doing a LOB lookup instead of reading from the binlogs of RDS for MySQL source instances when working with "limited LOB size" settings. The binlog of MySQL stores the LOBs as seen in the below page. There is a possibility of improving the performance of Replication if Qlik Replicate can read the LOB data directly from the log rather than always doing a LOB lookup. 

For Internal reference:  case 00055009

-----------------------------

https://dev.mysql.com/doc/refman/5.7/en/replication-options-binary-log.html#sysvar_binlog_row_image

You can cause the server to log full or minimal rows using the binlog_row_image system variable. This variable actually takes one of three possible values, as shown in the following list:

  • full: Log all columns in both the before image and the after image.
  • minimal: Log only those columns in the before image that are required to identify the row to be changed; log only those columns in the after image where a value was specified by the SQL statement, or generated by auto-increment.
  • noblob: Log all columns (same as full), except for BLOB and TEXT columns that are not required to identify rows, or that have not changed.

The default value is full.

3 Comments
Nulee_Massaro
Employee
Employee

This is a great request. We are seriously considering this. We will report back when we have more information.

Status changed to: Open - Collecting Feedback
Meghann_MacDonald

From now on, please track this idea from the Ideation portal. 

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Ideation
Explorer II
Explorer II
 
Status changed to: Closed - Archived