idea Re: Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup) - Status changed to: Open - Collecting Feedback in Suggest an Idea

Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup)

j_james — Tue, 11 Oct 2022 06:24:23 GMT

Opening this idea on behalf of a customer.

It seems Qlik Replicate is doing a LOB lookup instead of reading from the binlogs of RDS for MySQL source instances when working with "limited LOB size" settings. The binlog of MySQL stores the LOBs as seen in the below page. There is a possibility of improving the performance of Replication if Qlik Replicate can read the LOB data directly from the log rather than always doing a LOB lookup.

For Internal reference: case 00055009

-----------------------------

https://dev.mysql.com/doc/refman/5.7/en/replication-options-binary-log.html#sysvar_binlog_row_image

You can cause the server to log full or minimal rows using the binlog_row_image system variable. This variable actually takes one of three possible values, as shown in the following list:

full: Log all columns in both the before image and the after image.
minimal: Log only those columns in the before image that are required to identify the row to be changed; log only those columns in the after image where a value was specified by the SQL statement, or generated by auto-increment.
noblob: Log all columns (same as full), except for BLOB and TEXT columns that are not required to identify rows, or that have not changed.

The default value is full.

Re: Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup) - Status changed to: Open - Collecting Feedback

Nulee_Massaro — Tue, 22 Nov 2022 13:37:51 GMT

This is a great request. We are seriously considering this. We will report back when we have more information.

From now on, please track this idea from the Ideation por...

Meghann_MacDonald — Wed, 02 Aug 2023 16:02:53 GMT

From now on, please track this idea from the Ideation portal.

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Re: Qlik Replicate : RDS for MySQL as source - Improve LOB Handling (read LOB data from binlog rather than doing a LOB lookup) - Status changed to: Closed - Archived

Ideation — Wed, 02 Aug 2023 16:02:55 GMT