topic Re: Replicate LOB columns in SQL Server Target in Qlik Replicate

Replicate LOB columns in SQL Server Target

varadharaj — Tue, 23 Jun 2020 13:29:54 GMT

Hi Team,

We have configured the replicate as below

SQL server source -->Log stream

Log stream -->SQL Server target

We need to replicate LOB columns in target, we have configured maximum value 102400 KB, it is throwing below error

Not enough memory resources are available to process this command (apr status = 720008)

What is the value we need to give for LOB columns without truncating data as it is throwing error for even 1000 KB.

Please let us know the expected behavior.

Note :BCP for loading tables is disabled

Re: Replicate LOB columns in SQL Server Target

Madhavi_Konda — Sun, 12 Jul 2020 12:32:05 GMT

Hi Varadharaj,
Please check the available memory/disk on your replicate server machine.
Did you set System memory utilization threshold/Disk space threshold in Resouce Control?

Thanks,
Madhavi

Re: Replicate LOB columns in SQL Server Target

lyka — Thu, 16 Jul 2020 16:28:02 GMT

Hi Varadharaj,

Since you are replicating lob columns, please try to decrease the full load commit rate.

As documented in our user guide:

In some scenarios, tasks configured to replicate tables with multiple LOB

columns may consume a large amount of memory. This is because Replicate allocates

memory by multiplying the Limit LOB size to value by the Commit rate during full

load value, the sum of which, it multiplies by the number of LOB columns being

replicated. So, for example, if LOB size is limited to 5 MB and the default commit rate is

used (10000 events), a task replicating 6 LOB columns will consume 30 GB of memory.

Note that other factors such as the database type and version may also affect memory

consumption.

Should you encounter memory consumption issues and suspect that a combination of

the above factors may be the cause, stop the task and lower the value in the Commit

rate during full load field. Then resume the task. Repeat this process until acceptable

performance/memory levels are reached.

These instructions apply to Change Processing and Full Load tasks.

Hope this helps!

Thanks,

Lyka