limit the retrieval size on the db2 z endpoint source

[Yves_s]

Hello we have a speed(mb/s) limitation on the brokers after Qlik of mb/s

therefore we asked ourselves the question if he was possible on the db2 z endpoint source to limit the number of records obtained per second or the retrieval size

[OritA]

Hi, 

I am not sure I understand the exact need as when using Replicate all data that is being captured in CDC is replicated. Replicate does not control the network parameters. I suggest you open a SalesForce case and elaborate the need and may be provide an example with the task diagnostic package so we could better understand what is needed and if possible help to set the task accordingly. 

Regards,

Orit

[john_wang · Accepted solution]

Hello @Yves_s ,

In addition to @OritA comments, Are the resource considerations relevant in the Full Load stage or CDC stage?

1- In Full Load stage

    Full Load is a 'once' job in a given period however we may limit the resource usage in various methods:

    (1) Determine if the issue is caused by LOB columns. Excluding some LOB columns can significantly reduce the amount of data transferred and the processor resources required.

    (2) If applicable, apply filters to limit the number of rows. This can reduce resource consumption during the Full Load stage.

    (3) Set proper ODBC Server priority. Qlik Replicate retrieves rows from source tables via ODBC access. Adjust the ODBC Server configuration to balance resource usage effectively.

2- In CDC Stage

    (1) Control the result set to see if helpful

         

    (2) Control the UDTF resource usage in WLM application environment .

Please note that the above items pertain to a single task. If you have multiple tasks running in parallel, reducing the total number of concurrent tasks will significantly reduce resource usage.

Hope this helps.

John.