<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic stream buffer size vs stream buffer number in Qlik Replicate</title>
    <link>https://community.qlik.com/t5/Qlik-Replicate/stream-buffer-size-vs-stream-buffer-number/m-p/2059817#M5663</link>
    <description>&lt;DIV class="flex-1 overflow-hidden"&gt;
&lt;DIV class="react-scroll-to-bottom--css-vxrdx-79elbk h-full dark:bg-gray-800"&gt;
&lt;DIV class="react-scroll-to-bottom--css-vxrdx-1n7m0yu"&gt;
&lt;DIV class="flex flex-col items-center text-sm dark:bg-gray-800"&gt;
&lt;DIV class="group w-full text-gray-800 dark:text-gray-100 border-b border-black/10 dark:border-gray-900/50 bg-gray-50 dark:bg-[#444654]"&gt;
&lt;DIV class="text-base gap-4 md:gap-6 md:max-w-2xl lg:max-w-xl xl:max-w-3xl p-4 md:py-6 flex lg:px-0 m-auto"&gt;
&lt;DIV class="relative flex w-[calc(100%-50px)] flex-col gap-1 md:gap-3 lg:w-[calc(100%-115px)]"&gt;
&lt;DIV class="flex flex-grow flex-col gap-3"&gt;
&lt;DIV class="min-h-[20px] flex flex-col items-start gap-4 whitespace-pre-wrap"&gt;
&lt;DIV class="markdown prose w-full break-words dark:prose-invert light"&gt;
&lt;P&gt;Hi Team,&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Please let me know, if my understanding is correct or not.&lt;/P&gt;
&lt;P&gt;The stream buffer size determines the amount of data that Qlik Replicate will read from the source system before sending it to the target system. A larger buffer size can increase throughput by reducing the number of network round trips required to move data, but it can also increase memory usage on the Replicate server. The optimal stream buffer size will depend on factors such as the size of the data being transferred and the available memory on the Replicate server.&lt;/P&gt;
&lt;P&gt;The stream buffer number controls the number of stream buffers that Qlik Replicate will use to move data. Each stream buffer is associated with a separate thread, allowing Replicate to move data from multiple tables or files in parallel. Increasing the number of stream buffers can improve parallelism and reduce latency, but it can also increase CPU usage on the Replicate server. The optimal stream buffer number will depend on factors such as the number of tables or files being transferred and the available CPU resources on the Replicate server.&lt;/P&gt;
&lt;P&gt;Thanks.&lt;/P&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;</description>
    <pubDate>Thu, 13 Apr 2023 01:43:19 GMT</pubDate>
    <dc:creator>suvbin</dc:creator>
    <dc:date>2023-04-13T01:43:19Z</dc:date>
    <item>
      <title>stream buffer size vs stream buffer number</title>
      <link>https://community.qlik.com/t5/Qlik-Replicate/stream-buffer-size-vs-stream-buffer-number/m-p/2059817#M5663</link>
      <description>&lt;DIV class="flex-1 overflow-hidden"&gt;
&lt;DIV class="react-scroll-to-bottom--css-vxrdx-79elbk h-full dark:bg-gray-800"&gt;
&lt;DIV class="react-scroll-to-bottom--css-vxrdx-1n7m0yu"&gt;
&lt;DIV class="flex flex-col items-center text-sm dark:bg-gray-800"&gt;
&lt;DIV class="group w-full text-gray-800 dark:text-gray-100 border-b border-black/10 dark:border-gray-900/50 bg-gray-50 dark:bg-[#444654]"&gt;
&lt;DIV class="text-base gap-4 md:gap-6 md:max-w-2xl lg:max-w-xl xl:max-w-3xl p-4 md:py-6 flex lg:px-0 m-auto"&gt;
&lt;DIV class="relative flex w-[calc(100%-50px)] flex-col gap-1 md:gap-3 lg:w-[calc(100%-115px)]"&gt;
&lt;DIV class="flex flex-grow flex-col gap-3"&gt;
&lt;DIV class="min-h-[20px] flex flex-col items-start gap-4 whitespace-pre-wrap"&gt;
&lt;DIV class="markdown prose w-full break-words dark:prose-invert light"&gt;
&lt;P&gt;Hi Team,&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Please let me know, if my understanding is correct or not.&lt;/P&gt;
&lt;P&gt;The stream buffer size determines the amount of data that Qlik Replicate will read from the source system before sending it to the target system. A larger buffer size can increase throughput by reducing the number of network round trips required to move data, but it can also increase memory usage on the Replicate server. The optimal stream buffer size will depend on factors such as the size of the data being transferred and the available memory on the Replicate server.&lt;/P&gt;
&lt;P&gt;The stream buffer number controls the number of stream buffers that Qlik Replicate will use to move data. Each stream buffer is associated with a separate thread, allowing Replicate to move data from multiple tables or files in parallel. Increasing the number of stream buffers can improve parallelism and reduce latency, but it can also increase CPU usage on the Replicate server. The optimal stream buffer number will depend on factors such as the number of tables or files being transferred and the available CPU resources on the Replicate server.&lt;/P&gt;
&lt;P&gt;Thanks.&lt;/P&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;
&lt;/DIV&gt;</description>
      <pubDate>Thu, 13 Apr 2023 01:43:19 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Qlik-Replicate/stream-buffer-size-vs-stream-buffer-number/m-p/2059817#M5663</guid>
      <dc:creator>suvbin</dc:creator>
      <dc:date>2023-04-13T01:43:19Z</dc:date>
    </item>
    <item>
      <title>Re: stream buffer size vs stream buffer number</title>
      <link>https://community.qlik.com/t5/Qlik-Replicate/stream-buffer-size-vs-stream-buffer-number/m-p/2059885#M5664</link>
      <description>&lt;P&gt;Hi,&amp;nbsp;&lt;/P&gt;
&lt;P&gt;The first part of your summary is correct. However the second part is slightly different as the sorter sends to the target commited transactions so the data object that is being sent is transaction data i.e it should be rephrased as follows:&lt;BR /&gt;&lt;SPAN&gt;"The stream buffer number controls the number of stream buffers that Qlik Replicate will use to move data. &lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;Each stream buffer is associated with a separate thread, allowing Replicate to move data from multiple transactions."&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;FYI - here is link to an article that provides some details on how to set the stream buffer size &amp;amp; number:&lt;BR /&gt;&lt;A href="https://community.qlik.com/t5/Official-Support-Articles/Qlik-Replicate-Outgoing-stream-is-full-Forwarding-events-to/ta-p/1816058" target="_blank"&gt;https://community.qlik.com/t5/Official-Support-Articles/Qlik-Replicate-Outgoing-stream-is-full-Forwarding-events-to/ta-p/1816058&lt;/A&gt;&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;Regards,&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;Orit&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Thu, 13 Apr 2023 06:55:33 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Qlik-Replicate/stream-buffer-size-vs-stream-buffer-number/m-p/2059885#M5664</guid>
      <dc:creator>OritA</dc:creator>
      <dc:date>2023-04-13T06:55:33Z</dc:date>
    </item>
  </channel>
</rss>

