topic Re: what is the max parallelize buffer size in talend job in Talend Studio

what is the max parallelize buffer size in talend job

Anonymous — Thu, 05 Jan 2017 12:50:04 GMT

i am running talend jobs parallel. what is the max parallelize buffer size in talend defaulte value is 25000 ,can we increase this number to how much?

Re: what is the max parallelize buffer size in talend job

Anonymous — Fri, 06 Jan 2017 07:23:38 GMT

Hi,
The unit is a row. Every row is pushed in a buffer, when this size is reached:
- the buffer is sent to a new worker thread to process it
- the operation continue filling a new buffer

This is the size of each bucket of data. Best values depends on your machine / jobs.

Best regards

Sabrina

Re: what is the max parallelize buffer size in talend job

Anonymous — Wed, 11 Jan 2017 05:26:13 GMT

hi xdshi,
can you please give sample statistics on how to change these values depending on job,machine.

Re: what is the max parallelize buffer size in talend job

Anil3 — Thu, 12 Sep 2019 19:22:22 GMT

See this help content, looks like this value takes effect only if we are working with database components that too loading data in multiple instances

https://help.talend.com/reader/gbOtKq9AxPG3JywjA6ahZA/a6UNAyrGlZRDIJC_uKvAEQ