Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

what is the max parallelize buffer size in talend job

i am running talend jobs parallel. what is the max parallelize buffer size in talend defaulte value is 25000 ,can we increase this number to how much?
0683p000009MCsk.png
Labels (2)
3 Replies
Anonymous
Not applicable
Author

Hi,
The unit is a row. Every row is pushed in a buffer, when this size is reached: 
- the buffer is sent to a new worker thread to process it 
- the operation continue filling a new buffer

This is the size of each bucket of data. Best values depends on your machine / jobs. 


Best regards


Sabrina

Anonymous
Not applicable
Author

hi xdshi,
          can you please give sample statistics on how to change these values depending on job,machine.
Anil3
Contributor
Contributor

See this help content, looks like this value takes effect only if we are working with database components that too loading data in multiple instances

 

https://help.talend.com/reader/gbOtKq9AxPG3JywjA6ahZA/a6UNAyrGlZRDIJC_uKvAEQ