topic Re: Increasing the number of threads without using tPartitioner component in Talend Studio

Increasing the number of threads without using tPartitioner component

Anonymous — Thu, 16 Jul 2015 18:55:35 GMT

Hi Team,
I am having a use case of fetching data from a web service in an iterative fashion. I was wondering whether there is a way by which i may manually set the number of parallel threads to fetch data from the web service.
I did check out the tPartitioner component which helps me to set the number of threads up-to N-1, where N is the number of cores available in the machine.Hence, at max i am able to set 3 threads, since i have a quad core processor.

So , i am checking for options where i may set 20-40 parallel threads to fetch data from the web service.
Kindly let me know if there is any way to do this.

Thank You

Re: Increasing the number of threads without using tPartitioner component

Anonymous — Fri, 17 Jul 2015 03:17:04 GMT

Hi sudharshan.c,

Have you checked "Enable parallel execution" option on iterate row? What's your current job design?
Please take a look at document about:TalendHelpCenter:How to launch parallel iterations to read data

Best regards
Sabrina

Re: Increasing the number of threads without using tPartitioner component

Anonymous — Fri, 17 Jul 2015 16:41:00 GMT

Hi Sabrina,
Thanks you!!!! you are a Savior for me!!!!!! Just what i needed.

Thank You

Re: Increasing the number of threads without using tPartitioner component

Anonymous — Fri, 17 Jul 2015 18:56:43 GMT

Also, may i know how to get the thread ID of the parallel executions that are executed in the 'iterate' property?

Re: Increasing the number of threads without using tPartitioner component

Anonymous — Mon, 20 Jul 2015 08:30:05 GMT

Hi,

may i know how to get the thread ID of the parallel executions that are executed in the 'iterate' property?

Could you please set an example for the thread ID of the parallel executions?

Best regards
Sabrina