topic Re: parallelization of route in Talend Studio

parallelization of route

Anonymous — Sat, 16 Nov 2024 10:36:43 GMT

Hi,
My route consume a JMS messages in activeMQ.
I want to parallelize this route in runtime because there is a lot of messages in ActiveMq so the treatment is very slow.
any ideas ?

Re: parallelization of route

Anonymous — Mon, 06 Jun 2016 05:22:56 GMT

Hi,

Could you try to add the "concurrentConsumers" option to the cJMS component (Advanced view -> URI options) ? then the code generation looks like:

        from(
                "cMQConnectionFactory1:queue:queue.name"
                        + "?concurrentConsumers=" + 10)

(for more options see http://camel.apache.org/jms.html)

Regards.

Re: parallelization of route

Anonymous — Mon, 06 Jun 2016 09:14:51 GMT

Indeed you can set the concurrentConsumers parameter, but you rather test, if the tJob really runs in parallel as well.

As far I know (at least in the previous versions) the biggest difference between the mediation and jobs were in parallel processing.
The routes were capable of running in parallel processing a single message, for the route there's a single instance capable of processing multiple data rows. So mixing Camel (mediation) and DI jobs were not always performance effective (having a single DI job with a single data row, the jJob element becomes the serialization bottleneck). However - if you start the tJob from the mediation flow, you rather test it how it really works

Mediation-job / job-mediation invocation has changed in a few last versions and my knowledge my not be current, so take my notes as points of attention, not rules

Re: parallelization of route

Anonymous — Mon, 31 Oct 2016 09:40:35 GMT

Hi,
It works with this syntaxe:

Thanks xldai, gusto2

Best regards,
Lachmiter