Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Talend and RabbitMQ

In our current setup (where we are now introducing Talend) we have RabbitMQ already in place as our central event broker. We now want Talend to start subscribing to queues in RabbitMQ, but this wasn't as easy as I'd initially hoped.
It seems that the ConnectionFactory in Talend is using AMQP 1.0, while RabbitMQ is using AMQP 0.9. There is an experimental plugin for RabbitMQ that introduces AMQP 1.0, but I would rather have Talend use AMQP 0.9 than having experimental plugins in production. For obvious reasons 0683p000009MACn.png
What is the best way to having Talend interacting with RabbitMQ?
Labels (2)
15 Replies
Anonymous
Not applicable
Author

Hi darkhorse,
We have redirected your issue to ESB experts then come back to you as soon as we can.
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
the best way in this case it to use the cMessageEndpoint component (Mediation Perspective in the Talend Studio) and to use the 'RabbitMQ'-component' (select 'rabbitmq' in the advanced tab of the cMessageEndpoint component - (add a new line to the table then you see a combobox which contains 'rabbitmq'.  ) In this case you can access RabbitMQ via AMQP within a Talend-Route (the camel-rabbitmq component uses the RabbitMQ AMQP client). 
The cAMQP component can only be used with an AMQP 1.0 compatible broker as you also mentioned / found out. 
More information on options of the camel-rabbitmq component can be found also here: http://camel.apache.org/rabbitmq.html 
Would be nice to get a short feedback if this has solved your questions and allowed you to progress on your tasks. 
Thanks,
Dietmar 
_AnonymousUser
Specialist III
Specialist III

Hello dietmar,
Am using Talend ESB to publish messages to Rabbit mq.
earlier i was using components like cConnectionFactory,Ctimer,CAMQP,Clog.
In your prev comment i read about cMessagingEndpoint. i enabled it and the rabbitmqcomponnet.
Can you tell me now what all componnets to use now, and how to use.
I order to connect to rabbit mq, ill need to pass url, exchange name, routing key, data
mourina
Contributor
Contributor

Hi,
My ESB open studio does not have mdiation perspective option. Also i cannot find CmessageInput component. Any pointer?
Thanks
vapukov
Master II
Master II

what version number?
in 6.2. it named - Routes, component will be available when You create (open) new route
0683p000009MBRZ.png
mourina
Contributor
Contributor

Hi vapukov,
Thanks a lot.
So I have the job in place now. My URI looks like "rabbitmq://XXXXXXX:5672/Myqueue?username=myuser&password=mypass".
But when I run I get
Starting job rmqnew at 15:12 07/11/2016.
connecting to socket on port 3356
connected
And it pretty much stays like that until I kill it. Any idea?
Thanks
vapukov
Master II
Master II

I not great expert in RabbitMQ, but I use different settings, You can see from 2nd picture - You use not full format

0683p000009MBCH.png   0683p000009MBRe.png   0683p000009MBQh.png
mourina
Contributor
Contributor

Hi Vapukov,
You have been a lot of help so far. My module is working now. Problem was with my URI. I had to pass more parameters to match exactly with the exchange set up.
Now can anyone suggest the best way to dump these messages to a database?
Thanks,
vapukov
Master II
Master II

Add runJob, and parse header and body to Job, inside Job as usual - parse Json, do anything what You need    
0683p000009MBIA.png   0683p000009MBRj.png