Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Save an extra $150 Dec 1–7 with code CYBERWEEK - stackable with early bird savings: Register
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Need to consume messages from RabbitMQ using ESB

Hi,

 

I am a beginner to both Talend ESB and RabbitMQ, as a start point I need to send a json message ( normal text message ) from RabbitMQ and that should be consumed by Talend job. I have created a sample route job using cMessagendpoint and a talend job which I would like to read the message and write to an excel sheet. The issue I am facing here is, the message is going to the queue but its not getting written to the excel sheet. Below is the URI i am using :


"rabbitmq://xxxxxxxxxxx:xxxxxx/<<exchangename>>?routingKey=*&exchangeType=topic&queue=<<queuename>>&username=<<xxxx>>&password=<<xxxxx>>&sslProtocol=true&autoDelete=false&skipQueueDeclare=true&autoAck=false&vhost=/datawarehouse"

 

I would like to know how to give the below values, from where do I need to get them?  Above is the sample URI which I have got from other project. 

 

Routing key

sslProtocol

autoDelete

skipqueueDeclare

autoAck

vhost

 

Attached the jobs for your reference. 

Kindly help me here. 

 

Regards,

Venu 

 

 

 

 

Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hi,

 

Also I have tried running my route job from Talend, however I am getting below warning message while running the same. Hence aborted the same. 

Attached the route job for your reference. 

 

[statistics] connected
[WARN ]: com.rabbitmq.client.TrustEverythingTrustManager - This trust manager trusts every certificate, effectively disabling peer verification. This is convenient for local development but prone to man-in-the-middle attacks. Please see http://www.rabbitmq.com/ssl.html#validating-cerficates to learn more about peer certificate validation.
[WARN ]: org.apache.camel.component.rabbitmq.RabbitConsumer - Unable to open channel for RabbitMQConsumer. Continuing and will try again
java.io.IOException
at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:124)
at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:120)
at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:362)
at com.rabbitmq.client.impl.recovery.RecoveryAwareAMQConnectionFactory.newConnection(RecoveryAwareAMQConnectionFactory.java:63)
at com.rabbitmq.client.impl.recovery.AutorecoveringConnection.init(AutorecoveringConnection.java:99)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:921)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:880)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:838)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:1021)
at org.apache.camel.component.rabbitmq.RabbitMQEndpoint.connect(RabbitMQEndpoint.java:248)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.openConnection(RabbitMQConsumer.java:64)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.getConnection(RabbitMQConsumer.java:75)
at org.apache.camel.component.rabbitmq.RabbitConsumer.<init>(RabbitConsumer.java:55)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.createConsumer(RabbitMQConsumer.java:112)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.startConsumers(RabbitMQConsumer.java:94)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.doStart(RabbitMQConsumer.java:163)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.impl.DefaultCamelContext.startService(DefaultCamelContext.java:3701)
at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRouteConsumers(DefaultCamelContext.java:4019)
at org.apache.camel.impl.DefaultCamelContext.doStartRouteConsumers(DefaultCamelContext.java:3954)
at org.apache.camel.impl.DefaultCamelContext.safelyStartRouteServices(DefaultCamelContext.java:3874)
at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRoutes(DefaultCamelContext.java:3638)
at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:3490)
at org.apache.camel.impl.DefaultCamelContext.access$000(DefaultCamelContext.java:208)
at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3249)
at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3245)
at org.apache.camel.impl.DefaultCamelContext.doWithDefinedClassLoader(DefaultCamelContext.java:3268)
at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:3245)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:3168)
at org.apache.camel.spring.SpringCamelContext.start(SpringCamelContext.java:133)
at org.apache.camel.main.Main.doStart(Main.java:139)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.main.MainSupport.run(MainSupport.java:170)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.run(Job_Dequeue_Source_test.java:184)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.runJobInTOS(Job_Dequeue_Source_test.java:290)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.main(Job_Dequeue_Source_test.java:260)
Caused by: com.rabbitmq.client.ShutdownSignalException: connection error
at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:66)
at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:36)
at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:443)
at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:306)
... 34 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290)
at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:580)
at java.lang.Thread.run(Thread.java:748)

Job Job_Dequeue_Source_test ended at 11:21 13/12/2019. [exit code=1]

 

Could you please suggest me the solution. 

 

Regards,

Venu 


route job.PNG