Need to consume messages from RabbitMQ using ESB

Anonymous — Sat, 16 Nov 2024 03:50:11 GMT

Hi,

I am a beginner to both Talend ESB and RabbitMQ, as a start point I need to send a json message ( normal text message ) from RabbitMQ and that should be consumed by Talend job. I have created a sample route job using cMessagendpoint and a talend job which I would like to read the message and write to an excel sheet. The issue I am facing here is, the message is going to the queue but its not getting written to the excel sheet. Below is the URI i am using :

"rabbitmq://xxxxxxxxxxx:xxxxxx/<<exchangename>>?routingKey=*&exchangeType=topic&queue=<<queuename>>&username=<<xxxx>>&password=<<xxxxx>>&sslProtocol=true&autoDelete=false&skipQueueDeclare=true&autoAck=false&vhost=/datawarehouse"

I would like to know how to give the below values, from where do I need to get them? Above is the sample URI which I have got from other project.

Routing key

sslProtocol

autoDelete

skipqueueDeclare

autoAck

vhost

Attached the jobs for your reference.

Kindly help me here.

Regards,

Venu

Re: Need to consume messages from RabbitMQ using ESB

Anonymous — Fri, 13 Dec 2019 11:24:11 GMT

Hi,

Also I have tried running my route job from Talend, however I am getting below warning message while running the same. Hence aborted the same.

Attached the route job for your reference.

[statistics] connected
[WARN ]: com.rabbitmq.client.TrustEverythingTrustManager - This trust manager trusts every certificate, effectively disabling peer verification. This is convenient for local development but prone to man-in-the-middle attacks. Please see http://www.rabbitmq.com/ssl.html#validating-cerficates to learn more about peer certificate validation.
[WARN ]: org.apache.camel.component.rabbitmq.RabbitConsumer - Unable to open channel for RabbitMQConsumer. Continuing and will try again
java.io.IOException
at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:124)
at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:120)
at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:362)
at com.rabbitmq.client.impl.recovery.RecoveryAwareAMQConnectionFactory.newConnection(RecoveryAwareAMQConnectionFactory.java:63)
at com.rabbitmq.client.impl.recovery.AutorecoveringConnection.init(AutorecoveringConnection.java:99)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:921)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:880)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:838)
at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:1021)
at org.apache.camel.component.rabbitmq.RabbitMQEndpoint.connect(RabbitMQEndpoint.java:248)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.openConnection(RabbitMQConsumer.java:64)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.getConnection(RabbitMQConsumer.java:75)
at org.apache.camel.component.rabbitmq.RabbitConsumer.<init>(RabbitConsumer.java:55)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.createConsumer(RabbitMQConsumer.java:112)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.startConsumers(RabbitMQConsumer.java:94)
at org.apache.camel.component.rabbitmq.RabbitMQConsumer.doStart(RabbitMQConsumer.java:163)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.impl.DefaultCamelContext.startService(DefaultCamelContext.java:3701)
at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRouteConsumers(DefaultCamelContext.java:4019)
at org.apache.camel.impl.DefaultCamelContext.doStartRouteConsumers(DefaultCamelContext.java:3954)
at org.apache.camel.impl.DefaultCamelContext.safelyStartRouteServices(DefaultCamelContext.java:3874)
at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRoutes(DefaultCamelContext.java:3638)
at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:3490)
at org.apache.camel.impl.DefaultCamelContext.access$000(DefaultCamelContext.java:208)
at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3249)
at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3245)
at org.apache.camel.impl.DefaultCamelContext.doWithDefinedClassLoader(DefaultCamelContext.java:3268)
at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:3245)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:3168)
at org.apache.camel.spring.SpringCamelContext.start(SpringCamelContext.java:133)
at org.apache.camel.main.Main.doStart(Main.java:139)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.main.MainSupport.run(MainSupport.java:170)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.run(Job_Dequeue_Source_test.java:184)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.runJobInTOS(Job_Dequeue_Source_test.java:290)
at data_anonymisation.job_dequeue_source_test_0_1.Job_Dequeue_Source_test.main(Job_Dequeue_Source_test.java:260)
Caused by: com.rabbitmq.client.ShutdownSignalException: connection error
at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:66)
at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:36)
at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:443)
at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:306)
... 34 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290)
at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:580)
at java.lang.Thread.run(Thread.java:748)

Job Job_Dequeue_Source_test ended at 11:21 13/12/2019. [exit code=1]

Could you please suggest me the solution.

Regards,

Venu

route job.PNG

topic Need to consume messages from RabbitMQ using ESB in Talend Studio

Need to consume messages from RabbitMQ using ESB

Re: Need to consume messages from RabbitMQ using ESB