topic Re: Talend Open Studio: Parallel Requests lost in Karaf in Talend Studio

Talend Open Studio: Parallel Requests lost in Karaf

JDoe1627570841 — Fri, 15 Nov 2024 23:54:24 GMT

Hello Everyone,

So we have an ESB job, where we receive multiple requests, at tRESTRequest component.

This job has a flow to send response back using tRESTResponse and pass the request to concerned stand alone jobs and child jobs.

We have the job deployed in Ubuntu karaf and the issue that we are facing is that there are multiple requests, that are not registered/ delivered by the tRESTRequest, like multiple requests are registering fine and then a bunch of requests are not registered.

They are simply lost. They are not logged in testb logs as well.

We require help figuring out the cause for this loss of requests, whether it is caused by karaf or tRESTRequest disconnection or some internal queue etc. ? Or some other reason altogether.

Any inputs are appreciated.

Thanks in advance !

Re: Talend Open Studio: Parallel Requests lost in Karaf

Anonymous — Tue, 03 Aug 2021 05:49:33 GMT

Hello,

Would you mind posting your ESB job design screenshots here? Did you use any context variable in your flow?

Best regards

Sabrina

Re: Talend Open Studio: Parallel Requests lost in Karaf

JDoe1627570841 — Mon, 16 Aug 2021 12:20:25 GMT

Hello Sabrina,

Thanks for responding and Sorry for a delayed response.

Regarding the job design, I have attached the flow above.

And we use context variable to store tRESTRequest unique Id for each coming request.

The issue we are facing is, multiple requests in a batch are lost and not logged in testb log as well, and other times they process just fine.

We are running this job in karaf console, in Ubuntu, and till now we have tried following solutions:

increased JVM memory allocation for the jobs
increased connection timeout at the database end
increased http.maxconnections = 50, for karaf config

But the issue is not yet resolved conclusively.

I hope this clears the picture a bit for you.