topic Re: POST data size - Karaf - Jetty in Talend Studio

POST data size - Karaf - Jetty

root — Sat, 16 Nov 2024 09:17:55 GMT

Is there any place where I can tell the container to accept lots of data?

In one of my web service, data around 1-2MB is consumed easily. However, when I sent data around 8MB, it was unable to process the data.

I was searching and it looks like jetty is having a max limit on the post data. It can be changed by modifying the jetty-web.xml??

http://www.eclipse.org/jetty/documentation/current/setting-form-size.html

Any direction for setting the Karaf Jetty to accept a bigger amount of data?

Thank you.

Re: POST data size - Karaf - Jetty

root — Mon, 18 Sep 2017 20:43:02 GMT

Shameless BUMP.

Re: POST data size - Karaf - Jetty

root — Tue, 03 Oct 2017 13:58:13 GMT

Any help please? I am out of options here. Does Karaf/ Jetty have any size limitations on the size of incoming FORM POST data? If yes how can I change it?

Thank you.

Re: POST data size - Karaf - Jetty

Anonymous — Tue, 03 Oct 2017 15:14:40 GMT

Which message do you get from the job? Because when I had a problem with bigger files it was down to the memory allocated to the job. Did a translation in the job which costed a lot of memory, the webservice components where able to handle much bigger files without issues.

Re: POST data size - Karaf - Jetty

root — Wed, 04 Oct 2017 21:03:41 GMT

It ends up being a 500 Error on the server side. Please advise what is a good way to troubleshoot it.

Re: POST data size - Karaf - Jetty

Anonymous — Thu, 05 Oct 2017 08:38:11 GMT

Hi,

What I did was adding a Tlogcather combined with a tXMLmap to generate a Document to send with the 500 error. In normal cases you don't need a body with a 500 but you can send (tRestResponse) it so I used the map to add information to help me with the debugging.

Re: POST data size - Karaf - Jetty

root — Thu, 05 Oct 2017 20:36:22 GMT

So wont we have a problem where it will say "Response already sent?"

Re: POST data size - Karaf - Jetty

Anonymous — Fri, 06 Oct 2017 11:57:19 GMT

Not when you let the job die when an error is received.

Re: POST data size - Karaf - Jetty

root — Fri, 06 Oct 2017 15:55:43 GMT

Hmm, I will see if I can add that to test. Nonethe less, is there any way to set the correct POST data size settings?

Re: POST data size - Karaf - Jetty

Anonymous — Fri, 06 Oct 2017 16:06:16 GMT

Not that I am aware of, besides it is generated automaticly. Error 500 is an internal error within the job/ services it self in most cases.

Re: POST data size - Karaf - Jetty

root — Fri, 06 Oct 2017 18:59:18 GMT

If you check the Jetty engine (which is embedded in the Talend Runtime ) it has some setting: http://www.eclipse.org/jetty/documentation/current/setting-form-size.html
I have unable to override the same.

Re: POST data size - Karaf - Jetty

Anonymous — Mon, 09 Oct 2017 07:59:12 GMT

Hi,

For us there was no need so far to dive into these settings, we process reguraly SOAP message bodies up to 20 MB without setting tweaks. I asume your service works well within the studio? Maybe you can monitor your memory usage within the studio of the job and see if there is a spike? In that case allocating more memory withing the runtime to the service cloud solve the issue.

Re: POST data size - Karaf - Jetty

root — Mon, 16 Oct 2017 15:36:26 GMT

I think I have figured out the problem... It seems to be our corporate firewall. Local connections work great. However, publicly accessible services seem to be blocked. Thanks

Re: POST data size - Karaf - Jetty

Anonymous — Wed, 25 Apr 2018 07:34:33 GMT

Hello,

Thanks for your feedback. Please mark your solution as accepted.

Best regards

Sabrina