topic Re: Performance falls if OSGI job is deployed in Talend Studio

Performance falls if OSGI job is deployed

Anonymous — Sat, 16 Nov 2024 09:26:41 GMT

Hello everybody

I've got some problem using an OSGI job.

I've developed a job whitch has to receive an xml file, transform data, send data to SOAP service, receive back the data, transform them again and finally responce! see capture1.jpg

If I run the job on "Open Studio", it works fine taking not too much time!

If I deploy the service as OSGI, the performances falls down.

50% of the requestes works but taking 3 times more time than in Studio, the rest of the requestes takes longer than result in a time out.

Could someone please suggest what to check or change in order to avoid performance falls!

thanks in advance

Muzio

Re: Performance falls if OSGI job is deployed

Anonymous — Tue, 08 Aug 2017 09:10:58 GMT

Hello,

Could you please indicate on which build version you got this issue? Are you using the same version for your studio and runtime?

Best regards

Sabrina

Re: Performance falls if OSGI job is deployed

Anonymous — Mon, 28 Aug 2017 09:26:30 GMT

Hello Sabrina

Sorry for the delay..

I'm working on 6.3.0.20161026_1219 Open Studio Verision.

I've got some problems to identify which RunTime version i'm working on!

I always suppose to be the same than the studio....

Could you please help me to identify the RunTime version?

Re: Performance falls if OSGI job is deployed

Anonymous — Fri, 01 Sep 2017 09:13:36 GMT

Hello Sabrina

Sorry for the delay..
I'm working on 6.3.0.20161026_1219 Open Studio Verision.
I've got some problems to identify which RunTime version i'm working on!
I always suppose to be the same than the studio....

Could you please help me to identify the RunTime version?

Re: Performance falls if OSGI job is deployed

Anonymous — Fri, 08 Sep 2017 11:12:25 GMT

Can someone give me a help please!!! Since august i'm running 2 of those ws in debug mode....
How it's possible debug services are much more faster than

Re: Performance falls if OSGI job is deployed

Anonymous — Mon, 11 Sep 2017 04:12:32 GMT

Hello,

Sorry for delay!

Could you please use info to check your talend runtime build version?

Is there any error message in runtime log? Which is located in <runtime>\containber\log\tesb.log

With talend open source, the runtime basically allows you to use the same JVM, which means that they essentially share the same memory.

For your scenario, you can use the cron tab (Linux) or a scheduler (Windows) to start your DI Jobs, and use the ESB Runtime to run just services and routes.

Best regards

Sabrina

Re: Performance falls if OSGI job is deployed

Anonymous — Mon, 18 Sep 2017 10:03:46 GMT

Hi Sabrina

Could you please use info to check your talend runtime build version?

Sorry Sabrina... i really feel myself like an idiot... but no way to find a "info" anywhere.

At the moment, with de deployed version seams to not exist anymore the timeout problem.

But the performance still falls.

thank you

see log file

tesb.log

Re: Performance falls if OSGI job is deployed

Anonymous — Mon, 18 Sep 2017 10:07:25 GMT

I forgot to give you the percentage..
Deployed job 56 seconds
Debug job 23 seconds

100% slower

Re: Performance falls if OSGI job is deployed

Anonymous — Mon, 18 Sep 2017 10:09:08 GMT

double sorry...

service name is ISAPRO_cSAP_IN_OrderSimulation

thanks again

Re: Performance falls if OSGI job is deployed

Anonymous — Tue, 19 Sep 2017 04:58:28 GMT

Hello,

Have you tried to use the cron tab (Linux) or a scheduler (Windows) to start your DI Jobs to see if the performance is better?

With talend open source for ESB, there is no job server you can use.

Best regards

Sabrina

Re: Performance falls if OSGI job is deployed

Anonymous — Tue, 19 Sep 2017 12:42:08 GMT

Hello Sabrina

The DI job are already scheduled (see scheduler.jpg)

but the heaviest job has not big data integration activity... it is mostly data transformation and SOAP request.

I've notice the CPU is 100% for longer when job is deployed. When job run in open studio, it take 80% for short time.

I've found some topics where somebody suggest to augment the JVM RAM usage.

i've tryed to augment the Memory usage of JVM on file SETENV.BAT lacated in (runtime folder)/Container/Bin like this:

SET JAVA_MIN_MEM=512M
SET JAVA_MAX_MEM=4096M

is this influent in your opinion? is the syntax right?

thanks

Muzio

Scheduler.jpg

Re: Performance falls if OSGI job is deployed

Anonymous — Wed, 20 Sep 2017 08:05:22 GMT

Hello,

Here is online document about:TalendHelpCenter:Memory Allocation Parameters

It is running for a long time or costs too much memory in runtime?

Best regards

Sabrina

Re: Performance falls if OSGI job is deployed

Anonymous — Wed, 20 Sep 2017 14:09:14 GMT

Thanks Sabrina

I appreciate a lot your help!

Service run too long and rake 100% of CPU but, in a old post i've found that kind of suggestion about the JVM memory..

lets see!

Could you please confirm the syntax i use was right?

JAVA_MAX_MEM=4096M

thanks

Re: Performance falls if OSGI job is deployed

Anonymous — Thu, 21 Sep 2017 08:29:50 GMT

Hello,

The JAVA_MAX_MEM corresponds to the JVM parameter -Xmx and JAVA_MIN_MEM corresponds to the JVM parameter -Xms.

Best regards

Sabrina

Re: Performance falls if OSGI job is deployed

Anonymous — Thu, 21 Sep 2017 08:52:48 GMT

My fault is not the MEANING... in doc you has linked to me... but also in the setenv.bat there's a quite good explaination.
My doubt is about the SYNTAX

set JAVA_MAX_MEM=4096M
JAVA_MAX_MEM=4096M
let JAVA_MAX_MEM:"4096M"
set JAVA_MAX_MEM="%4 096 000 000%"
set JAVA_MAX_MEM-4096M
.....

Re: Performance falls if OSGI job is deployed

Anonymous — Wed, 04 Oct 2017 10:49:52 GMT

Hello again

i'm still having problem...

this morning time out happened again...but maybe I catch the log error... see attached file

thanks for any possible suggestion.

Muzio

log_error.txt