topic Re: CPU usage while running talend project in Installing and Upgrading

CPU usage while running talend project

Pooja_kataria — Sat, 16 Nov 2024 09:24:14 GMT

Hi All,

We are facing issue while running one specific project the cpu usage comes up to 100% and it doesnt comes down until the job completes execution.

Can anyone please let me know the reason behind this and help me with it?

Thanking you in advance.

Re: CPU usage while running talend project

Aukema — Thu, 17 Aug 2017 12:09:34 GMT

This is probably caused by the components in the project.

Can you post a screenshot of the job, so we can help you?

Re: CPU usage while running talend project

Bill_Lane — Fri, 25 Aug 2017 11:02:54 GMT

From our experience, on a windows server, with some jobs I'd suggest that you look in Task Manager and see if it is one of the java processes taking all the CPU. If it is then increase the java memory for the specific job. We found that some 'bounced the limit' and then started to hog CPU but giving them a bit more java memory enabled them to run very quickly and not hog CPU.
We do have a revisit to the jobs on the 'to do' list to see if we can reduce the amount of memory they need but the 'instant' fix is more java memory for the 'problem' jobs.

Re: CPU usage while running talend project

Pooja_kataria — Thu, 31 Aug 2017 09:18:12 GMT

Thanks saukema and Bill_Lane,

Yes this might be the case as we have not tried by increasing the memory .

But the job also hangs to execute Can that be the case for the same?

Re: CPU usage while running talend project

Bill_Lane — Fri, 01 Sep 2017 12:59:37 GMT

Sorry Pooja_kataria I'm not sure what you mean by 'hangs to execute'. I suspect it is a translation issue.

Re: CPU usage while running talend project

Pooja_kataria — Fri, 01 Sep 2017 13:25:22 GMT

Hi Bill_Lane,

I meant sometimes the job while running as standalone job hangs in between and doesnt process further. Due to which the CPU usage goes 100% and also one thing is we have used parallel execution in the job.Let me know if you still confused with my question

Thanks !

Re: CPU usage while running talend project

Bill_Lane — Fri, 01 Sep 2017 13:32:25 GMT

Ah right, when the Java memory is too small we think, that Talend starts paging the memory and seems to tie its self up in doing that while doing very little of the job and using 100% cpu. As I say, for us, in these cases just using the 'JVM Parameters' tab for the job and adding '-Xmx####M', where #### is the amount of memory in mega bites to add, fixes the issue. As far as we can tell this happens for us when the job retrieves a large amount of data and then has to do some other processing with the data. Our DB is on another machine.