Remote engine : metrics collector

[yroffin]

hi,

i've some service deployed threw TMC and i don't succeed to solve metrics configuration

ESB metrics collector seem to cannot connect to my service to get metrics

is somebody have this issue on remote engine ?

2024-04-22T13:33:40,641 | WARN | pool-18-thread-1 | MetricsCollectorImpl | 314 - org.talend.ipaas.engine.dsrunner.dataservice-runner-metrics-collector - 2.13.0 | | [ESB] Metrics failed / object: {"taskExecutionId":"52152f06-1671-4fc4-96e2-5011eeb110dd","flowId":"66210eaa06a79417a0d672f9","artifactId":"xxxx","artifactType":"MICROSERVICE","jobType":"data_service","serviceType":"REST","httpPort":5079,"metricPath":"xxxx"}
org.jolokia.client.exception.J4pRemoteException: Error: Unauthorized
at org.jolokia.client.request.ValidatingResponseExtractor.extract(ValidatingResponseExtractor.java:67) ~[?:?]
at org.jolokia.client.J4pClient.execute(J4pClient.java:195) ~[?:?]
at org.jolokia.client.J4pClient.execute(J4pClient.java:168) ~[?:?]
at org.jolokia.client.J4pClient.execute(J4pClient.java:117) ~[?:?]
at org.talend.ipaas.rt.microservice.client.MicroserviceClientImpl.requestCXFObjectName(MicroserviceClientImpl.java:262) ~[?:?]
at org.talend.ipaas.rt.microservice.client.MicroserviceClientImpl.getCXFMetrics(MicroserviceClientImpl.java:88) ~[?:?]
at Proxy1692bda3_0fd9_431d_9afc_6e70917cdc1e.getCXFMetrics(Unknown Source) ~[?:?]
at org.talend.ipaas.rt.dsrunner.mc.MetricsCollectorImpl.lambda$collectMetrics$0(MetricsCollectorImpl.java:80) ~[?:?]
at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4706) ~[?:?]
at org.talend.ipaas.rt.dsrunner.mc.MetricsCollectorImpl.collectMetrics(MetricsCollectorImpl.java:55) ~[?:?]
at org.talend.ipaas.rt.dsrunner.mc.MetricsCollectorImpl.lambda$init$1(MetricsCollectorImpl.java:130) ~[?:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) [?:?]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) [?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
at java.lang.Thread.run(Thread.java:840) [?:?]

[w_nascimento]

Any updates on this error?

[Mohammed_Messaoudi · Accepted solution]

Hello,

Here it the error I'm seeing from the logs you shared with us: org.jolokia.client.exception.J4pRemoteException: Error: Unauthorized
This looks like a metrics authentication/configuration issue. 

For remote engine versions earlier than 2.12.4, you must configure Jolokia in etc/org.talend.ipaas.rt.dsrunner.metrics.collector.cfg to enable the engine to access the Jolokia endpoint for metrics collection.
​

The config should include the Jolokia URL:

ms.metric.collection.jolokia.url=https://localhost:{ms.port}/jolokia

ms.metric.collection.jolokia.username=${MS_SECURITY_USER_NAME:#{null}}

ms.metric.collection.jolokia.password=${MS_SECURITY_USER_PASSWORD:#{null}}

Please refer to the following documentation where we outlined this: https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/setting-up-jolokia

[w_nascimento · Accepted solution]

This configuration worked for me following. Thank you @Mohammed_Messaoudi !