Talend Real Time Big Data

arjunrv88 — Sat, 16 Nov 2024 08:35:35 GMT

Hi, There!

I am trying to build a simple job to consume messages from Rabbit MQ. I have used cAMQP, cMessageFilter and cLog components for this job.

When I try to run the job on a remote job server I get the following error:

Checking ports...

Sending job 'testForRabbitMq' to server (X.X.X.X:8001)...

File transfer completed.

Deploying job 'testForRabbitMq' on server (X.X.X.X:8000)...

Running job 'testForRabbitMq'...
Starting job testForRabbitMq at 13:35 06/03/2018.

IOException parsing XML document from class path resource [META-INF/spring/testforrabbitmq.xml]; nested exception is java.io.FileNotFoundException: class path resource [META-INF/spring/testforrabbitmq.xml] cannot be opened because it does not exist
org.springframework.beans.factory.BeanDefinitionStoreException: IOException parsing XML document from class path resource [META-INF/spring/testforrabbitmq.xml]; nested exception is java.io.FileNotFoundException: class path resource [META-INF/spring/testforrabbitmq.xml] cannot be opened because it does not exist
at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:342)
at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:303)
at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:174)
at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:209)
at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:180)
at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:243)
at org.springframework.context.support.AbstractXmlApplicationContext.loadBeanDefinitions(AbstractXmlApplicationContext.java:127)
at org.springframework.context.support.AbstractXmlApplicationContext.loadBeanDefinitions(AbstractXmlApplicationContext.java:93)
at org.springframework.context.support.AbstractRefreshableApplicationContext.refreshBeanFactory(AbstractRefreshableApplicationContext.java:130)
at org.springframework.context.support.AbstractApplicationContext.obtainFreshBeanFactory(AbstractApplicationContext.java:539)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:451)
at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:139)
at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:83)
at realtime.testforrabbitmq_0_1.testForRabbitMq$1.createContext(testForRabbitMq.java:86)
at org.apache.camel.main.Main.getCamelContextMap(Main.java:149)
at org.apache.camel.main.MainSupport.postProcessContext(MainSupport.java:433)
at org.apache.camel.main.Main.doStart(Main.java:125)
at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
at org.apache.camel.main.MainSupport.run(MainSupport.java:138)
at realtime.testforrabbitmq_0_1.testForRabbitMq.run(testForRabbitMq.java:134)
at realtime.testforrabbitmq_0_1.testForRabbitMq.runJobInTOS(testForRabbitMq.java:201)
at realtime.testforrabbitmq_0_1.testForRabbitMq.main(testForRabbitMq.java:170)
Caused by: java.io.FileNotFoundException: class path resource [META-INF/spring/testforrabbitmq.xml] cannot be opened because it does not exist
at org.springframework.core.io.ClassPathResource.getInputStream(ClassPathResource.java:171)
at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:329)
... 21 more
Job testForRabbitMq ended at 13:36 06/03/2018. [exit code=1]

I am using Talend Big Data Platform - Enterprise Version 6.4.1.20170623_1246

Can anyone let me know, what needs to be done to rectify this issue.

Re: Talend Real Time Big Data

Jesperrekuh — Tue, 06 Mar 2018 21:36:40 GMT

* its case sensitive
* make sure your (class) paths are set correctly

class path resource [META-INF/spring/testforrabbitmq.xml] cannot be opened because it does not exist

I guess something similar found at : Stackoverflow

Re: Talend Real Time Big Data

arjunrv88 — Tue, 06 Mar 2018 21:44:21 GMT

Could you please tell me where I should mention this classpath information? I am not sure if I know the correct path.

Re: Talend Real Time Big Data

Jesperrekuh — Tue, 06 Mar 2018 22:09:58 GMT

Im not quite familar with your specific case... so cant tell exactly.
Looks like something is wrong while packaging your job.

The point is that META-INF should be considered an internal Java meta directory.

Any files you want to include with your JAR should be placed in some other sub-directory or at the root of the JAR itself.
So when the job is packaged to run at your remote-server it should contain this XML file and its within this specific jar file.

By the way .jar files can be opened by 7zip or tar ...

Support from Talend is necessary...
Maybe this thread related... https://community.talend.com/t5/Design-and-Development/tESBConsumer-does-not-log-to-SAM-missing-agent-context-xml/td-p/184726

Cant help any further, sorry.

topic Re: Talend Real Time Big Data in Talend Studio

Talend Real Time Big Data

Re: Talend Real Time Big Data

Re: Talend Real Time Big Data

Re: Talend Real Time Big Data