Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Share your agentic AI experience, learn from others, and earn a new badge: Put Agentic AI to Work
cancel
Showing results for 
Search instead for 
Did you mean: 
aazhdmaster1612007186
Contributor
Contributor

Custom Hadoop cluster connection issue

Hi community,

​

​

I create 3 ec2 instances in AWS to simulate an Hadoop cluster (1 Namenode + 2 Datanodes), I installed and Apache Hadoop 3.2.1 downloaded directly from the official Apache web site. I configured the 3 instances and checked that everything is working fine.

​

​

​

Then I tried to configure my Hadoop cluster in Talend Studio Big Data 7.4 through Metadata -> Create Hadoop cluster, as I'm not using any of distributions proposed by Talend I choosed Custom Unsoported option with these parameters:

​

​

​

​

​

​

​

For the configuration I don't know what I need to set as Hadoop Configuration JAR, I already tried several options:

​

Jar file containing core-site.xml, yarn-site.xml, mapred-site.xml etc that I used for my Hadoop cluster definition in EC2 AWS.

Jar files found in Apache Hadoop libray as:

hadoop-core.jar

hadoop-common.jar

common-configuration.jar

etc

​

​

​

​

But each time, when I check the services I get this error:

​

​

​

Please could you explain me what I need to do to be able to fix this issue and finally be able to connect my Hadoop cluster with my local Talend Big Data Studio?

​

​

​

Thank you in advance.

Labels (2)
1 Reply
aazhdmaster1612007186
Contributor
Contributor
Author

Sorry,

 

There is the attachments related to my question0693p00000BW0gvAAD.png0693p00000BW0gqAAD.png0693p00000BW0glAAD.png