Custom Hadoop cluster connection issue

aazhdmaster1612007186 — Sat, 16 Nov 2024 00:43:29 GMT

Hi community,

I create 3 ec2 instances in AWS to simulate an Hadoop cluster (1 Namenode + 2 Datanodes), I installed and Apache Hadoop 3.2.1 downloaded directly from the official Apache web site. I configured the 3 instances and checked that everything is working fine.

Then I tried to configure my Hadoop cluster in Talend Studio Big Data 7.4 through Metadata -> Create Hadoop cluster, as I'm not using any of distributions proposed by Talend I choosed Custom Unsoported option with these parameters:

For the configuration I don't know what I need to set as Hadoop Configuration JAR, I already tried several options:

Jar file containing core-site.xml, yarn-site.xml, mapred-site.xml etc that I used for my Hadoop cluster definition in EC2 AWS.

Jar files found in Apache Hadoop libray as:

hadoop-core.jar

hadoop-common.jar

common-configuration.jar

etc

But each time, when I check the services I get this error:

Please could you explain me what I need to do to be able to fix this issue and finally be able to connect my Hadoop cluster with my local Talend Big Data Studio?

Thank you in advance.

Re: Custom Hadoop cluster connection issue

aazhdmaster1612007186 — Sat, 30 Jan 2021 12:52:02 GMT

Sorry,

There is the attachments related to my question

topic Custom Hadoop cluster connection issue in Installing and Upgrading

Custom Hadoop cluster connection issue

Re: Custom Hadoop cluster connection issue