Could not connect Talend 7.1.1 to Apache Hadoop 2.7.5 distribution
Hi All,
I have installed Apache Hadoop distribution 2.7.5 in windows 10 and started all the services. I am using Talend Big data version 7.1.1 in the same machine. When tried to create hadoop cluster connection in Talend, I could not see Apache Hadoop distribution, so I had to select custom Unsupported distribution and entered all the details but still could not able to connect and got the below error. Can you please help me with this. Also under Custom authentication, I have username, kerberos and usergroup. Only when I select Kerberos, Check services is getting enabled. Can you please let me know the reason for this too.
Error:
-------
org.talend.designer.hdfsbrowse.exceptions.HadoopServerException: org.talend.designer.hdfsbrowse.exceptions.HadoopServerException: java.util.concurrent.ExecutionException: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration cannot be found by org.talend.core.runtime_7.1.1.20181026_1147 at org.talend.designer.hdfsbrowse.hadoop.service.check.AbstractCheckedServiceProvider.checkService(AbstractCheckedServiceProvider.java:57) at org.talend.designer.hdfsbrowse.hadoop.service.HadoopServiceBean.check(HadoopServiceBean.java:102) at org.talend.designer.hdfsbrowse.hadoop.service.check.CheckHadoopServicesDialog$5.run(CheckHadoopServicesDialog.java:373) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.talend.designer.hdfsbrowse.exceptions.HadoopServerException: java.util.concurrent.ExecutionException: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration cannot be found by org.talend.core.runtime_7.1.1.20181026_1147 at org.talend.designer.hdfsbrowse.hadoop.service.check.CheckedWorkUnit.execute(CheckedWorkUnit.java:47) at org.talend.designer.hdfsbrowse.hadoop.service.check.AbstractCheckedServiceProvider.checkService(AbstractCheckedServiceProvider.java:54) ... 5 more Caused by: java.util.concurrent.ExecutionException: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration cannot be found by org.talend.core.runtime_7.1.1.20181026_1147 at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:206) at org.talend.designer.hdfsbrowse.hadoop.service.check.CheckedWorkUnit.execute(CheckedWorkUnit.java:44) ... 6 more Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration cannot be found by org.talend.core.runtime_7.1.1.20181026_1147 at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:439) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:352) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:344) at org.eclipse.osgi.internal.loader.ModuleClassLoader.loadClass(ModuleClassLoader.java:160) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.talend.designer.hdfsbrowse.hadoop.service.check.provider.CheckedNamenodeProvider.check(CheckedNamenodeProvider.java:35) at org.talend.designer.hdfsbrowse.hadoop.service.check.AbstractCheckedServiceProvider$1.run(AbstractCheckedServiceProvider.java:49) at org.talend.designer.hdfsbrowse.hadoop.service.check.CheckedWorkUnit$1.call(CheckedWorkUnit.java:65) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more
