Hi, We are trying to connect to Hadoop "PivotalHD 2.0" from Talend 5.5. We can make the connection very well using a standard job components like tHDFSGet or tHDFSList using Kerberos authentication. But we are facing issues using same connection setting when trying with Hadoop Cluster connection in a Map/Reduce job. I see the Kerberos authentication is not enabled for PivotalHD 2.0, is this a limitation or we can get this working. Please suggest. thanks, Rahul GE Aviation
We had the Namenode URI wrong. Default by talend is nn_/_HOST, we used hdfs/_HOST and its working to authenticate normal Standard job connection to HDFS.
I have another issue now where when trying to connect to HDFS from a talend mapreduce job, its using SIMPLE authentication even though we have sepcified Kerberos authentication.
14/10/24 15:22:59 ERROR security.UserGroupInformation: PriviledgedActionException as:<UserName> (authIMPLE) causerg.apache.hadoop.security.AccessControlException: Client cannot authenticate via: Error message is above.
Thanks,
Rahul