Skip to main content

Qlik

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2015-09-01 04:06 AM

HDFS HA in tHDFS components

Hi everyone,
I'm using a Hadoop cluster with a HDFS in HA mode set up.
How could I set up the tHDFS*components to always point to the active namenode ?
I saw this page https://help.talend.com/search/all?query=Enabling+the+HDFS+High+Availability+feature+in+the+Studio&c... but it describes how to configure the tHive components and it doesn't seem to work with tHDFS components. What am I missing? Do I need to change any configuration in the metadata of my Hadoop cluster in the Studio ?
Thank you.
Orlando
Labels (2)
Labels
72 Views
0 Likes
2 Replies
Anonymous
Not applicable
‎2015-09-23 01:00 PM
Author

Hi,
The solution is the same than Hive but for the Namenode URI, you should define "hdfs://nameservice1".
Can you please let us know if that fixes the issue ?
Cheers,
Rémy.
72 Views
0 Likes
Anonymous
Not applicable
‎2015-09-24 04:07 AM
Author

Hi Rémy,
You're right. The solution is the same than Hive.
Actually, I found out that my problem was coming from my Oozie configuration. I got an error saying that Hostname "nameservice1" was not found the while deploying to Oozie. 
I had to add the parameters (dfs.nameservice, ...) in the hadoop properties of the cluster in the metadata.
This solution is working with the new Talend Big Data 6.0.
Thanks for your help.
Regards,
Orlando
72 Views
0 Likes