Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Talend Cloud AWS EU Scheduled Outage: Starting Tues 26 May 21:00 CEST with expected completion Wed 27 May 01:00 CEST
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] Proxy support for Hadoop connections?

It appears that Hadoop components don't support any proxy interaction.  There's no specific configuration for it anywhere within the components themselves, the Preferences -> General -> Network Connections doesn't affect the job or the metadata Hadoop Cluster configuration, and tSetProxy doesn't affect it either.
Is there another route?  This makes using AWS EMR very difficult. 
Labels (3)
1 Solution

Accepted Solutions
Anonymous
Not applicable
Author

I'm just a dummy, I found that if you set it via hadoop properties it works.
I used these properties:

hadoop.socks.server=SOCKS_PROXY_IP:8080
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.SocksSocketFactory

View solution in original post

1 Reply
Anonymous
Not applicable
Author

I'm just a dummy, I found that if you set it via hadoop properties it works.
I used these properties:

hadoop.socks.server=SOCKS_PROXY_IP:8080
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.SocksSocketFactory