Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Connect 2026! Turn data into bold moves, April 13 -15: Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Executing Talend Job from linux machine which can connect to HDFS

Hi
I am using Hadoop Open Studio for Big Data tool for developing my ETL program in Windows machine. And I set 
-Dhadoop.home.dir=C:/tmp/webutils for all big data related components. After developing the job, I am placing this job (as jar file) in another Linux machine. But when executing that jar file(talend job), we are facing below issues
Exception in component tHDFSInput_1
java.nio.channels.UnresolvedAddressException
        at sun.nio.ch.Net.checkAddress(Net.java:101)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
        at org.apache.hadoop.hdfs.DFSClient.newConnectedPeer(DFSClient.java:3106)

how can I execute the talend job from linux machine which can connect to another hadoop box and perform the job.
Thanks a lot in advance.

Prakash

Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hi,
Have you tried to build jobs as a standalone job(.sh file/ .bat file) if you want to reuse the Job in Talend Studio installed on another machine?
Please have a look at document about:TalendHelpCenter:How to build Jobs.
Best regards
Sabrina