Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] Oozie cannot upload jar files to HDFS.

Hi,
I have a job which puts (using thdfsoutput) some data to a remote server hdfs. The job works correctly using the standard "Run" tab. No connection problems. When I run the job using oozie I receive the error:

The local file can not upload to Hadoop HDFS!

Unable to upload file C:\...\TOS_BD-20161026_1219-V6.3.0\temp\Twitter\lib\hadoop-hdfs-2.7.1.2.4.0.0-169.jar to path/to/hdfs
What I see in the hdfs directory where the job is being deployed is a bunch of 0-byte jar files...
Any idea of what can be the reason? locally I use jre 1.8, the server OS is running jre 1.7, can this be the problem?
(more info: I can successfully put this jar file to hdfs via Hue.)
Thank you!
Labels (2)
1 Solution

Accepted Solutions
Anonymous
Not applicable
Author

Hi Sabrina,
I resolved the problem. I had a wrong IP address in my hosts file. Thank you for your quick responses.
How can I mark this post as resolved?
Thanks!!!
Pau

View solution in original post

5 Replies
Anonymous
Not applicable
Author

Hi,
Big Data Distributions are compatible with Java 1.8 used. Here is the document about:TalendHelpCenter:Java
Could you please try to use JDK 1.8 to see if it works?
Best regards
Sabrina
Anonymous
Not applicable
Author

errorlog.txt
Hi Sabrina,
thank you very much for the answer. After some pain I resolved the java version and now jdk1.8 are installed in all the nodes.
Unfortunately I continue with the same error when I try to run the job from the oozie view. Any idea?
Something I should have done earlier is to click the "check services" button from the edit cluster metadata prompt. Namenode is OK but Resource Manager fails. Hostnames and ports are coherent with the cluster configuration. Does anyone have an idea of what can be causing this error? I attach the error in txt file. It seems to be this error: , but I kerberos security is not enabled in the cluster and I have not ticked this checkbox mentioned in the link.
Please help! Thanks!
errorlog.txt
Anonymous
Not applicable
Author

Hi,
Did you use IP address? Could you please show us your job setting screenshots?(blur your sensitive data)
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi Sabrina,
I resolved the problem. I had a wrong IP address in my hosts file. Thank you for your quick responses.
How can I mark this post as resolved?
Thanks!!!
Pau
Anonymous
Not applicable
Author

Hi,
Great this issue has been fixed. You can click the "Set this topic as resolved" link which is right underneath your initial post to mark this topic as resolved.
Best regards
Sabrina