Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Talend Open Studio for Big Data 7.0.1 Exception at runtime

Hi Team,

  • I Recently downloaded the Talend Open Studio for Big Data 7.0.1.
  • I am trying to list the HDFS files using component tHDFSList but when I try to execute the job throwing below error.  
    Exception in thread "main" java.lang.NoClassDefFoundError: org/htrace/Trace
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:214)
  • HDFS service connection was successful find the attached screenshot "HDFS_Connection.PNG"
  • htrace dependent libraries are installed find the attached screenshot "tHDFSList_htrace.PNG"
  • Find below full exception details. 
  • Whether any other dependent libraries are missing or any other options in the Talend Open Studion is missing? Please advice me to resolve this issue.
    Environment Details:
    Operating System: Windows server 2016 64 bit
    Java Version: JDK 1.8

Full Error Details:

Starting job Write_HDFS at 13:17 28/03/2019.

[statistics] connecting to socket on port 4041
[statistics] connected
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because UNIX Domain sockets are not available on Windows.
Exception in thread "main" java.lang.NoClassDefFoundError: org/htrace/Trace
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:214)
at com.sun.proxy.$Proxy7.getListing(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy8.getListing(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1969)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1952)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:693)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105)
at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:755)
at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:751)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:751)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1485)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1525)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.tHDFSList_1Process(Write_HDFS.java:382)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.runJobInTOS(Write_HDFS.java:731)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.main(Write_HDFS.java:580)
Caused by: java.lang.ClassNotFoundException: org.htrace.Trace
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 23 more
[statistics] disconnected

Job Write_HDFS ended at 13:17 28/03/2019. [exit code=1]

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please check that the required all external jars are installed for you job to execute?

For more information, please refer to this online installation guide:TalendHelpCenter:Installing external modules.

Best regards

Sabrina