Talend Open Studio for Big Data 7.0.1 Exception at runtime

Anonymous — Sat, 16 Nov 2024 06:13:45 GMT

Hi Team,

I Recently downloaded the Talend Open Studio for Big Data 7.0.1.
I am trying to list the HDFS files using component tHDFSList but when I try to execute the job throwing below error.
Exception in thread "main" java.lang.NoClassDefFoundError: org/htrace/Trace
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:214)
HDFS service connection was successful find the attached screenshot "HDFS_Connection.PNG"
htrace dependent libraries are installed find the attached screenshot "tHDFSList_htrace.PNG"
Find below full exception details.
Whether any other dependent libraries are missing or any other options in the Talend Open Studion is missing? Please advice me to resolve this issue.
Environment Details:
Operating System: Windows server 2016 64 bit
Java Version: JDK 1.8

Full Error Details:

Starting job Write_HDFS at 13:17 28/03/2019.

[statistics] connecting to socket on port 4041
[statistics] connected
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because UNIX Domain sockets are not available on Windows.
Exception in thread "main" java.lang.NoClassDefFoundError: org/htrace/Trace
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:214)
at com.sun.proxy.$Proxy7.getListing(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy8.getListing(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1969)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1952)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:693)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105)
at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:755)
at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:751)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:751)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1485)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1525)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.tHDFSList_1Process(Write_HDFS.java:382)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.runJobInTOS(Write_HDFS.java:731)
at test_oracle_hdfs.write_hdfs_0_1.Write_HDFS.main(Write_HDFS.java:580)
Caused by: java.lang.ClassNotFoundException: org.htrace.Trace
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 23 more
[statistics] disconnected

Job Write_HDFS ended at 13:17 28/03/2019. [exit code=1]

Re: Talend Open Studio for Big Data 7.0.1 Exception at runtime

Anonymous — Tue, 02 Apr 2019 08:22:26 GMT

Hello,

Could you please check that the required all external jars are installed for you job to execute?

For more information, please refer to this online installation guide:TalendHelpCenter:Installing external modules.

Best regards

Sabrina

topic Talend Open Studio for Big Data 7.0.1 Exception at runtime in Talend Studio

Talend Open Studio for Big Data 7.0.1 Exception at runtime

Re: Talend Open Studio for Big Data 7.0.1 Exception at runtime