tHDFSFileExist Failing with org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/hadoop/tracing/SpanReceiverHost;

Anonymous — Wed, 06 Sep 2017 19:14:01 GMT

Hi All - I am facing the below error while connecting to Hadoop using tHDFSFileExist. This issue is occurring only when we use context variables, I tried hard coding the Hadoop parms in tHDFSFileExist its working fine though. Is there a specific reason why it's facing wen we use context vars ???

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/StringLorg/apache/hadoop/tracing/SpanReceiverHost;

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)

at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)

at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)

at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)

at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)

at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:159)

at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:156)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:156)

Please help me with this ?

Re: tHDFSFileExist Failing with org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/hadoop/tracing/SpanReceiverHost;

Anonymous — Wed, 13 Sep 2017 08:09:17 GMT

Hello
Which filed do you use context variable? I would suggest you to print the value of context variable before you use it to check if the value is the identical.

Regards
Shong

topic Re: tHDFSFileExist Failing with org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/hadoop/tracing/SpanReceiverHost; in Data Quality

tHDFSFileExist Failing with org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/hadoop/tracing/SpanReceiverHost;

Re: tHDFSFileExist Failing with org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Lorg/apache/hadoop/tracing/SpanReceiverHost;