java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V

Anonymous — Sat, 16 Nov 2024 04:52:53 GMT

Please, I´m trying to use the component tHDFSInput after import 2 libraries:

azure-data-lake-store-sdk-2.3.6.jar

hadoop-azure-datalake-3.2.0.jar

And I´m following the steps described here: https://help.talend.com/reader/Sm466hmdh~Y~2GehtIo6xw/6tEZDas0IOzvyMUDEfx0HQ

I´m using Talend Open Studio Big Data version TOS_BD-20170623_1246-V6.4.1.

I´m receiving an error describing that the method "reloadExistingConfigurations" does not exist.

But, by documentation of library hadoop-azure-datalake-3.2.0.jar, there is the method reloadExistingConfigurations().

Please, someone could help to configure the libraries correctly?

Error:

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V
at org.apache.hadoop.fs.adl.AdlConfKeys.addDeprecatedKeys(AdlConfKeys.java:127)
at org.apache.hadoop.fs.adl.AdlFileSystem.<clinit>(AdlFileSystem.java:98)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2134)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2099)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2702)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2715)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2751)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2733)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:377)
[statistics] disconnected
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:166)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
at local_project.connection_azure_0_1.connection_azure.tHDFSInput_1Process(connection_azure.java:824)
at local_project.connection_azure_0_1.connection_azure.runJobInTOS(connection_azure.java:1256)
at local_project.connection_azure_0_1.connection_azure.main(connection_azure.java:1093)
Job connection_azure ended at 15:06 22/08/2019. [exit code=1]

Re: java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V

Anonymous — Wed, 28 Aug 2019 08:16:03 GMT

Hello,

We have replied to your another topic:https://community.talend.com/t5/Design-and-Development/tHDFSInput-error-NoSuchMethodError-org-apache-hadoop-conf/m-p/200366/highlight/false#M109482.

Could you please stick to one topic so that we could pay individule attention to it.

Best regards

Sabrina

topic java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V in Talend Studio

java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V

Re: java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V