Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Please, I´m trying to use the component tHDFSInput after import 2 libraries:
azure-data-lake-store-sdk-2.3.6.jar
hadoop-azure-datalake-3.2.0.jar
And I´m following the steps described here: https://help.talend.com/reader/Sm466hmdh~Y~2GehtIo6xw/6tEZDas0IOzvyMUDEfx0HQ
I´m using Talend Open Studio Big Data version TOS_BD-20170623_1246-V6.4.1.
I´m receiving an error describing that the method "reloadExistingConfigurations" does not exist.
But, by documentation of library hadoop-azure-datalake-3.2.0.jar, there is the method reloadExistingConfigurations().
Please, someone could help to configure the libraries correctly?
Error:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.reloadExistingConfigurations()V
at org.apache.hadoop.fs.adl.AdlConfKeys.addDeprecatedKeys(AdlConfKeys.java:127)
at org.apache.hadoop.fs.adl.AdlFileSystem.<clinit>(AdlFileSystem.java:98)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Unknown Source)
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2134)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2099)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2702)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2715)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2751)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2733)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:377)
[statistics] disconnected
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:166)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
at local_project.connection_azure_0_1.connection_azure.tHDFSInput_1Process(connection_azure.java:824)
at local_project.connection_azure_0_1.connection_azure.runJobInTOS(connection_azure.java:1256)
at local_project.connection_azure_0_1.connection_azure.main(connection_azure.java:1093)
Job connection_azure ended at 15:06 22/08/2019. [exit code=1]
Hello,
We have replied to your another topic:https://community.talend.com/t5/Design-and-Development/tHDFSInput-error-NoSuchMethodError-org-apache....
Could you please stick to one topic so that we could pay individule attention to it.
Best regards
Sabrina