topic Re: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file in Talend Studio

java.io.IOException: No KeyProvider is configured, cannot access an encrypted file

Anonymous — Sat, 16 Nov 2024 09:52:12 GMT

I am running a Talend job to read and write data from HDFS encryption zone with the help of Ranger KMS. Though the Talend job is not able to read and write the files out the HDFS encryption zone. Getting the below error for the same:

Exception in component tHDFSInput_1
java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(DFSClient.java:1382)
at org.apache.hadoop.hdfs.DFSClient.createWrappedInputStream(DFSClient.java:1461)
at org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:332)
at org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:326)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:326)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:782)

Please help if anyone has faced the same issue.

Re: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file

Anonymous — Wed, 26 Apr 2017 09:03:33 GMT

Hi,

Which talend build version are you using? Can you successfully connect to your HDFS Encryption zone through talend tool without missing libraries issue?

Best regards

Sabrina

Re: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file

Anonymous — Wed, 26 Apr 2017 09:33:04 GMT

Hi,

Yes I am able to write data to the encryption zone. I am unable to read it and copy the HDFS file outside the zone. The version of Talend is Talend Open Studio for Big Data 6.3.1. Please let me know how to go about this.

Thank you.

Preeti

Re: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file

Anonymous — Thu, 01 Jun 2017 17:00:00 GMT

@ppadelkar can you provide the screeshot of the job that you are building? @xdshi do we need to decrypt the folder via talend before we can access the files?