Unable to create new entity via S3 Protocol

bzeyben — Tue, 07 Dec 2021 22:35:04 GMT

Hi All,

I am unable to add or create a new entity based on data that is within an AWS S3 bucket.
I was able to register and validate the AWS S3 bucket as a Source connection but when I try to access the folder location on S3, it it throws an error:

Error! Couldn't get the list of subdirectories and files. Please make sure your provided path exists in the specified target.

I am able to connect and validate the S3 location via the AWS console and via Python Boto3 module.

I am tried many different syntax but not sure what needs to be provided in the "File Browser" location.
The documentation doesn't provide any details either.

I am on QDC 4.4.1 release.

Thanks,

Buelent

Re: Unable to create new entity via S3 Protocol

DaveHowland — Tue, 05 May 2020 15:21:39 GMT

The s3 directory browser can sometimes throw errors saying it can't get to a directory, when in fact it's a permission error. Are you certain that the user you're using in the source connection is able to navigate through the different folders of that bucket?

Hope that helps..

David

topic Re: Unable to create new entity via S3 Protocol in Catalog and Lineage

Unable to create new entity via S3 Protocol

Re: Unable to create new entity via S3 Protocol