topic Connecting to S3 using Web Connectors in App Development

Connecting to S3 using Web Connectors

Ericga — Wed, 21 Apr 2021 21:50:16 GMT

I am attempting to extract data from a csv file stored in an Amazon S3 bucket utilizing the Qlik Amazon S3 Web Connector. i can connect successfully with the Web Connectors dashboard. And I can do a GetRawObjectAsText and in the Data Preview pane and I see the data as expected. Comma separated Header on first row and the comma separated data on the rows after that.

The issue comes when i try to use the connection in the Qlik Sense script. When I run the script below, it returns an error "There were no fields to load in the given source". I can change LOAD * to LOAD <FieldName> and it gives the error "Field <FieldName> Not Found".

Why won't "LOAD *" return any data? is there another syntax i should be using to load data with?

Thanks

let vQwcConnectionName = 'lib://WebConnectors';
AmazonS3Connector_GetRawObjectAsText:
LOAD
*
FROM [$(vQwcConnectionName)]
(URL IS [http://MYSERVERNAME:5555/data?connectorID=AmazonS3Connector&table=GetRawObjectAsText&accessKey=sta_gen_1%3a2CUOdHj20j5uMLPK0bSZ3Q%3d%3d%3aDJcC47nVGnN1yBT%2b%2ffch%2b%2f0rxDGtC4UQWCsalMYFxXs%3d&secretKey=sta_gen_1%3aGxssUVLcNOVden2wqB2U3A%3d%3d%3aIWeNTcBbAIyymDKMdUb5COyegrR3DLOuIVUo4LiGF0RUvtfret9viZLCKT8t3P1&region=us-east-1&bucketName=theS3Bucketnamehere&objectKey=KeyName%2fFILENAME.csv&appID=], qvx);

Re: Connecting to S3 using Web Connectors

Ranganath_DR — Thu, 22 Apr 2021 06:33:12 GMT

Hi,

Refer to below link and check if everything correctly is correctly set.

https://help.qlik.com/en-US/connectors/Subsystems/Web_Storage_Provider_Connectors_help/Content/Connectors_StorageProvider/Storage%20provider%20connectors/Amazon-S3-storage-provider-connector.htm

Regards,

Ranga

Re: Connecting to S3 using Web Connectors

Ericga — Thu, 22 Apr 2021 14:12:55 GMT

Ranga,

the link you sent helped me solve the issue. i thought what it was showing only applied to saas but that is not the case. in my example above based on another post i created my connection with only the first portion of the url which is http://MYSERVERNAME:5555 instead of the whole url. When i created the web connection with the full URL and did a Select data it created the script i needed.

Thanks