topic Re: Amazon S3 Native Connector Performance in Connectivity & Data Prep

Amazon S3 Native Connector Performance

darwinex1 — Tue, 13 Dec 2022 06:45:21 GMT

Hello,
I am testing the Amazon S3 connector included in the November 2022 Patch version of

I notice that its performance is much lower than Qlik WebConnector. With the execution takes 20 minutes and with the native connector the execution time is 1.5 hours

Any idea how to improve the times?

Re: Amazon S3 Native Connector Performance

Jay_Brown — Mon, 23 Jan 2023 16:16:56 GMT

Hello @darwinex1 , performance should be similar. Is Qlik Web Connectors installed on the same server as Qlik Sense Enterprise? Meaning are both tests from the same server?

Also, what type of execution are you performing, List, GetRawObject, Upload, etc.?

Re: Amazon S3 Native Connector Performance

darwinex1 — Thu, 26 Jan 2023 08:41:46 GMT

Hello @Jay_Brown,

The Qlik Sense Enterprise and Qlik Web Connectors are in the same server.

We have performed a new test. We have read 1036 xlsx files. These files have a size of 15KB. We obtain the list of files with a List operation and then execute a FOR loop to read each file.

Qlik WebConnector takes 54 seconds however Amazon S3 takes 14 minutes.I attach screenshots with the result of each execution.

The code is the same except "FROM" sentence

Qlik WebConnector

LOAD *
FROM [$(vQwcConnectionName)] //URL to Qlik Web connector
(URL IS [$(fURL($(encoded_s3_filename)))],ooxml, no labels, header is 4 lines) //file name
where not IsNull(G);

Amazon s3 Connector:

LOAD *

FROM [$(swapsLibConnection)/$(s3_filename)] //Lib connection name + file name
(ooxml, no labels, header is 4 lines)
where not IsNull(G);

Re: Amazon S3 Native Connector Performance

Jay_Brown — Tue, 31 Jan 2023 21:14:50 GMT

Hello @darwinex1 , What version of Qlik Web Connectors are you currently testing against and have you tried another version?

Re: Amazon S3 Native Connector Performance

darwinex1 — Wed, 01 Feb 2023 12:24:58 GMT

Hi @Jay_Brown ,

Qlik WebConnector funciona correctamente (versión June-2022 (2.130.0.26720)).

Tenemos problemas con el conector nativo Amazon S3 de Qlik Sense Enterprise.

Actualmente, nuestra versión de Qlik Sense Enterprise es Noviembre 2022 Parche 2.

Thank you.