Skip to main content
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Showing results for 
Search instead for 
Did you mean: 
darwinex1
Contributor II
Contributor II

Amazon S3 Native Connector Performance

Hello,
I am testing the Amazon S3 connector included in the November 2022 Patch version of Qlik Sense Enterprise on Windows 

I notice that its performance is much lower than Qlik WebConnector. With Qlik Web Connectors  the execution takes 20 minutes and with the native connector the execution time is 1.5 hours

Any idea how to improve the times?

Labels (3)
4 Replies
Jay_Brown
Support
Support

Hello @darwinex1 , performance should be similar.  Is Qlik Web Connectors installed on the same server as Qlik Sense Enterprise?  Meaning are both tests from the same server?

Also, what type of execution are you performing, List, GetRawObject, Upload, etc.?

To help users find verified answers, please don't forget to mark a correct resolution or answer to your problem or question as correct.
darwinex1
Contributor II
Contributor II
Author

Hello @Jay_Brown,

The Qlik Sense Enterprise and Qlik Web Connectors  are in the same server.

We have performed a new test. We have read 1036 xlsx files. These files have a size of 15KB. We obtain the list of files with a List operation and then execute a FOR loop to read each file. 

Qlik WebConnector takes 54 seconds however Amazon S3 takes 14 minutes.I attach screenshots with the result of each execution.

The code is the same except "FROM" sentence

Qlik WebConnector

LOAD *
FROM [$(vQwcConnectionName)] //URL to Qlik Web connector
(URL IS [$(fURL($(encoded_s3_filename)))],ooxml, no labels, header is 4 lines) //file name
 where not IsNull(G);

Amazon s3 Connector:

LOAD *

FROM [$(swapsLibConnection)/$(s3_filename)]  //Lib connection name + file name
(ooxml, no labels, header is 4 lines)
where not IsNull(G);

Jay_Brown
Support
Support

Hello @darwinex1 , What version of Qlik Web Connectors are you currently testing against and have you tried another version?

To help users find verified answers, please don't forget to mark a correct resolution or answer to your problem or question as correct.
darwinex1
Contributor II
Contributor II
Author

Hi @Jay_Brown ,

Qlik WebConnector funciona correctamente (versión June-2022 (2.130.0.26720)).

Tenemos problemas con el conector nativo Amazon S3 de Qlik Sense Enterprise.

Actualmente, nuestra versión de Qlik Sense Enterprise es Noviembre 2022 Parche 2.

 

Thank you.

Community Browser