Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Performance on load table from SQL Server

Hi,

I suppose to load all rows from SQLServer table, It's supposed to be ~5 Million Rows.

In the table there are 20 columns, and i need to pull 10 of them.

In a matter only of traffic, and  overload on the system what is the efficient way to load:

Load* or load field1,Field2....

Thanks,

Jacob

13 Replies
tresesco
MVP
MVP

Load

          field1,

          field2,

          ..

          field10

From <> ;

This should be the better option as this loads less number of fields. And if you have doubt about optimized load, let me tell you, this still remains optimized.

maxgro
MVP
MVP

I think is better to limit the sql part to limit the network traffic

table:

sql

select

     field1,

     .....,

     field10

from yoursqltable;

rbecher
MVP
MVP

One should never use SELECT * or LOAD * ...

Astrato.io Head of R&D
Joseph_Musekura
Support
Support

Hi,

You can optimize your loading by

(1)  Loading your data and save them in a QVDs file

(see QlikView reference manual C:\ProgramData\QlikTech\QlikView Documentation\Reference Manual).

(2) Then loading data from the QVDs.

Using QVDs will increase the performance

Regards

rbecher
MVP
MVP

..this doesn't speed up the data load from the database.

Astrato.io Head of R&D
its_anandrjs

If you load fields and data directly from the SQL then you can try some thing like below

1. First opproach

LOAD

    Field1,

    Field2

    ..

    ..

    ..;

SQL SELECT *

FROM Categories;

DROP Fields Field10,Field11.....Field20;

2. Second you can try but comment then like //Field10, // //Field11 and so on and you can try a resident load also and then comment the fields on the load.

rbecher
MVP
MVP

But SELECT * loads the full data set from the database also...

Astrato.io Head of R&D
maxgro
MVP
MVP

this is the reason I suggested to extract only the needeed 10 fields in the sql (database)

table:

sql

select

     field1,

     .....,

     field10

from yoursqltable;

Not applicable
Author

Thanks all for the approaches..

I'll further my question...

If there is where sentence involved: i.e. WHERE year = 2014

is still select the specific fields instead of select* is the way that cost less in terms of DB traffic?