Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

What is the use/purpose of un-optimized load and Binary Load

Hi All,

Need details on un-optimized load and Binary Load.

On community i found technichal issue for both these and unable to get what are un-optimized load and Binary Load and what is usefulness of these.

Pls explain for better understanding.

Thanks

1 Solution

Accepted Solutions
magavi_framsteg
Partner - Creator III
Partner - Creator III

Hi mansi.

When you load data from QVD:s you preferably do it optimized.

To do an optimized load, simply load the individual fields, or * without doing any operations or conditions.

This is the prefered way of loading data.

However, you cannot always do it since you need to do operations, for example date, num, count, where, exists et cetera. As soon as you do only one of these operations, you break the optimized load and the load is unoptimized.

Optimized load just means to transfer data from the QVD directly into RAM, hence it is optimized. It never needs to look at the data, it just transfers data into RAM.

If you instead do an operation, like date or num, the load needs do do the operation on each row inside the QVD before it is loaded into RAM.

Binary loads are even quicker than loading from QVD because it loads the whole QVW-file as a whole and copies the whole data model into RAM in one go. So if binary load can be used, it is very efficient.

I hope this will kick you in the right direction.

Cheers!

VeryOptimized:

BINARY MyFile.qvw;

Optimized:

LOAD

     Field1

     ,Field2

;

Optimized:

LOAD *;

UnOptimized:

LOAD

     num(Field1) as Field1

     Field2

;

UnOptimized:

LOAD

     Field1

     ,Field2

WHERE Field1 > 0

;

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.

View solution in original post

3 Replies
magavi_framsteg
Partner - Creator III
Partner - Creator III

Hi mansi.

When you load data from QVD:s you preferably do it optimized.

To do an optimized load, simply load the individual fields, or * without doing any operations or conditions.

This is the prefered way of loading data.

However, you cannot always do it since you need to do operations, for example date, num, count, where, exists et cetera. As soon as you do only one of these operations, you break the optimized load and the load is unoptimized.

Optimized load just means to transfer data from the QVD directly into RAM, hence it is optimized. It never needs to look at the data, it just transfers data into RAM.

If you instead do an operation, like date or num, the load needs do do the operation on each row inside the QVD before it is loaded into RAM.

Binary loads are even quicker than loading from QVD because it loads the whole QVW-file as a whole and copies the whole data model into RAM in one go. So if binary load can be used, it is very efficient.

I hope this will kick you in the right direction.

Cheers!

VeryOptimized:

BINARY MyFile.qvw;

Optimized:

LOAD

     Field1

     ,Field2

;

Optimized:

LOAD *;

UnOptimized:

LOAD

     num(Field1) as Field1

     Field2

;

UnOptimized:

LOAD

     Field1

     ,Field2

WHERE Field1 > 0

;

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.

Not applicable
Author

Thank you so much Magnus Åvitsland for timely Reply.

Thanks

magavi_framsteg
Partner - Creator III
Partner - Creator III

No problemo.

And please mark your question as solved, for other users to take benefit from it.

Cheers!

Kind regards

Magnus Åvitsland

BI Consultant

Framsteg Business Intelligence Corp.