Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Incremental Load without using Qvd

Hello folks,

how to do incremental load without using qvds?

if i have 4 independent tables need to do increment load what is the simplest way to acheive it?

sorry if my question is foolish....

Thanks in Advance.

Regards,

Venkat.

1 Solution

Accepted Solutions
jagan
Luminary Alumni
Luminary Alumni

Hi Venkat,

You can implement Incremental loading by using CSV or Txt file also.  We need to store previous data somewhere to implement Incremental Loading, for this QVD is the best choice, because the loading is around 100X times faster when compared to Database or other sources.  In QVD we will store the past data and during reload we will get only the latest data from Source and concatenates this to the previous data in QVD.

Hope this explanation helps you.

Regards,

Jagan.

View solution in original post

5 Replies
jonathandienst
Partner - Champion III
Partner - Champion III

Hi

Do you understand what incremental load is? I suggest that you read the QV reference manual - it has a good explanation.

Perhaps you are looking for a partial load. This allows you to add to or replace individual tables in your data model without reloading all the tables. Partial load uses the ADD and REPLACE modifiers on the load statement that will affect the loading when a partial load is requested (from the desktop client, server task option or command line switch).

HTH

Jonathan

Logic will get you from a to b. Imagination will take you everywhere. - A Einstein
Anonymous
Not applicable
Author

Thanks jonathan.....

actually it was my interview question...i told incremental loading using qvd...then he asked me this question...:)

ToniKautto
Employee
Employee

Incremental by definition means that you only load the changed data from your previous load.

QVD is the preferred choice of data storage, as it is an optimized file format for QlikView and Qlik Sense. Technically you could find other file formats to hold the current data, but other formats would decrease performance.

Please remember to mark helpful and correct answers, so that other community members known if more attention is needed to your question.

jagan
Luminary Alumni
Luminary Alumni

Hi Venkat,

You can implement Incremental loading by using CSV or Txt file also.  We need to store previous data somewhere to implement Incremental Loading, for this QVD is the best choice, because the loading is around 100X times faster when compared to Database or other sources.  In QVD we will store the past data and during reload we will get only the latest data from Source and concatenates this to the previous data in QVD.

Hope this explanation helps you.

Regards,

Jagan.

markodonovan
Specialist
Specialist

Hi Venkat,

Depending on the size of the tables it might be worth having a look at the buffer statement if you want something simple:

For example:

buffer (incremental) LOAD * FROM MyLog.log;

This creates a qvd file for you.

Have a look in the qlikview desktop help for more details.

Thanks

Mark

http://www.techstuffybooks.com