Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
kkkumar82
Specialist III
Specialist III

Is it possible to do incremental load without qvds

All,

Just curious to know , is it possible to perform incremental load by directly connecting to the database with  out qvds.

Regards

Kiran Kumar

1 Solution

Accepted Solutions
jagan
Luminary Alumni
Luminary Alumni

Hi,

It is not possible to implement incremental loading without any temporary file QVD/CSV/Excel.  You have to store the data somewhere and use it to add the new data to the existing data.

Regards,

jagan.

View solution in original post

6 Replies
Anonymous
Not applicable

It is mentioned here, did you check this?

Incremental Load without using Qvd

kkkumar82
Specialist III
Specialist III
Author

All,

I have gone through some of the posts suggested, so what I understood is , it is necessary to store the data in any format like csv, txt or qvd and from that we have to perform increment load.

So finally without having any of the storage directly connecting to a data base we cannot perform incremental loading in Qlikview.

Please correct me if I am wrong.

Thanks

Kiran Kumar

jagan
Luminary Alumni
Luminary Alumni

Hi,

It is not possible to implement incremental loading without any temporary file QVD/CSV/Excel.  You have to store the data somewhere and use it to add the new data to the existing data.

Regards,

jagan.

jonathandienst
Partner - Champion III
Partner - Champion III

I don't really understand your points above.

The purpose of incremental loading is to avoid loading the same data from the source (database or files) over and over, but to store that data in a local file. This is useful if the source file or table is extremely large, or there are access restrictions (eg no expensive reads from a production database during working hours).

You can use any data storage format. But QVDs have some important benefits:

  • They are compact - although not compressed, QVD's store the data in a very concise format, so the files are smaller (compared to CSVs).
  • They can be written quickly.
  • They can be read extremely quickly - eaily 10x faster than reading from a CSV.
  • They maintain the data types, including dual values. So there are less issues with dates and other complex formats.

Hope that helps clarify the matter.

Logic will get you from a to b. Imagination will take you everywhere. - A Einstein
kkkumar82
Specialist III
Specialist III
Author

Hi Jonathan,

The point is we were thinking is there a way that we can do incremental loading in Qlikview without qvds, I mean can we do incremental loading directly connecting to database( in our case).

As per jagan it is not possible.

I think I am clear this time.

Thanks

Kiran Kumar