Qlik Community

QlikView App Development

Discussion Board for collaboration related to QlikView App Development.

Announcements
BARC’s The BI Survey 19 makes it official. BI users love Qlik. GET REPORT
Highlighted
kkkumar82
Valued Contributor III

Is it possible to do incremental load without qvds

All,

Just curious to know , is it possible to perform incremental load by directly connecting to the database with  out qvds.

Regards

Kiran Kumar

Tags (1)
1 Solution

Accepted Solutions
MVP & Luminary
MVP & Luminary

Re: Is it possible to do incremental load without qvds

Hi,

It is not possible to implement incremental loading without any temporary file QVD/CSV/Excel.  You have to store the data somewhere and use it to add the new data to the existing data.

Regards,

jagan.

View solution in original post

6 Replies
Chanty4u
Esteemed Contributor III

Re: Is it possible to do incremental load without qvds

balrajahlawat
Esteemed Contributor

Re: Is it possible to do incremental load without qvds

It is mentioned here, did you check this?

Incremental Load without using Qvd

kkkumar82
Valued Contributor III

Re: Is it possible to do incremental load without qvds

All,

I have gone through some of the posts suggested, so what I understood is , it is necessary to store the data in any format like csv, txt or qvd and from that we have to perform increment load.

So finally without having any of the storage directly connecting to a data base we cannot perform incremental loading in Qlikview.

Please correct me if I am wrong.

Thanks

Kiran Kumar

MVP & Luminary
MVP & Luminary

Re: Is it possible to do incremental load without qvds

Hi,

It is not possible to implement incremental loading without any temporary file QVD/CSV/Excel.  You have to store the data somewhere and use it to add the new data to the existing data.

Regards,

jagan.

View solution in original post

MVP
MVP

Re: Is it possible to do incremental load without qvds

I don't really understand your points above.

The purpose of incremental loading is to avoid loading the same data from the source (database or files) over and over, but to store that data in a local file. This is useful if the source file or table is extremely large, or there are access restrictions (eg no expensive reads from a production database during working hours).

You can use any data storage format. But QVDs have some important benefits:

  • They are compact - although not compressed, QVD's store the data in a very concise format, so the files are smaller (compared to CSVs).
  • They can be written quickly.
  • They can be read extremely quickly - eaily 10x faster than reading from a CSV.
  • They maintain the data types, including dual values. So there are less issues with dates and other complex formats.

Hope that helps clarify the matter.

Logic will get you from a to b. Imagination will take you everywhere. - A Einstein
kkkumar82
Valued Contributor III

Re: Is it possible to do incremental load without qvds

Hi Jonathan,

The point is we were thinking is there a way that we can do incremental loading in Qlikview without qvds, I mean can we do incremental loading directly connecting to database( in our case).

As per jagan it is not possible.

I think I am clear this time.

Thanks

Kiran Kumar