Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Announcements
QlikView Fans! We’d love to hear from you.
Share your QlikView feedback with the product team… Click here to participate in our 5-minute survey.
Rules, plus terms and conditions, can be found here.
Not applicable

Question: How to do incremental load of QVDs

I have a DB which has many tables in it. Data is inserted, updated and deleted on a daily basis. I have few QVDs setup that pulls data from these tables twice daily. Then there are many QVWs that reads data from these QVDs. My problem is that data pull from DB to QVD (complete load) is taking a long time (about 2 hours now) and its increasing with each day. Is there a way to pull only those records from DB that are inserted, modified and deleted and update the DB incrementally?

Thanks

Tags (1)
1 Solution

Accepted Solutions
dirk_konings
Contributor III

Question: How to do incremental load of QVDs

This could help :

4 Replies
Not applicable

Question: How to do incremental load of QVDs

Correction: I meant "update the QVD (not DB) incrementally" in the last line.

Also, every single record in my DB has record creation and last modified time stamp.

dirk_konings
Contributor III

Question: How to do incremental load of QVDs

This could help :

MVP
MVP

Question: How to do incremental load of QVDs

Nice presentation. For deletes, I haven't found the inner join of existing primary keys back to the table to be particularly slow. Since the primary key is typically sitting on an index, a database management system typically only needs to read that index, which can be MUCH faster than reading the table data itself. It is also reading the ENTIRE index, which a smart DBMS should be able to do in a highly-optimized way.

Not applicable

Question: How to do incremental load of QVDs

Thanks Dirk. I will give this a try and feel that it's going to solve my problem.

Community Browser