Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Mastering Change Data Capture: Read Now
cancel
Showing results for 
Search instead for 
Did you mean: 
l26b
Contributor III
Contributor III

Incremental Load

Hi, 

 

I have a really complicated query that I am running now in qlik for a long period of time and extracting data and store it into qvd. 

I want to move to incremental load but the script I tried was deleting data from the past 2 days. 

Any idea how to make this work? I can send full extract app in private

Labels (3)
12 Replies
l26b
Contributor III
Contributor III
Author

script is attached

marcus_sommer

Because of the fact that the sql contains heavily nested sub-queries an appropriate incremental control-logic might be placed n times. I suggest to start with an optimizing of the sql - for example by removing the nested queries and simplifying as much as possible.

And maybe you ends with n quite pure raw-data queries to Qlik and applying the wanted transformations there. In each case you need to understand exactly what the sql is doing to be able to apply anything on top of it. 

Kaushik2020
Creator III
Creator III

My suggestion will be to create a stored procedure using the script which you have shared above into a table in SQL. Further use incremental load based on the progress_date column/Data field from the table to describe the QVD generation. this way your load will be quick and you will load only the new records as part of QVD creation. Happy to help you with optimization in SQL as well as Qlik Sense.