Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

update method from SQL to QVD

hi all,

how we can use the update method for incremental procedure ? Please let me know with some example.

Consider my data is fetching into SQL daily bases. Now in SQL data i'm having 3 days data and also having single PrimaryKey column i.e; 01-01-2012 to 03-01-2012.

Step 1:) I created QVD from SQL by using QVW file.

Step 2:) Now again into SQL data entered for 06-01-2012 to 07-01-2012. The entire SQL data having for dates 1,2,3,6,7.

Step 3:) By using incremental process i updated to QVD only fetching the latest data.

i.e; Getting Max Date from old Qvd and after the Getting the data from SQL where date greater than MaxDate of Old QVD.

Step 4:) Now admin  members got know that they missed to enter data into SQL dates for 04-01-2012 and 05-01-2012, so they updated in SQL data. The entire SQL data having for dates 1,2,3,4,5,6,7

Step 5:) If i STEP3 process it is not updating the missing dates to QVD i.e; 04-01-2012 and 05-01-2012 data.

I GOT TO KNOW THAT THERE IS A UPDATE METHOD WHICH WILL OVERCOME THIS KIND OF PROBLEMS.

Please can anyone explain the steps that i can overcome this problem with UPDATE METHOD.

Thanks & Regards,

Satish.A

4 Replies
Not applicable
Author

Hi rav,

Load the complete data into QVD and find the data wich are not in the history QVD using not exists function.

Note: if required create a key with date,primarykey and fields you required to find the record distinctly.

Thanks,

sampath

Not applicable
Author

Hi sampath,

Thanks for reply.

Can i know which will be faster incremental reload for very large amount of data either by "not exists" or "checking with MaxDate condition" on update procedure ?

Thanks in advance.

Not applicable
Author

hi all,

Please share your knowledge on this.

Thanks in advance

gandalfgray
Specialist II
Specialist II

Well, you must have someway to identify which records are new or not.

If the records entered into the database does not have a timestamp for when they are entered/updated or a sequential column that gets incremented it is hard to create the incremental load logic.

/gg