topic Re: update method from SQL to QVD in QlikView

update method from SQL to QVD

Mon, 29 Oct 2012 11:41:13 GMT

hi all,

how we can use the update method for incremental procedure ? Please let me know with some example.

Consider my data is fetching into SQL daily bases. Now in SQL data i'm having 3 days data and also having single PrimaryKey column i.e; 01-01-2012 to 03-01-2012.

Step 1:) I created QVD from SQL by using QVW file.

Step 2:) Now again into SQL data entered for 06-01-2012 to 07-01-2012. The entire SQL data having for dates 1,2,3,6,7.

Step 3:) By using incremental process i updated to QVD only fetching the latest data.

i.e; Getting Max Date from old Qvd and after the Getting the data from SQL where date greater than MaxDate of Old QVD.

Step 4:) Now admin members got know that they missed to enter data into SQL dates for 04-01-2012 and 05-01-2012, so they updated in SQL data. The entire SQL data having for dates 1,2,3,4,5,6,7

Step 5:) If i STEP3 process it is not updating the missing dates to QVD i.e; 04-01-2012 and 05-01-2012 data.

I GOT TO KNOW THAT THERE IS A UPDATE METHOD WHICH WILL OVERCOME THIS KIND OF PROBLEMS.

Please can anyone explain the steps that i can overcome this problem with UPDATE METHOD.

Thanks & Regards,

Satish.A

Re: update method from SQL to QVD

Mon, 29 Oct 2012 11:54:16 GMT

Hi rav,

Load the complete data into QVD and find the data wich are not in the history QVD using not exists function.

Note: if required create a key with date,primarykey and fields you required to find the record distinctly.

Thanks,

sampath

Re: update method from SQL to QVD

Mon, 29 Oct 2012 15:27:10 GMT

Hi sampath,

Thanks for reply.

Can i know which will be faster incremental reload for very large amount of data either by "not exists" or "checking with MaxDate condition" on update procedure ?

Thanks in advance.

Re: update method from SQL to QVD

Tue, 30 Oct 2012 08:56:37 GMT

hi all,

Please share your knowledge on this.

Thanks in advance

Re: update method from SQL to QVD

gandalfgray — Tue, 30 Oct 2012 12:29:50 GMT

Well, you must have someway to identify which records are new or not.

If the records entered into the database does not have a timestamp for when they are entered/updated or a sequential column that gets incremented it is hard to create the incremental load logic.

/gg