Below is my script for storing QVD's for one of my application. We are triggering this task every 2 hours , but it has been many times that we are missing some data . So to avoid this I want to come up with an idea to load the data from beginning of the week over the weekends. No sure if this is possible but i need help on this.
For example : This week starts form 17th Aug (Monday) , below script will keep on running until Friday i.e. 21st Aug and on 22nd Aug (Weekend) I want to load complete data from 17th until 22nd .
Please suggest what could be the best approach to avoid loss of data.
LET vStartDate = date(makedate(2014,1), 'DD.MM.YYYY hh:mm:ss');
Set vSignal = '..\0_Signal';
Set vQVD = 'D:\qvprod\QV_QVD';
Let vQVDCurrentYear = 'D:\qvprod\QV_QVD\'& year(today());
I would suggest that you first investigate why your data is incomplete when your script does a complete load every two hours. Is it the data volume that is causing trouble?
Another question: if you load the complete data set every two hours (no WHERE clauses that reduce the data set to a
specific period), then what's the use of only loading one week in the weekend?
The best approach IMHO is to perform an Incremental LOAD during weekdays, and perform full LOADs in the weekend. But if your current Full LOADs have issues on weekdays, they'll will most probably have the same issues in the weekend.