This is one of those times where you ask the question and just when you submit the answer pops up.
The numbers next to the lines is not actually number of lines from the files, it's the number of lines read in to the table. It accumulates as the load progresses. So my first solution was indeed correct and there were no issue =)
I need to implement somewhat like you have implemented.
My datawarehouse fact contains near about 70 million records .
Each month fact is loaded with nearly 1.2 million data and is always contains data of 5 years (current+last 4 years).
I want to create architecture to load this data in QVW application.
So i decided to go with QVD files for fetching data from database and QVD files will be source of my QVW application. I want to know which are the best prectices to created QVD file. Below are some of my queries
1. How may QVD files to create?
2. In case if i choose to go with multiple QVD option. How shold i implemet inceramental load in this case?
Any help on this will really help me to proceed with robust architecture.