is it indeed possible to do incremental load for qvW (application)?
I hope for QlikView it is not a huge data, since QV is able to report on big data ...
My question again: Do you see with certain tricks a possibility to reduce loading time for processes 1 to 4 (above), which take now 25 + 55 + 17 + 5 Minutes? (into let's say 20-30 Minutes all together?) extraction, loading, transformation, application, publishing?
thank you for your input. We are intending to use QlikView instead of / independent on a DW. Our DW for QV is just QVD.
Let's say we will manage to identify new records only for QVD. It is not clear to me, how to use the old QVW with old data and just add/append new lines into it in order to reduce loading and calculation time.
Some kind load binary old qvw and add new lines (or even modified) - something similar like SAP BW does the interaction between DSO and InfoCube.
One thing is, if its possible try to build a incremental loading concept. Otherwise you may follow below.
For example if Extraction Process QVW is taking the 45Mins and it's having may be 20 Tables to pull and convert into QVD's. Try to create a three QVW's for the extraction process like small size tables as one, medium size tables as one and large size will be one and then create the batch files,trigger it the three QVW's at a time same time with the 1mins of diffrence,
For the Transformation process also you can follow the same method. May be it can help.