Export a reduced selection to a QVD

[#1]

Hi,

I am in desperate need of help. I have a huge data set that can be heavily reduced by country selection.

I have split the file into two "Source creator" and "Analysis". Basically, "source creator" reads all different text files and create the data set. "Analysis" has all the graphs and calculations. If I put them both in the same file and use all data, the file reaches the memory roof in no time.

In my dream scenario I would like to run "Source creator" with one list of Countries and an export button. Here I make a few country selections, click export and all REDUCED data (I mean the entire data set prices, employees etc related to the selected countries) is sent to a QVD.

The QVD is then used as the sole file to import by "Analysis", containing all necessary tables.

How do I solve this?

I cannot use Store (since I need the user input on countries) and I don't know how to use ExportEx etc. I cannot find any info anywhere.

[disqr_rm]

One option would be to have once streight table chart created per table you want to extract. Have these streight tables minimized on the screen, so ithey don't take all your memory. Then with your button you need to call a macro to do export of these charts.

set obj = ActiveDocument.GetSheetObject("CH01")
obj.ExportEx "C:\test.qvd", 4

You can loop on all the document objects (charts) which have a certain namings (like > CH99) and then do the export in that loop.

Thanks

[rwunderlich]

Do you really need a QVD? Or do you want multiple "Analysis" QVWs, each having the same charts but different country data?

If you have Publisher Enterprise, you can do a "Loop and Reduce" against the master "Source" qvw and generate a qvw for each country that will look something like this:

Analysis_CH.qvw
Analysis_DE.qvw
Analysis_US.qvw

If you don't have Pub Enterprise, It may be possible to create this function as an external script if you have the VB skills.

-Rob

[#4]

Thanks, both of you.

It does not really solve my problem though. Looping through all charts is a good hack but it feels like this could cause further problems up ahead.

Robs solution does not work for me since I don't have Pub. Ent. and unfortunately I am not too skilled with VB.

I would expect that there would be some standard solution for this since *I assume user chosen data reduction would be a common thing. Or?

Maybe the problem could be solved completely different without data reduction. Perhaps I do something wrong with my QVW to make the memory go through the roof. Qliktech is saying that Qlikview can handle a LOT of data but I see memory problems very, very often (have 3 Gb RAM). I had to create a "Kill Qlikview"-application because of recurring freezing of the program.

In what way could I describe to you how "large" my QV application is too see if it is abnormally large? The script takes 2-3 minutes to load all data from different text files. The text files (if I use all) are in total 50 Mb - however it is practically impossible for me to load all countries (i.e. all 50 Mb).

[#5]

Hmm, That is quite unusual. Generally a document of around 300 MB should be fine in a 3GB RAM if your model is good. Load generally takes more memory, so if you have QV crashing during the loads, you will have to optimize the script. With 50MB of data, you should not be getting into any memory related problems. Having more visibility into the model will help.

[rwunderlich]

ch-bjo wrote:In what way could I describe to you how "large" my QV application is too see if it is abnormally large?

It would be best if you upload a reduced copy of the actual QVW. See this wiki entry if you have questions on preparing the example.

How many total rows are in your fact table(s)?

-Rob