loop and export QVD's

[#1]

Has anyone implemented a method to Loop through a folder of QVD's Exporting each to a csv file. I need to validate some Data that I believe may have been duplicated across qvd's that are supposed to be incremental. There are a number of them in total containing millions of transactions that should be distinct.

Colin

[rbecher]

Hi Colin,

there is a solution in QV script but why you don't load everything in QV to measure the distinctness?

- Ralf

[#3]

Have you tried it across 300 million records, I tried it more for curiousity than anything else. It took a 24 core server with 133GB ram to 98% for 4 hours before falling over without an error, it just higlighted the line ob.export in my macro.

I think id rather do it in a database, its still going to be heavy there but ive got a bit more control over whats going on.

Id like to see the script solution you hinted at.

ColinR

[rbecher · Accepted solution]

Just try the attached app. This is part of our TIQView suite.

But there is still an issue with CSV files created by QV containing three binaries at the beginning...

- Ralf.

[#5]

thanks for the script, there is an obvious bug in it when used for my scenario. the TableName in each of my QVD's is the same as its an incremental Load of the same data and the table nae in each qvd is Sales. Using your script as is the for each loop overrites the Previous file with a new file of the Same name so the final output is the csv results of only the last file.

A simple edit allowed me to create an output CSV based on the InputFilename though

i hadnt realised the Store Command could write to CSV !

Regards
colinR