My guess here is that the files from the new folder are being loaded into a seperate table to the files from the original folder (because of the new field, qlikview won't automatically concatenate the tables) so it will be left to do a nasty join on the common fields from teh 2 tables at the end of script. It will freeze and crash if the volumes of data in the tables are high.
If your intention is to have all the data loaded into one table, with the new field populated for the new files then use CONCATENATE before the load of the new files to force qlikview to add then onto the bottom of the existing table containg the older file data. Something like below.... Hope this helps - Matt
LOAD [Field 1],
FROM OLD FOLDER
LOAD [Field 1],
[BRAND NEW FIELD]
FROM NEW FOLDER
Thank you both - I will try the concatenate this morning.
I load this file every morning when I get to work - it takes almost 20 minutes. Can you please help me with the QVD? I have no idea how to go about it...
I have QV Personal Edition and for this file, I load the following every morning:
1. A NEW Full Account Extract, which replaces the previous account extract (about 400,000 records).
2. An ADDITIONAL Daily Transaction Extract with a KEY Account Number field. This I load from a folder where all historical transaction extracts are, so I load all of them including the new daily extract (usually about 50,000 records per day - up to 2 million records at the moment for them all).
3. An ADDITIONAL Daily Application Extract with a KEY ID Number field. This I load from a folder where all historical application extracts are, so I load all of them including the new daily extract (usually about 1,000 records per day - up to 400,000 records at the moment for them all).
4. An Insurance Policy Extract with the Account Number fields as Key again. Like the Account Extract I REPLACE this extract every day (as it is a full extract, not just new daily sign-ups) - about 25,000 records.
Your help is greatly appreciated. My script is attached to my first post.