Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
adamdavi3s
Master
Master

qvd load 10x slower when file locations dynamically loaded...!

Dear All,

here is a little friday pickle for you.

I was struggling with a slow QVD load and I assumed it was down to the fact I was using an not exists clause.

However, I copied the files locally and the reload was almost instant as expected. So I created a test file and loaded this in the server, again the reload was super quick.

Now I have two test files with the specific code I want to test.

One has the file paths hard-coded, one has them loaded from an include file based on the files current location.

Testfile5: This is my file with the hard coded paths and loads from the QVD in about 1min

Testfile4: contains the current code and takes 10mins

ANy ideas at all? This one has me really baffled.

I've uploaded both logs and files but have replaced a bunch of the code with 'blah blah blah'

And yes one file might have incrementally loaded slightly fewer rows but this is NOT the issue, the new file loaded an extra 1m rows earlier today and it still did it in 1min.

1 Solution

Accepted Solutions
adamdavi3s
Master
Master
Author

yep, just me being over tired and having a friday 'moment'

View solution in original post

5 Replies
sudeepkm
Specialist III
Specialist III

few suggestions that you may try:

1. Use Must_Include

2. Use Relative path instead of full path

example:

$(Must_Include=..\_Core\file_locations.qvs);

adamdavi3s
Master
Master
Author

ah I hadn't thought of must include thank you, i'll try that

the path is on the same drive but not a subdirectory which is why I went absolute

I just cant understand why it would cause this impact though

adamdavi3s
Master
Master
Author

Ok I:

left the include scripts in

made all the path names absolute (as per the quicker file)

Still 10 mins

I am now just sanity checking by excluding the include files and hardcoding the connection string in the slow file, which in theory should speed it up to the same as the quicker file

adamdavi3s
Master
Master
Author

Found it, I think the slow file has an extra apply map in it!

Must have totally missed it when reproducing the file

adamdavi3s
Master
Master
Author

yep, just me being over tired and having a friday 'moment'