QVD load not optimized when used Exists function

[manishnarang]

Hi,

I have a QVD of around 60M rows. I am trying to load the dates for a particular type of products.

Sample script:

------------------------------------------

Temp:

Load * Inline

[

Product Type

A

B

C

];

LoadDates:

Load [Invoice Date]

from

abc.qvd(qvd)

where

exists([Product Type]);

Drop table Temp;

-------------------------------------

It gives me the data for Product Type A, B and C, but takes very long time to execute and in Trace window, it does not show as Optimized Load.

without this filter, I am able to load the dates in 1/10th time of the time taken to load the above.

Can anyone help what i am missing?

Regards,

Manish

[tresesco]

The script you shared seems to be a sample one. Could you share the exact load statement you are trying?

[manishnarang]

appriciate your response but

I won't be able to share the exact script but this is exactly the same logic i am using.

[tresesco]

Not even that exact load section of the script?

[sasiparupudi1]

Are you selecting Product Type from your qvd?

[manishnarang]

Thanks again. This is,in fact, the exact same script except column names changed..

[manishnarang]

Hi,

No, Just loading the dates.

Product Type is in where clause only.

[tresesco · Accepted solution]

Try including the comparative field [Product Type] in the load (and then drop), like:

LoadDates:

Load

     [Invoice Date],

     [Product Type]

from

abc.qvd(qvd)

where

exists([Product Type]);

Drop Field [Product Type];

[manishnarang]

Thank you very much. It worked perfectly.