topic Re: Loading data qvd optimized in QlikView

Loading data qvd optimized

arsenal1983 — Tue, 24 May 2016 07:59:57 GMT

Hi,

I'm trying to load huge set of data from qvd files.

I would like to create qvd optimized import process but I need to filter data besed on 2 fields.

so I have:

TAB:

Load

from

XXX

where

Exists(FIELD_1)

Exists(FIELD_2);

but this script is not optimized is there any chance to create optimized script with more than 1 where condition?

Re: Loading data qvd optimized

Chanty4u — Tue, 24 May 2016 08:02:15 GMT

chk disRe: optimised qvd load

What is optimised QVD?

Re: Loading data qvd optimized

marcus_sommer — Tue, 24 May 2016 08:16:48 GMT

I don't believe that this will be possible but you could try a reversed approach by combining both fields into one single-field (within the qvd and within the already loaded datatmodel). Further thinkable is to split your qvd into several qvd's - that meant to consider a complete different logic to store and reuse your data - but it isn't certain that you will get an overall benefit from them compared with your current solution.

- Marcus

Re: Loading data qvd optimized

arsenal1983 — Tue, 24 May 2016 11:13:21 GMT

Maybe Sunny T will help me

Re: Loading data qvd optimized

Kushal_Chawda — Tue, 24 May 2016 11:15:26 GMT

What is filter conditions?

Re: Loading data qvd optimized

marcus_sommer — Tue, 24 May 2016 11:17:05 GMT

If you want that somebody noticed a particular posting you need to add his/her profile-link, like: stalwar1‌.

- Marcus

Re: Loading data qvd optimized

arsenal1983 — Tue, 24 May 2016 11:21:06 GMT

It doesn't matter I have

* list of accounts and

* list of partners (ID)

I need to load all data from accout list OR partner list

Re: Loading data qvd optimized

sunny_talwar — Tue, 24 May 2016 11:21:38 GMT

Marcus‌ already responded to you, not sure what else may I add to his comment.

Re: Loading data qvd optimized

Clever_Anjos — Tue, 24 May 2016 11:22:05 GMT

Since you have an OR, you can make 2 loads, the result conceptually would be the same

TAB:

Load

from XXX

where

Exists(FIELD_1);

concatenate

Load

from XXX

where

Exists(FIELD_2);

Re: Loading data qvd optimized

Anil_Babu_Samineni — Tue, 24 May 2016 11:29:40 GMT

Try this:

Load multiple QVD with different fields into on... | Qlik Community

Re: Loading data qvd optimized

arsenal1983 — Tue, 24 May 2016 12:34:11 GMT

It will not work - because this set of data sometimes are separable and sometimes not, for example:

if on my field_1 lis I will have 1 and if on my field_2 list I will have 2 then I will load ID 2 twice.

Re: Loading data qvd optimized

Clever_Anjos — Tue, 24 May 2016 12:36:01 GMT

TAB:

Load

from XXX

where

Exists(FIELD_1);

concatenate

Load

from XXX

where

Exists(FIELD_2) and not exists(FIELD_1);

Re: Loading data qvd optimized

arsenal1983 — Tue, 24 May 2016 12:55:40 GMT

it will work but it will not be optimized load...

Re: Loading data qvd optimized

marcus_sommer — Tue, 24 May 2016 13:24:14 GMT

Are both fields depending to eachother in any way then you might be able to include this within the qvd-generation in an extra field. Are both fields instead completely independent to eachother then you will always need two conditions. But maybe there are further ideas from anyone if you provide some more details instead of the abstract FIELD_1/2.

- Marcus