topic Re: How to load optimised data in App Development

How to load optimised data

rkspareek1992 — Fri, 06 Apr 2018 11:18:07 GMT

Hi,

I am fetching data from a big table with three where conditions with resident load as Where RBUKRS='4100' and Flag_PnL='Original_PnL' and Flag_BS_PnL='Original'.

This condition is taking too much time in reloading the data.

KIndly suggest any optimised way, so that I can reduce reload time.

Thanks in advance.

Re: How to load optimised data

stabben23 — Fri, 06 Apr 2018 11:44:18 GMT

Instead of doing a resident load, do a Preceding Load

LOAD *

Where RBUKRS='4100' and Flag_PnL='Original_PnL' and Flag_BS_PnL='Original'

;

LOAD

from yoursoucefile;

Re: How to load optimised data

felipedl — Fri, 06 Apr 2018 11:46:19 GMT

Hi Rakesh,

Use the ETL layers to extract the data with your where conditions and store the QVDs.

The transform and load layers will use the generated QVDs in an optimized way, if you simply load the tables with simply where clauses.

See the following as example:

ETL layer in qlikview

Re: How to load optimised data

rkspareek1992 — Wed, 11 Apr 2018 04:22:56 GMT

Hi stabben23

I have previously loaded data, from which I want to load some data (Where RBUKRS='4100' and Flag_PnL='Original_PnL' and Flag_BS_PnL='Original'), then how it is possible to load with Preceding Load at the place of Resident?

Re: How to load optimised data

stabben23 — Wed, 11 Apr 2018 05:49:57 GMT

Hi Rakesh,

This is a preceding load (the Bold part) This load from Your sourcefile and then read it again in memory With Your where statment.

Table:

LOAD

Where RBUKRS='4100' and Flag_PnL='Original_PnL' and Flag_BS_PnL='Original'

;

LOAD

RBUKRS,

Flag_PnL,

Flag_BS_PnL,

....

from yoursoucefile;

This is a resident LOAD, which means that you load the main table twice, second time With where statment and drop the first loaded table.

Table:

LOAD

RBUKRS,

Flag_PnL,

Flag_BS_PnL,

....

from yoursoucefile;

New_Table:

LOAD

RBUKRS,

Flag_PnL,

Flag_BS_PnL,

....

Resident Table

Where RBUKRS='4100' and Flag_PnL='Original_PnL' and Flag_BS_PnL='Original'

;

Drop table Table;