Incremental Load with 3 columns as key

sivavasam — Sat, 13 May 2023 12:18:52 GMT

I need to implement incremental data db table has 25,000,000 lines .... 50 plus fields but I has 3 coloumns to combine a key for where not exists key .pls suggest me

Example

Table :

Load A,B,C,D,E

From QVD ;

Max:

Load Max (D) as MaxD

Resident to Table ;

Drop Table ;

Drop Max;

Let vMaxDate = peek ( 'MaxD',0);

Source :

Load * select From DB

Where D > '$(vMaxDate)';

Concatenate (source)

Load *, A &'|'&B&'|'&C as Key

From Source QVD

Where doesn't not exists ( key);

Suggest if any ....

Re: Incremental Load with 3 columns as key

BrunPierre — Sat, 13 May 2023 14:17:56 GMT

Hi, try this.

Let vMaxDate=Peek('MaxD', 0, 'Max');

Source:
LOAD * select From DB
Where D > '$(vMaxDate)';

Concatenate(source)
LOAD *
Where not Exists (Key);

LOAD *,
A &'|'&B&'|'&C as Key

FROM Source QVD;

topic Incremental Load with 3 columns as key in QlikView

Incremental Load with 3 columns as key

Re: Incremental Load with 3 columns as key