Incremental Load

Mon, 28 Sep 2015 14:27:53 GMT

HI All.

I have written the script for incremental loading pasted below.

Inserts:

LOAD *

FROM

$(Vqvxpath)dim_geography_inserts.qvx(qvx);

date_dim_geography:

LOAD Max(geography_updated_datetime) as dim_geography_Maxdate

Resident Inserts;

LET VDate_dim_geography = Peek('dim_geography_Maxdate',0,'date_dim_geography');

DROP Table date_dim_geography;

STORE Inserts into $(Vqvdpath)dim_geography.QVD(qvd);

DROP Table Inserts;

Updates:

LOAD *

FROM

$(Vqvxpath)dim_geography_updates.qvx(qvx)

Where (geography_updated_datetime >$(VDate_dim_geography)) ;

Concatenate

LOAD *

FROM

$(Vqvdpath)dim_geography.qvd(qvd)

Where not Exists(geography_key);

STORE Updates into $(Vqvdpath)dim_geography.QVD(qvd);

DROP Table Updates;

Issues:

1.Not able to merge the Insert and Update QVX files but wen i ran script only Insert records are getting loaded But not Update records.

EX:Inserts --10 & Updates --5

I can see 10 Records which are Insert.QVX

2.When i ran the QVW its loading some data say 100 records.I want to append the file from next run onwards.

Like when i ran 2nd time i got more 20 records in QVX and if i refresh QVW only 20 records are loading and previous 100 records are getting override.

Could you guys please check the above script and let me know the necessary changes to achieve my requirement.

Thanks in Advance,Please let me know if any other information required.

Regards,

Ramesh

topic Incremental Load in QlikView