topic Implement Incremental Load in QlikView

Implement Incremental Load

agni_gold — Wed, 08 Jan 2014 12:24:17 GMT

I have a excel file like

ID Name address

1 a b

2 b rgfr

3 c dgr

4 d gfrg

i have loaded this file in qlikview , now when i reload the script then it loads all the data , now please tell me how to implement incremental load on this type of table. Because there is no timestamp field but ID is Primary Key. Provide me script also.

thanks.

Re: Implement Incremental Load

manideep78 — Wed, 08 Jan 2014 12:31:51 GMT

Store MAX(ID) value in a variable.

Next time when u get data, get only those records which are greater than MAX(ID) and concatenate to previous table.

So that every time you reload you will get only incremented records.

Table1:

LOAD ID,

NAME

FROM

(qvd);

LET vMaxID = Peek('ID',-1,'Table1');

Concatenate

LOAD ID,

NAME

FROM

(ooxml, embedded labels, table is Sheet1)

Where ID>$(vMaxID);

STORE Table1 into F:\Manideep\qlikview practice\Incremental_Load\Updated_Data.qvd;

Hope this helps

Regards,

Manideep

Re: Implement Incremental Load

Wed, 08 Jan 2014 14:36:28 GMT

Hi,

I tried this scrit executed.

Table1:

LOAD ID,

Name,

Address

FROM

(ooxml, embedded labels, table is Sheet1);

STORE Table1 into E:\QlikView\QVD\Updated_Data.qvd;

Table1:

LOAD ID,

Name,

Address

FROM

(qvd);

Concatenate

LOAD ID,

Name,

Address

FROM

(ooxml, embedded labels, table is Sheet1)

Where not Exists(ID);

STORE Table1 into E:\QlikView\QVD\Updated_Data.qvd;

regards

mahesht

Re: Implement Incremental Load

agni_gold — Wed, 08 Jan 2014 17:42:39 GMT

but every time when i reload script it will again reload all data from source

Re: Implement Incremental Load

Anonymous — Wed, 08 Jan 2014 19:13:44 GMT

Maybe you need to make sure the Save Before Reload is turned on. Otherwise whenever you run your code and it fails, you will be reloading your original code with no changes. Just a thought....