topic Re: Incremental Load Help?? in QlikView

Incremental Load Help??

rohitians — Tue, 07 Jan 2014 07:14:09 GMT

Hello Everyone,

I have a document where in i want to implement incremental load depending upon time suppose last reload was at 4.00 pm and now it 5.00 pm i just want to reload new data i,e from 4.00 to 5.00 pm. How this can be achieved please help...i have timestamp as a filed..

Thanks and Regards,

Rohit

Re: Incremental Load Help??

nilesh_gangurde — Tue, 07 Jan 2014 07:21:13 GMT

You can change the variables and use this script for your data.

Set vQVDName =ABC;

Set vTableName = ABC;

if isnull(QvdCreateTime('..\Qvds\$(vQVDName).qvd')) then

$(vQVDName):

Select * from $(vTableName);

Store $(vQVDName) into ../Qvds/$(vQVDName).qvd;

Drop table $(vQVDName);

ELSE

TEMP:

LOAD

MAX(LAST_UPDATE_DATE) as LAST_UPDATE_DATE

FROM

..\Qvds\$(vQVDName).qvd

(qvd);

Let vLastUpdateDate = timestamp(peek('LAST_UPDATE_DATE',0,'TEMP'),'DD-MMM-YYYY hh:mm:ss');

Drop table TEMP;

$(vQVDName):

Sql Select * from $(vTableName) where LAST_UPDATE_DATE >

to_date('$(vLastUpdateDate)','DD-MON-RRRR HH24:MI:SS');

if NoOfRows('$(vQVDName)') > 0 then

Concatenate

LOAD *

FROM

..\Qvds\$(vQVDName).qvd

(qvd);

Store $(vQVDName) into ../Qvds/$(vQVDName).qvd;

Drop table $(vQVDName);

ENDIF

Re: Incremental Load Help??

Siva_Sankar — Tue, 07 Jan 2014 07:21:30 GMT

Rohit,

PFA. The document helps to give better understanding about incremental load with example.

Regards.

Siva

Re: Incremental Load Help??

rohitians — Tue, 07 Jan 2014 09:30:55 GMT

Hey,

The code works fine,

but shows error at line,

$(vQVDName):

Sql Select * from $(vTableName) where LAST_UPDATE_DATE >

to_date('$(vLastUpdateDate)','DD-MON-RRRR HH24:MI:SS');

to_date is here error occurs..

Thanks and Regards,

Rohit

Re: Incremental Load Help??

nilesh_gangurde — Tue, 07 Jan 2014 09:32:58 GMT

please read the error or you can take snapshot of error and post here so i can help you.

-Nilesh

Re: Incremental Load Help??

rohitians — Tue, 07 Jan 2014 09:47:50 GMT

Hey,

THis line is having error

LAST_UPDATE_DATE >

to_date('$(vLastUpdateDate)','DD-MON-RRRR HH24:MI:SS');

where in we compare the timestamp..

Thanks...

Re: Incremental Load Help??

nilesh_gangurde — Tue, 07 Jan 2014 09:56:05 GMT

there are following chances of error.

1. Your Filedname is "Timestamp". hence cant use "LAST_UPDATE_DATE" Fieldname as Field to compare.

2. Check the variable ($(vLastUpdateDate))is getting updated properly or not.

3. Also the formate of the date in the variable should be timestamp.

hope this will help.

-Nilesh

Re: Incremental Load Help??

rohitians — Tue, 07 Jan 2014 11:43:53 GMT

I got it i Did it in following way,

where timestamp(peek('Timestamp',0,'TEMP'),'DD-MMM-YYYY hh:mm:ss') >='$(vLastUpdateDate)';

Thanks for Helping..:d