Hi All,
I have made an incremental load extractor but it is taking more time to reload as compared to the extractor without incremental load.
Also it is fetching the existing data from qvd again along with new updated data due to which I think it is taking too much time.
following is the script , I am using for making the incremental load.
LastUpdatedDate:
LOAD
max("DATE") as MaxDate
FROM [lib://qvd/book.qvd]
(qvd);
Let varThisExec = Date(Now());
Let varLastExec = peek('MaxDate', 0, 'LastUpdatedDate');
incremented_table:
LOAD
NAME,
"DATE",
ID
FROM [lib://BOOK/Book1.xlsx]
(ooxml, embedded labels, table is Sheet1)
Where "DATE" >= '$(varLastExec)';
Concatenate
LOAD
"NAME",
"DATE",
"ID"
from [lib://qvd/book.qvd]
(qvd)
where not Exists(ID);
Inner Join
LOAD
"ID"
FROM [lib://BOOK/Book1.xlsx]
(ooxml, embedded labels, table is Sheet1);
if '$(ScriptErrorCount)' = 0 then
Store incremented_table into [lib://qvd/book.qvd]
(qvd);
Let varLastExec = '$(varThisExec)';
endif
Pls help me out as to what changes I should apply in the script in order to reduce the reload time and should load only the updated record instead of loading the whole data again.
Thanks
