Incremental Load

[navaneeth79]

I have a QVW where the excel data is loaded and stored in qvd from many sheets of excel sheet using odbc connection. Now I want the qvd to be incremented with the latest data retaining the old data in the qvd when the excel is replaced.

[swuehl]

Have you alread had a look at

Using QVD files for incremental load ‒ QlikView

[navaneeth79]

I have followed the same procedure but unable to append the data, only new data is been seen.

[Thiago_Justen_]

What about this:

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

[navaneeth79]

my query is every week I replace the source file so the last week data gets replaced by new week data. but I want to retain the old data of the previous file and the new data in the current file should get incremented to it

[Thiago_Justen_]

I see...

I have an app doing what you want. Basically, if you follow the steps into the link below you will reach your goal:

Overview of Qlik Incremental Loading

[navaneeth79]

its not  working

I have a excel with  5 sheets and all sheets have same fields, and I get each excel every week. presently we replace old excel with new excel. and the 5 sheets data is store into one table in qlikview using ODBC connection. and that table is stored in QVD. Now I want  the exact procedure but  only change is need to retain the old data in QVD as well as increment the QVD with new data.

[swuehl]

Please outline your current approach of loading the data.

There are a lot of working examples of an incremental LOAD, so it should be possible to adapt to your needs.

[navaneeth79]

ODBC CONNECT TO [Excel Files;DBQ=$(FilePath)\ResponseTimes.xlsx];

XlsxTables:
SQLTables;

DISCONNECT;

LET vRows = NoOfRows('XlsxTables');
FOR i = 0 TO $(vRows)-1
LET vSheetName = subfield(peek('TABLE_NAME', i,'XlsxTables'),'$',1);

ResponseTime:
LOAD *,
'APResponse' as FactType,
Time as ResponseTimestamp,
hour(frac(Time)) as TestHour,
frac(Time) as TestTime,
[Resp Time] as ResponseTime,
Date(Time) as _CalendarDateKey, 
'$(vSheetName)' as PerfTestName
FROM [$(FilePath)\ResponseTimes.xlsx]
(ooxml, embedded labels, table is '$(vSheetName)');

NEXT i

DROP TABLE XlsxTables;

Concatenate (ResponseTime)
LOAD * from [$(QVDPath)\ResponseTime.qvd](qvd);


Store ResponseTime into
[$(QVDPath)ResponseTime.qvd]
(qvd);


Drop Table ResponseTime;

This is my code where ReponseTimes.xlsx is the excel work book with 5 sheets containing same fields and every week the Old Excel is replaced by new Excel and Data is stored in ResponseTime.qvd . But now my requirement is whenever old excel is replaced by new excel the qvd should hold the old data along with new data

[shiveshsingh]

In your below code, what is there in ResponseTime.qvd? Old files?

Concatenate (ResponseTime)
LOAD * from [$(QVDPath)\ResponseTime.qvd](qvd);