Qlik Community

QlikView App Development

Discussion Board for collaboration related to QlikView App Development.

Highlighted
navaneeth79
New Contributor II

Incremental Load

I have a QVW where the excel data is loaded and stored in qvd from many sheets of excel sheet using odbc connection. Now I want the qvd to be incremented with the latest data retaining the old data in the qvd when the excel is replaced.

21 Replies
Highlighted
MVP
MVP

Re: Incremental Load

Highlighted
navaneeth79
New Contributor II

Re: Incremental Load

I have followed the same procedure but unable to append the data, only new data is been seen.

Highlighted
thiago_justen
Valued Contributor III

Re: Incremental Load

What about this:

www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

Thiago Justen Teixeira Gonçalves
WhatsApp: 24 98152-1675
Skype: justen.thiago
Highlighted
navaneeth79
New Contributor II

Re: Incremental Load

my query is every week I replace the source file so the last week data gets replaced by new week data. but I want to retain the old data of the previous file and the new data in the current file should get incremented to it

Highlighted
thiago_justen
Valued Contributor III

Re: Incremental Load

I see...

I have an app doing what you want. Basically, if you follow the steps into the link below you will reach your goal:

Overview of Qlik Incremental Loading

Thiago Justen Teixeira Gonçalves
WhatsApp: 24 98152-1675
Skype: justen.thiago
Highlighted
navaneeth79
New Contributor II

Re: Incremental Load

its not  working

I have a excel with  5 sheets and all sheets have same fields, and I get each excel every week. presently we replace old excel with new excel. and the 5 sheets data is store into one table in qlikview using ODBC connection. and that table is stored in QVD. Now I want  the exact procedure but  only change is need to retain the old data in QVD as well as increment the QVD with new data.

Highlighted
MVP
MVP

Re: Incremental Load

Please outline your current approach of loading the data.

There are a lot of working examples of an incremental LOAD, so it should be possible to adapt to your needs.

Highlighted
navaneeth79
New Contributor II

Re: Incremental Load

ODBC CONNECT TO [Excel Files;DBQ=$(FilePath)\ResponseTimes.xlsx];

XlsxTables:
SQLTables;

DISCONNECT;

LET vRows = NoOfRows('XlsxTables');
FOR i = 0 TO $(vRows)-1
LET vSheetName = subfield(peek('TABLE_NAME', i,'XlsxTables'),'$',1);

ResponseTime:
LOAD *,
'APResponse'
as FactType,
Time as ResponseTimestamp,
hour(frac(Time)) as TestHour,
frac(Time) as TestTime,
[Resp Time] as ResponseTime,
Date(Time) as _CalendarDateKey
'$(vSheetName)'
as PerfTestName
FROM [$(FilePath)\ResponseTimes.xlsx]
(
ooxml, embedded labels, table is '$(vSheetName)');

NEXT i

DROP TABLE XlsxTables;

Concatenate (ResponseTime)
LOAD * from [$(QVDPath)\ResponseTime.qvd](qvd);


Store ResponseTime into
[$(QVDPath)ResponseTime.qvd]
(
qvd);


Drop Table ResponseTime;

This is my code where ReponseTimes.xlsx is the excel work book with 5 sheets containing same fields and every week the Old Excel is replaced by new Excel and Data is stored in ResponseTime.qvd . But now my requirement is whenever old excel is replaced by new excel the qvd should hold the old data along with new data

Highlighted
shiveshsingh
Honored Contributor

Re: Incremental Load

In your below code, what is there in ResponseTime.qvd? Old files?

Concatenate (ResponseTime)
LOAD * from [$(QVDPath)\ResponseTime.qvd](qvd);