Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Issue in incremental load

Hi,

I am facing issue while performing incremental load.  Data is not updating.

I am attaching the sample qvw/qvd file for reference and source input file.

Two excel sheet i have attached. One having sales data for 03/28 and other sheet which have data for 03/29.

This 03/29 sheet have some of the records need to be updated.

Please help me!!

6 Replies
aarkay29
Specialist
Specialist

try this:




Last_update_date:

load max([Invoive Date]) as Maxdate

From

 

(qvd);

Let vLast_update_date = Date(peek('Maxdate',0,'Last_update_date'),'MM/DD/YYYY');

Drop Table Last_update_date;

Incremental:

LOAD [Sale Source],

    [Transaction ID],

    [Invoive Date],

    [Customer Detail],

    [Customer ID],

    [Customer Area code],

    [Bill No],

    [Product Name],

    [Transaction mode],

    [Product quantity],

    [Total sales amount]

FROM

[C:\Users\664393\Documents\Sales input_03292017.xlsx]

(ooxml, embedded labels, table is Sheet1) where [Invoive Date] > '$(vLast_update_date)';

Concatenate

LOAD [Sale Source],

    [Transaction ID],

    [Invoive Date],

    [Customer Detail],

    [Customer ID],

    [Customer Area code],

    [Bill No],

    [Product Name],

    [Transaction mode],

    [Product quantity],

    [Total sales amount]

FROM

[C:\Users\664393\Documents\SampleinputQVD.qvd]

(qvd)

where not Exists([Customer ID]);

STORE Incremental into [C:\Users\664393\Documents\SampleinputQVD.qvd]

(qvd);

DROP Table Incremental;

jonas_rezende
Specialist
Specialist

Hi, Rohit Kumar.

My suggestion is:

Create a key field to control the modification, because each key field is a fact. See example below of incremental load insert and update (no delete).

Last_update_date:

LOAD

  Distinct

  Max(Date([Invoive Date])) AS  Maxdate

FROM

(qvd);

Let vLast_update_date = Date(peek('Maxdate',0,'Last_update_date'),'MM/DD/YYYY');

DROP Table Last_update_date;

SampleinputQVD:

LOAD

  

  ([Sale Source] & '_' & [Transaction ID] & '_ ' & [Customer ID] & '_' & [Customer Area code] & '_' & [Bill No] & '_' & [Product Name] & '_' & Date([Invoive Date]))

  

  AS [Modification Data],

  [Sale Source],

     [Transaction ID],

     Date([Invoive Date]) AS [Invoive Date],

     [Customer Detail],

     [Customer ID],

     [Customer Area code],

     [Bill No],

     [Product Name],

     [Transaction mode],

     [Product quantity],

     [Total sales amount]

FROM

(ooxml, embedded labels, table is Sheet1)

Where

Date([Invoive Date]) >= '$(vLast_update_date)';

Concatenate

LOAD [Sale Source],

     [Transaction ID],

     Date([Invoive Date]) AS [Invoive Date],

     [Customer Detail],

     [Customer ID],

     [Customer Area code],

     [Bill No],

     [Product Name],

     [Transaction mode],

     [Product quantity],

     [Total sales amount],

     [Modification Data] //Already create in QVD.

FROM

(qvd)

where not Exists([Modification Data]);

STORE SampleinputQVD into

(qvd);

DROP Table SampleinputQVD;

P.S.: create a key field in QVD before run script. Utilize the attached  that already exist (Modification Data field).

I hope this helps!

Jonas Melo.

Not applicable
Author

Hi Aar,

Total 14 records needs to be there after successful insert and update. I have run the shared script but it is giving me only 10 records and respected date is also not updated. Please find the missing output file as below:

  

Customer Detail file for 0328 fileOutput QVD
SureshRamesh
RameshRobin
RobinRonit
RupeshSubhash
SauravVardhan
VishalSuresh
VikasVikas
NaveenNaveen
VivekVivek
NavneetNavneet
Customer Detail file for 0329 fileNot in the output QVD
BipinBipin
RameshRupesh
RobinVishal
RonitSaurav
Subhash
Vardhan

Thanks,

Rohit

Not applicable
Author

Hi Jonas,

I am expecting total 14 record in output QVD but the resulted output is giving 10 records. Please see also my reply to Aar for details.

Thanks,

Rohit

aarkay29
Specialist
Specialist

Hi Rohit,

According to your requirement BillNo and Customer Detail seem to be the compositekey

Let me know if that is incorrrect.

PFA

jonas_rezende
Specialist
Specialist

Hi, Rohit Kumar.

Please, list the 4 registers new and do upload of data source.

Regards,

Jonas Melo.