Skip to main content
Woohoo! Qlik Community has won “Best in Class Community” in the 2024 Khoros Kudos awards!
Announcements
Nov. 20th, Qlik Insider - Lakehouses: Driving the Future of Data & AI - PICK A SESSION
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Incremental Load Failing

Hi All,

I had implemented incremental load few days ago it worked fine for the first two days then it has failed all over. Instead of loading all six tables outlined in the script it only loads the first table. Please provide help it's an absolute must for my project.

Thanks in advance,

Capture.PNG

Capture1.PNG

1 Solution

Accepted Solutions
syukyo_zhu
Creator III
Creator III

Try this

Tmp_table:

SQL SELECT *

FROM yourtabledatabase

where  yourdate >= '$(v_date_min)'

IF FileSize ('$(vRepxxx)\xxxx\yourqvd.qvd') > 0 then

  Concatenate (Tmp_table)

  LOAD

   *

  From [$(vRepxxx)\xxxx\yourqvd.qvd] (qvd)

  Where

    yourdate < Date#('$(v_date_min)', 'YYYYMMDD')

  //

  or

  not exists (yourkey)

;

ENDIF

STORE yourqvd into [$(vRepxxx)\xxxx\yourqvd.qvd] (qvd);

View solution in original post

4 Replies
syukyo_zhu
Creator III
Creator III

Hi

if you use concanate and you don't get any data from your first table "CustomerCuration", your reload will be failed.

check this load

CustomerCuration:

SQL SELECT *

FROM "rbc_dw"."open".dim1customercuration

Where updatedate > '$(vLastRunTime)';

Not applicable
Author

Thanks for the reply, my understanding is in order for one to implement an incremental load one must use concatenate. Is there any other way I can do a insert and update incremental load?

Thanks,

syukyo_zhu
Creator III
Creator III

Try this

Tmp_table:

SQL SELECT *

FROM yourtabledatabase

where  yourdate >= '$(v_date_min)'

IF FileSize ('$(vRepxxx)\xxxx\yourqvd.qvd') > 0 then

  Concatenate (Tmp_table)

  LOAD

   *

  From [$(vRepxxx)\xxxx\yourqvd.qvd] (qvd)

  Where

    yourdate < Date#('$(v_date_min)', 'YYYYMMDD')

  //

  or

  not exists (yourkey)

;

ENDIF

STORE yourqvd into [$(vRepxxx)\xxxx\yourqvd.qvd] (qvd);

Not applicable
Author

Thanks Xia!!!!!!