Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
amit_saini
Master III
Master III

Incremental load help for QVD Gen

Hi Folks,

Attached is our QVD Gen from one of our support team , which is some how complicated (Use of variables).

I have tried few things in order to do incremental load on generated qvd's , but failed to do so.

Currently I believe this is doing full load in each trigger and storing qvd's. See below:

I'm looking for a solution where I can do incremental load on generated qvds, can't wait for 2 hours for new data.

I tried so many things based on comments from developer at script side , but still no success .

Please suggest what is the best possible way for incremental load.

Thanks,

AS

29 Replies
Kushal_Chawda

Are you sure that, DTUPDATE field format in database is DD.MM.YYYY hh;mm:ss format ? Can you confirm that it is not the String value in database?

or try to_timestamp() instead to_date()

to_timestamp('$(Last_Updated_Date)', 'dd.mm.yyyy HH24:MI:SS')

amit_saini
Master III
Master III
Author

Yes I'm checking for format , will let u knw!

Thanks,

AS

stabben23
Partner - Master
Partner - Master

If you dont have "Last_Updated_Date then this statment wont work:

WHERE DTUPDATE > to_date('$(Last_Updated_Date)', 'dd.mm.yyyy HH24:MI:SS')

I'm also wondering what "to_date" is?

WHERE DTUPDATE > '$(Last_Updated_Date)' should be enough.

I should also do my dateformat Within the variable instead of in where statment.

stabben23
Partner - Master
Partner - Master

incrementalLoadMode=0 in Your script. Cant find where you set this variable.

// incrementalLoadMode: 1 = only insert 2 = insert and update 3 = insert, update and delete

is what is comment in Your script

amit_saini
Master III
Master III
Author

Yes I have already tried based on comment part, but still full load.

Thanks,.

AS

jagan
Luminary Alumni
Luminary Alumni

Hi,

Date format is the issue, check it correctly.

Regards,

Jagan.

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

Can you post the Document log?

-Rob

http://masterssummit.com

http://qlikviewcookbook.com

amit_saini
Master III
Master III
Author

Hi Rob,

First of all was pleasure meeting you @ Qonnections2016.

Attached is the log file

Also sharing one of our pic

Thanks,

AS

amit_saini
Master III
Master III
Author

Thanks

AS

stabben23
Partner - Master
Partner - Master

20.05.2016 10:30:20: 0118  SQL SELECT NLFDPONR || NSTEPNR || NOPERSPLITTNR || DTTIMESTAMP AS UNIQUEKEY, PRI_EVENTS_HIST.*

    FROM PRI_EVENTS_HIST

20.05.2016 10:30:21:             31 fields found: UNIQUEKEY, NLFDPONR, NSTEPNR, NOPERSPLITTNR,

     DTTIMESTAMP, NEVENT, NLFDEVNR, NLFDMASCHNR, NLFDCHARGENNR,

     NOPERSTATNR, NLFDSTATIONNR, NRESSOURCENR, NPERS_IDNR, NEINHEIT,

     NLFDARTIKELNR, NIDNR, NMENGE, NVALUE, SVALUE, NREASONNR, NDTTIMESTAMPTZID,

     NLFDCHARGENNRD, NBUNCHQUANTITY, NBUNCHUNIT, NMATSTATUSID, NWITHDRAWALID,

  NRESTOOLCAVITYID, NPRIEVENTID, DTREFERENCE, NDTREFERENCETYID, NDTREFERENCETZID, 9,134,782 lines fetched

9.134.782 should not be fetched when you load incrementall, check Your timestamps here.