Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
amit_saini
Master III
Master III

Incremental load help for QVD Gen

Hi Folks,

Attached is our QVD Gen from one of our support team , which is some how complicated (Use of variables).

I have tried few things in order to do incremental load on generated qvd's , but failed to do so.

Currently I believe this is doing full load in each trigger and storing qvd's. See below:

I'm looking for a solution where I can do incremental load on generated qvds, can't wait for 2 hours for new data.

I tried so many things based on comments from developer at script side , but still no success .

Please suggest what is the best possible way for incremental load.

Thanks,

AS

29 Replies
Kushal_Chawda

Are you sure that, DTUPDATE field format in database is DD.MM.YYYY hh;mm:ss format ? Can you confirm that it is not the String value in database?

or try to_timestamp() instead to_date()

to_timestamp('$(Last_Updated_Date)', 'dd.mm.yyyy HH24:MI:SS')

amit_saini
Master III
Master III
Author

Yes I'm checking for format , will let u knw!

Thanks,

AS

stabben23
Partner - Master
Partner - Master

If you dont have "Last_Updated_Date then this statment wont work:

WHERE DTUPDATE > to_date('$(Last_Updated_Date)', 'dd.mm.yyyy HH24:MI:SS')

I'm also wondering what "to_date" is?

WHERE DTUPDATE > '$(Last_Updated_Date)' should be enough.

I should also do my dateformat Within the variable instead of in where statment.

stabben23
Partner - Master
Partner - Master

incrementalLoadMode=0 in Your script. Cant find where you set this variable.

// incrementalLoadMode: 1 = only insert 2 = insert and update 3 = insert, update and delete

is what is comment in Your script

amit_saini
Master III
Master III
Author

Yes I have already tried based on comment part, but still full load.

Thanks,.

AS

jagan
Partner - Champion III
Partner - Champion III

Hi,

Date format is the issue, check it correctly.

Regards,

Jagan.

rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

Can you post the Document log?

-Rob

http://masterssummit.com

http://qlikviewcookbook.com

amit_saini
Master III
Master III
Author

Hi Rob,

First of all was pleasure meeting you @ Qonnections2016.

Attached is the log file

Also sharing one of our pic

Thanks,

AS

amit_saini
Master III
Master III
Author

Thanks

AS

stabben23
Partner - Master
Partner - Master

20.05.2016 10:30:20: 0118  SQL SELECT NLFDPONR || NSTEPNR || NOPERSPLITTNR || DTTIMESTAMP AS UNIQUEKEY, PRI_EVENTS_HIST.*

    FROM PRI_EVENTS_HIST

20.05.2016 10:30:21:             31 fields found: UNIQUEKEY, NLFDPONR, NSTEPNR, NOPERSPLITTNR,

     DTTIMESTAMP, NEVENT, NLFDEVNR, NLFDMASCHNR, NLFDCHARGENNR,

     NOPERSTATNR, NLFDSTATIONNR, NRESSOURCENR, NPERS_IDNR, NEINHEIT,

     NLFDARTIKELNR, NIDNR, NMENGE, NVALUE, SVALUE, NREASONNR, NDTTIMESTAMPTZID,

     NLFDCHARGENNRD, NBUNCHQUANTITY, NBUNCHUNIT, NMATSTATUSID, NWITHDRAWALID,

  NRESTOOLCAVITYID, NPRIEVENTID, DTREFERENCE, NDTREFERENCETYID, NDTREFERENCETZID, 9,134,782 lines fetched

9.134.782 should not be fetched when you load incrementall, check Your timestamps here.