7 Replies Latest reply: Jun 7, 2017 10:41 AM by Ronald van der Does RSS

    Incremental Load

    Jeb Pittard

      I'm struggling with the incremental load. My load script looks like this.

       

      ODBC CONNECT TO [A2i Server] (XUserId is CECJdQJGJTWB, XPassword is NJNTWBFMELZcWRVMRZHA);

      LOAD *;

      SQL SELECT  cast([recid] as varchar)+'-'+cast(cast([Transaction Effective Date] as int) as varchar) as PKey, *

      FROM "GL_Transactions".dbo."GL_Transactions"

      where [Transaction Effective Date] >='12/31/2015' ;

       

      CONCATENATE(GL_Transactions)

      LOAD *;

      SQL SELECT *

      FROM "GL_Transactions".dbo."GL_Transactions"

      where not exists (PKey) ;

       

      store GL_Transactions Into \\bhmwpapp1\qlikview\99.Shared_Folders\2.QVD\2.QVD_Data\GL_Transactions.qvd  (qvd);

       

      It loads 17 million records for the whole set, but what I would like to do is load the 17 million records once and then only load 30,000 records each day, but I'm getting this error message

       

      SQL##f - SqlState: 37000, ErrorCode: 102, ErrorMsg: [Microsoft][ODBC SQL Server Driver][SQL Server]Incorrect syntax near 'PKey'.

      SQL SELECT *

      FROM "GL_Transactions".dbo."GL_Transactions"

      where not exists (PKey)

       

      Can anyone suggest a better way to load the bulk one time and then the incremental records on a daily basis (ideally without manual intervention)?


      Thanks

      Jeb