3 Replies Latest reply: Mar 16, 2015 1:29 AM by Rob Wunderlich RSS

    Loading Dimensions (Update and Insert) or Full Load in QVD File

    Shivendoo Kumar

      Hi Members,

       

      My dimensions are Update (Existing Records) and Insert (New Records) and Same I want to apply in my QlikView Script to Load all dimensions Update/Insert.

       

      What I thought, Instead of doing Update and Insert, each load I can make it Full load for all the dimension. We have 2 years of data in our DWH and source for QlikView is DWH.

       

      The bigger dimension is having 15 million records and rest all dimensions are having less than 200000 records.

       

      I would like to know what would be more efficient ?

      1. Full Load (Each Day)? (15 Million or more records need to load every day)
      2. or Update/Insert? (On average each day, maximum 2 million records need update and insert)

       

      Kindly suggest me the best practice and pros and corns of FULL LOAD and Update/Insert.

       

      Note: My Facts are Incremental Load on daily basis.

       

      Also provide me Update and Insert syntax for below Query

       

      Full Load QlikView Script from My Database:

       

      DIM_EMP_DATA:

      LOAD

        EMP_KEY             as EmployeeKey,

        EMP_ID              as EmployeeId,

        EMP_TYPE            as EmployeeType,

        EMP_NAME            as EmployeeName

       

      SQL

      SELECT  

        EMP_KEY,

        EMP_ID,

        EMP_TYPE,

        EMP_NAME

      FROM STAR.DIM_EMPLOYEE;

       

      STORE DIM_EMP_DATA INTO D:\DIMENSION_DATA\DIM_EMP_DATA.QVD;

      DROP TABLE DIM_EMP_DATA;