0 Replies Latest reply: May 28, 2015 8:25 AM by Omar Slomic RSS

    Possible wrong data lineage

      Hi

       

      I have a task of representing data lineage in a custom app, hence I have some questions regarding Governance Dashboard data lineage files stored in QVX_LastRun and QVX_LastRun-folder folders.

      For me it seems like data from QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx shows wrong data lineage from time to time.


      Let me demonstrate the information found in TableLineage.QVD (just 4 columns to show source and target):

      QVDLineage2.png


      From this picture it looks like D_EXCHANGE_RATES.QVD gets data from multiple QV tables (see LOADStatement). In reality it is only one of them, D_Exchange_Details, that populates the QVD-file.

       

      Here is script code from D:\QLIKVIEW\LIVE\SOURCEDOCUMENTS\DM0005\QVD_Load_DM0005_ProjectLog.qvw showing how D_EXCHANGE_RATES.QVD gets populated:


      D_Exchange_Rates:
      LOAD
      "EUR_TO_JPY"
      AS Exchange_Rates_EUR_to_JPY,
      "EUR_TO_USD"
      AS Exchange_Rates_EUR_to_USD,
      "JPY_TO_EUR"
      AS Exchange_Rates_JPY_to_EUR,
      "JPY_TO_USD"
      AS Exchange_Rates_JPY_to_USD,
      "USD_TO_EUR"
      AS Exchange_Rates_USD_to_EUR,
      "USD_TO_JPY"
      AS Exchange_Rates_USD_to_JPY,
      "XR_ID"
      AS Exchange_Rates_ID,
      "TICKET_NUMBER"
      AS Exchange_Rates_Ticket_Number,
      "RUN_NO"
      AS Exchange_Rates_Run_Number,
      "PROCESS_RUN_NO"
      AS Exchange_Rates_Process_Run_Number;
      SQL SELECT *
      FROM
      $(vSchema)."D_EXCHANGE_RATES";

      STORE D_Exchange_Rates INTO $(vFolder_QVD)\D_EXCHANGE_RATES.QVD (QVD);
      DROP TABLE D_Exchange_Rates;



      Note that same lineage is shown in QVX_LastRun\QVDLineage.qvx.


      So, is the Governance Dashboard creating wrong lineage or should QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx

      be joined with with some other QVD/QVX files in order to produce correct information?

       

      Kind regards

      A.H.