Qlik Community

QlikView Scripting

Discussion Board for collaboration on QlikView Scripting.

Announcements

Breathe easy -- you now have more time to plan your next steps with Qlik!
QlikView 11.2 Extended Support is now valid through December 31, 2020. Click here for more information.

Not applicable

Possible wrong data lineage

Hi

I have a task of representing data lineage in a custom app, hence I have some questions regarding Governance Dashboard data lineage files stored in QVX_LastRun and QVX_LastRun-folder folders.

For me it seems like data from QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx shows wrong data lineage from time to time.


Let me demonstrate the information found in TableLineage.QVD (just 4 columns to show source and target):

QVDLineage2.png


From this picture it looks like D_EXCHANGE_RATES.QVD gets data from multiple QV tables (see LOADStatement). In reality it is only one of them, D_Exchange_Details, that populates the QVD-file.

Here is script code from D:\QLIKVIEW\LIVE\SOURCEDOCUMENTS\DM0005\QVD_Load_DM0005_ProjectLog.qvw showing how D_EXCHANGE_RATES.QVD gets populated:


D_Exchange_Rates:
LOAD
"EUR_TO_JPY"
AS Exchange_Rates_EUR_to_JPY,
"EUR_TO_USD"
AS Exchange_Rates_EUR_to_USD,
"JPY_TO_EUR"
AS Exchange_Rates_JPY_to_EUR,
"JPY_TO_USD"
AS Exchange_Rates_JPY_to_USD,
"USD_TO_EUR"
AS Exchange_Rates_USD_to_EUR,
"USD_TO_JPY"
AS Exchange_Rates_USD_to_JPY,
"XR_ID"
AS Exchange_Rates_ID,
"TICKET_NUMBER"
AS Exchange_Rates_Ticket_Number,
"RUN_NO"
AS Exchange_Rates_Run_Number,
"PROCESS_RUN_NO"
AS Exchange_Rates_Process_Run_Number;
SQL SELECT *
FROM
$(vSchema)."D_EXCHANGE_RATES";

STORE D_Exchange_Rates INTO $(vFolder_QVD)\D_EXCHANGE_RATES.QVD (QVD);
DROP TABLE D_Exchange_Rates;



Note that same lineage is shown in QVX_LastRun\QVDLineage.qvx.


So, is the Governance Dashboard creating wrong lineage or should QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx

be joined with with some other QVD/QVX files in order to produce correct information?

Kind regards

A.H.