Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Possible wrong data lineage

Hi

I have a task of representing data lineage in a custom app, hence I have some questions regarding Governance Dashboard data lineage files stored in QVX_LastRun and QVX_LastRun-folder folders.

For me it seems like data from QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx shows wrong data lineage from time to time.


Let me demonstrate the information found in TableLineage.QVD (just 4 columns to show source and target):

QVDLineage2.png


From this picture it looks like D_EXCHANGE_RATES.QVD gets data from multiple QV tables (see LOADStatement). In reality it is only one of them, D_Exchange_Details, that populates the QVD-file.

Here is script code from D:\QLIKVIEW\LIVE\SOURCEDOCUMENTS\DM0005\QVD_Load_DM0005_ProjectLog.qvw showing how D_EXCHANGE_RATES.QVD gets populated:


D_Exchange_Rates:
LOAD
"EUR_TO_JPY"
AS Exchange_Rates_EUR_to_JPY,
"EUR_TO_USD"
AS Exchange_Rates_EUR_to_USD,
"JPY_TO_EUR"
AS Exchange_Rates_JPY_to_EUR,
"JPY_TO_USD"
AS Exchange_Rates_JPY_to_USD,
"USD_TO_EUR"
AS Exchange_Rates_USD_to_EUR,
"USD_TO_JPY"
AS Exchange_Rates_USD_to_JPY,
"XR_ID"
AS Exchange_Rates_ID,
"TICKET_NUMBER"
AS Exchange_Rates_Ticket_Number,
"RUN_NO"
AS Exchange_Rates_Run_Number,
"PROCESS_RUN_NO"
AS Exchange_Rates_Process_Run_Number;
SQL SELECT *
FROM
$(vSchema)."D_EXCHANGE_RATES";

STORE D_Exchange_Rates INTO $(vFolder_QVD)\D_EXCHANGE_RATES.QVD (QVD);
DROP TABLE D_Exchange_Rates;



Note that same lineage is shown in QVX_LastRun\QVDLineage.qvx.


So, is the Governance Dashboard creating wrong lineage or should QVD_Historical\TableLineage.QVD or QVX_LastRun\QVDLineage.qvx

be joined with with some other QVD/QVX files in order to produce correct information?

Kind regards

A.H.

0 Replies