topic Re: QVW LineageInfo missing in QlikView

QVW LineageInfo missing

blaise — Wed, 13 Aug 2014 08:55:49 GMT

Hello fellow Qv'ers

Im trying to retrieve the qvw data lineage info from all my QVW but for some reason this data isn't present in the QVW when loading into QV as XML.

The lineage info resides in (XmlSimple, Table is [DocumentSummary/LineageInfo]).

Does anyone know why some qvw's doesn't have this info? I also have a lot of QVW's that also miss the DocumentSummary/FieldDescription and DocumentSummary/TableDescription.

Br Johan

Re: QVW LineageInfo missing

ashfaq_haseeb — Wed, 13 Aug 2014 09:00:44 GMT

Hi,

you need to look at QlikView Governance

Regards

ASHFAQ

Re: QVW LineageInfo missing

blaise — Wed, 13 Aug 2014 09:11:47 GMT

I would like to build my own app, Governance Dashboard includes way more info than i need for this particular project.

I have however asked the same question in the governance forum now.

Will also see if Governance dashboard can retreive the LineageInfo from my QVW but Im pretty sure It can't.

Re: QVW LineageInfo missing

ashfaq_haseeb — Thu, 14 Aug 2014 10:20:55 GMT

Hi,

rwunderlich can help you here.

Regards

ASHFAQ

Re: QVW LineageInfo missing

blaise — Thu, 14 Aug 2014 10:31:21 GMT

It looks like the dataLineage info is missing if the QVW doesn't include at least one (internal) table.

If I add a table to the qvw's that lacked LineageInfo and performed a reload the data becomes available.

Think I'll file a bug-report...

Re: QVW LineageInfo missing

Tyler_Waterfall — Mon, 18 Aug 2014 13:02:07 GMT

Johan Hessler - good observation - if there is no data stored in the qvw, then the LineageInfo element in the QVW xml footer (the 'metadata') is not present, at least not in 11.20 SR 4. So the QVW only stores lineageInfo for internal tables.

Am I correct in assuming that you have a 'layer' of QVWs which load/transform data and store out to QVDs and the drop the tables?

Re: QVW LineageInfo missing

blaise — Mon, 18 Aug 2014 13:10:56 GMT

Yes, most of my bigger implementations include a lot of "collect and store qvd" qvws. At least one per source system. After that I have the "transformation" step (sometimes one layer for each source system) and most likely a tranformation step per application before i actually consume and keep information in a qvw.

I solved my requirement by adding a dummy table to each "collect and store qvd" qvw but have today also started retreiving the "source files" info from the document log (so I can verify that the lineageInfo is reliable)

. Have a few implementations where the Qvw does different things based on weekday and day of month so i need to find a good to solve that.

Im thinking about running the LineageInfo collect for a month and based on history retrieve all source files or make use of the document logs in the publisher log directory (30 days history as a standard setting).

Re: QVW LineageInfo missing

rwunderlich — Mon, 18 Aug 2014 18:36:53 GMT

"most of my bigger implementations include a lot of "collect and store qvd" qvws"

The lineage info for a QVD can be found in the QVD itself.

-Rob

http://masterssummit.com

http://robwunderlich.com

Re: QVW LineageInfo missing

Tyler_Waterfall — Mon, 18 Aug 2014 19:19:14 GMT

Thanks Rob Wunderlich for the reminder!

Re: QVW LineageInfo missing

Anonymous — Wed, 25 May 2016 14:11:13 GMT

Hello twa‌,

Within the previous version of the Governance Dashboard if I wanted to know "loaders" that connect to the database I could filter TableLineage qvd file by Source_Type = "Database". As it was mentioned earlier in this conversation "empty QVW loaders" are usually used to extract and save data as qvd files. Taking into consideration that the newest version of QVGD (v2.0.1) is skipping "an empty" QVW files, would you advice how to filter "loaders" that connect to databases only, please?

Many thanks in advance for your help.

Best regards,

Janusz

Re: QVW LineageInfo missing

Tyler_Waterfall — Wed, 25 May 2016 19:27:47 GMT

janusz.twardziak‌ -

I'm not sure what you mean by

the newest version of QVGD (v2.0.1) is skipping "an empty" QVW files

QVGD 2.0.1 will load the existing metadata in the QVW, even for "empty" QVWs. However, there might not be lineage information for those empty QVWS. In which case you get the best lineage you can from the lineage in the QVDs.

I don't think this lineage in the QVDs includes database connection, though, which I think is your dilemma and question.

Is that correct?

Re: QVW LineageInfo missing

Anonymous — Thu, 26 May 2016 14:20:02 GMT

Hi twa‌

That's exactly what I meant. I'm aware of the QVD lineage information but there is no way to filter those QVDs created by extracting information from database. Any reason why it has been omitted?

Many thanks,

Janusz

Re: QVW LineageInfo missing

rwunderlich — Thu, 26 May 2016 16:55:28 GMT

QVDs do include the Connection string. If it's not reported in the QGD then perhaps it's just a change that needs to be made to QGD.

-Rob

Re: QVW LineageInfo missing

Tyler_Waterfall — Thu, 26 May 2016 18:23:36 GMT

Can you send me an example (QVD and/or GovDB that scanned QVDs) where you are seeing (or Not seeing) this connection as you would expect in the lineage metadata? twa@qlik.com

Re: QVW LineageInfo missing

Anonymous — Fri, 27 May 2016 09:56:38 GMT

Hello twa‌,

Thanks for your prompt replies.

The screenshot below shows exactly where I'm expecting to see the connection string or at least the information which QVDs were created by extracting information from database.

Am I missing something?

Many thanks in advance for your help.

Best regards,

Janusz

Re: QVW LineageInfo missing

Anonymous — Wed, 01 Jun 2016 08:43:21 GMT

Hello twa‌,

I'm not sure if you got my last reply. Would you find a minute to have a look, please?

Thanks,

Janusz

Re: QVW LineageInfo missing

rwunderlich — Wed, 01 Jun 2016 18:22:12 GMT

I just noticed that QV12 SR2 no longer writes LineageInfo to the QVD, as QV11 did. Not sure if this is by design or a bug. Either way an unpleasant change.

-Rob

http://masterssummit.com

http://qlikviewcookbook.com

Re: QVW LineageInfo missing

Anonymous — Thu, 02 Jun 2016 08:22:35 GMT

That would explain why this information is missing in the QVGD_QVDTableLineage data set.

Thanks a mill Rob for your help.

Tyler ( twa) would you advise, please?

Best regards,

Janusz

Re: QVW LineageInfo missing

rwunderlich — Thu, 02 Jun 2016 16:59:15 GMT

I've reported the missing Lineage data issue to Support.

I'll post any status updates here:

QV12 SR2 QVDs missing Lineage Info

-Rob

http://masterssummit.com

http://qlikviewcookbook.com

Re: QVW LineageInfo missing

Tyler_Waterfall — Tue, 07 Jun 2016 19:34:35 GMT

If the bug has been reported (thanks rwunderlich‌!) then we wait for Qlik R&D to fix it. If Rob has a bug # to share you could also report the issue and reference the bug - just to add more reason to fix it sooner than later.