Hi, I’m working on creating a Lineage app used to analyze the apps across all streams in my Qlik Sense environment, including which files (QVD, Excel, TXT, etc.) are used as input files and which files are created by the apps.
I’m using the monitor_apps_REST_app, which connects via REST. First, I use it to fetch all apps in the environment. Then, I use the endpoint:
GET /v1/apps/{appId}/data/lineage
to retrieve the following:
statement (string): The LOAD and SELECT script statements from the data load script.
discriminator (string): A string indicating the origin of the data:
[filename]: the data comes from a local file
INLINE: the data is entered inline in the load script
RESIDENT: the data comes from a resident table. The table name is listed
AUTOGENERATE: the data is generated from the script
Provider: the data comes from a data connection (the connector source name is listed)
[webfile]: the data comes from a web-based file
STORE: path to QVD or TXT file where data is stored
EXTENSION: the data comes from a Server Side Extension (SSE)
However, the GET /v1/apps/{appId}/data/lineage endpoint does not retrieve all input and output files used or created in each app.
Last time I looked, there were some limitations in the lineage data. Tables that were dropped in the script may not be included in the lineage data, depending on when they were dropped. You can see this problem for example in a QVD generator script that STOREs a QVD and then drops the table.
