Skip to main content
Announcements
UPGRADE ADVISORY for Qlik Replicate 2024.5: Read More
cancel
Showing results for 
Search instead for 
Did you mean: 
Greg_Pagan
Contributor III
Contributor III

Create List of Tables assigned to Tasks

We have an issue where people are using the same tables in multiple tasks and that is causing some data problems when they use the same target end points.  Is there a way to create a list of the tables being used in a tasks?  And if that can be done, can we pick other information to include on the report like transformations being done on the table?  It would be best if we could do it through the console but if necessary we could use the APIs to do it as well if the information were available there.  

Labels (1)
1 Solution

Accepted Solutions
Heinvandenheuvel
Specialist III
Specialist III

Hmm, sounds like you really have a people/project problem which you are trying to solve with technology. I understand a potential 'trust but verify' situation but really your first approach for this should be within the projects.

Working with a GUI- point - click - point -click - point -click ad infinitum doesn't seem a robust way to solve this.

Come up with a simple database of schemas,tables,tasks,project-owners and last touch date? Now you may want to seed such database from what is out there.

Years ago I create a Perl script, probably the one @PGN refers to, to list tables and manipulations  from a json input file. I'll attach it.  The problem with that is/was is that it must rely on EXPLICIT tables,. If a wild-card is used then we no longer control what is processed.

You might want to use "REPCTL GETTABLESSTATUS" (or comparable EM API) instead of relying on what the JSON promises.

I'd even be tempted to the  "table_descs.json" from "REPCTL DUMPMETADATA". The beauty there is that this can be done 'leisurely' by an intern or similar on a copy of the dynamic_metadata.sqlite collection, completely away from the (production) replicate server(s). (with a skeleton replicate install perhaps to get 'repctl').

Good luck,

Hein

 

View solution in original post

7 Replies
PGN
Creator II
Creator II

There are some Perl scripts that are available; I believe there might be some Powershell flavors as well.  If someone from support doesn't provide them, I can upload the one I use here.  If you have QLIK Enterprise Manager, that may have some tools, but I'm not sure (we don't have it, but I've heard it may offer more tools).

Heinvandenheuvel
Specialist III
Specialist III

Hmm, sounds like you really have a people/project problem which you are trying to solve with technology. I understand a potential 'trust but verify' situation but really your first approach for this should be within the projects.

Working with a GUI- point - click - point -click - point -click ad infinitum doesn't seem a robust way to solve this.

Come up with a simple database of schemas,tables,tasks,project-owners and last touch date? Now you may want to seed such database from what is out there.

Years ago I create a Perl script, probably the one @PGN refers to, to list tables and manipulations  from a json input file. I'll attach it.  The problem with that is/was is that it must rely on EXPLICIT tables,. If a wild-card is used then we no longer control what is processed.

You might want to use "REPCTL GETTABLESSTATUS" (or comparable EM API) instead of relying on what the JSON promises.

I'd even be tempted to the  "table_descs.json" from "REPCTL DUMPMETADATA". The beauty there is that this can be done 'leisurely' by an intern or similar on a copy of the dynamic_metadata.sqlite collection, completely away from the (production) replicate server(s). (with a skeleton replicate install perhaps to get 'repctl').

Good luck,

Hein

 

PGN
Creator II
Creator II

We've done what Hein recommends.  Export the table/task info and store it in the database flavor of your choice.  Mine is SQL Server, others have used the most widely available one:  Excel.  That way when someone asks, "How did that table get there?" (In David Byrne's voice), I can easily check.

Greg_Pagan
Contributor III
Contributor III
Author

I have passed along the both the control and programmatic solutions mentioned in the replies.  I appreciate the your time and hopefully the export of the task and table information will be adopted by my customers. 

DanielHernandezCaro
Contributor
Contributor

Hi could you share the comands to export the table/task info? Thanks. I have been try with REPCTL DUMPMETADATA but I don't kown how to use. 

sureshkumar
Support
Support

john_wang
Support
Support

One way getting a task's tables list is in Replicate console GUI:

Designer --> Full Table List --> Export To TSV

john_wang_1-1727573475483.png

All tables involved in the task, including those selected through Patterns, will be listed in the TSV file.

Hope this helps.

John.

 

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!