Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
We have an issue where people are using the same tables in multiple tasks and that is causing some data problems when they use the same target end points. Is there a way to create a list of the tables being used in a tasks? And if that can be done, can we pick other information to include on the report like transformations being done on the table? It would be best if we could do it through the console but if necessary we could use the APIs to do it as well if the information were available there.
Hmm, sounds like you really have a people/project problem which you are trying to solve with technology. I understand a potential 'trust but verify' situation but really your first approach for this should be within the projects.
Working with a GUI- point - click - point -click - point -click ad infinitum doesn't seem a robust way to solve this.
Come up with a simple database of schemas,tables,tasks,project-owners and last touch date? Now you may want to seed such database from what is out there.
Years ago I create a Perl script, probably the one @PGN refers to, to list tables and manipulations from a json input file. I'll attach it. The problem with that is/was is that it must rely on EXPLICIT tables,. If a wild-card is used then we no longer control what is processed.
You might want to use "REPCTL GETTABLESSTATUS" (or comparable EM API) instead of relying on what the JSON promises.
I'd even be tempted to the "table_descs.json" from "REPCTL DUMPMETADATA". The beauty there is that this can be done 'leisurely' by an intern or similar on a copy of the dynamic_metadata.sqlite collection, completely away from the (production) replicate server(s). (with a skeleton replicate install perhaps to get 'repctl').
Good luck,
Hein
There are some Perl scripts that are available; I believe there might be some Powershell flavors as well. If someone from support doesn't provide them, I can upload the one I use here. If you have QLIK Enterprise Manager, that may have some tools, but I'm not sure (we don't have it, but I've heard it may offer more tools).
Hmm, sounds like you really have a people/project problem which you are trying to solve with technology. I understand a potential 'trust but verify' situation but really your first approach for this should be within the projects.
Working with a GUI- point - click - point -click - point -click ad infinitum doesn't seem a robust way to solve this.
Come up with a simple database of schemas,tables,tasks,project-owners and last touch date? Now you may want to seed such database from what is out there.
Years ago I create a Perl script, probably the one @PGN refers to, to list tables and manipulations from a json input file. I'll attach it. The problem with that is/was is that it must rely on EXPLICIT tables,. If a wild-card is used then we no longer control what is processed.
You might want to use "REPCTL GETTABLESSTATUS" (or comparable EM API) instead of relying on what the JSON promises.
I'd even be tempted to the "table_descs.json" from "REPCTL DUMPMETADATA". The beauty there is that this can be done 'leisurely' by an intern or similar on a copy of the dynamic_metadata.sqlite collection, completely away from the (production) replicate server(s). (with a skeleton replicate install perhaps to get 'repctl').
Good luck,
Hein
We've done what Hein recommends. Export the table/task info and store it in the database flavor of your choice. Mine is SQL Server, others have used the most widely available one: Excel. That way when someone asks, "How did that table get there?" (In David Byrne's voice), I can easily check.
I have passed along the both the control and programmatic solutions mentioned in the replies. I appreciate the your time and hopefully the export of the task and table information will be adopted by my customers.
Hi could you share the comands to export the table/task info? Thanks. I have been try with REPCTL DUMPMETADATA but I don't kown how to use.
Hello @DanielHernandezCaro
Kindly refer the below article
Backing up or Exporting Tasks from Qlik Replicate - Qlik Community - 1909596
Regards,
Suresh
One way getting a task's tables list is in Replicate console GUI:
Designer --> Full Table List --> Export To TSV
All tables involved in the task, including those selected through Patterns, will be listed in the TSV file.
Hope this helps.
John.