
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Get source table count and insert into target audit table
My source is MSSQL and target is snowflake. For each FULL Load or CDC data load from source tables, I should capture the counts and insert into snowflake audit table. How should I achieve this?
- Subscribe by Topic:
-
Connectivity - Sources or Targets
-
Functionality
-
General Question

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
WHY? Not kidding. The purpose of the data collected may well help to define the better answer.
The question is posed is vague and wrong. What data is desired in the audit table and when?
Probably task-name, start-time, end-time?, server name? per task - yes? per-table - yes?
What about CDC? There is no such thing as 'CDC data load'. What is that supposed to mean? CDC is ongoing. Are you interested in CDC activity per time interval? Minutes? Hours? Days? per-table surely? per-operation?
Maybe just start by enabling attrep_history tables in task settings and see what that provides and from there what more might be required/desired. Unfortunately that does not have per table information.
Do you have the Enterprise Manager available? It's Analytics section may well just offer all you need. The better solutions probably involve using the Enterprise Manager API and calls like - GetTableStatuses - to get last full-load times and counts, as well as some (Transient! - lost over task stop/start) CDC into.
Without Enterprise Manager you may be stuck using REPCTL and use gettaskstatus and/or gettablesstatus there.
For the absolute fullest insight into CDC activity you may need to enable 'task settings' -> 'Apply Changes Settings' -> 'Store Changes Settings'
If this is a serious business requirement then I urge you to work with the QLIK Professional Services team to provide advice and implementation help, as the wording of your question suggests that there may be a an awful lot to learn in this space.
Cheers,
Hein
