
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Qlik Replicate- How to create Kafka control topics per task?
I have a task that would get the data from DB2 and write to Kafka. I set-up the control topics following this doc - https://community.qlik.com/t5/Knowledge/How-to-use-control-tables-topics-attrep-status-attrep-histor...
I have a couple of questions -
- Can the control topic be set per task or for all tasks that have Kafka as target endpoint, the the tables will be common
- Is there a way to set these up such that the topic gets updated only if there is an update when using incremental. It seems, there is a message in the topic every few seconds even if there is no data coming in from source endpoint.
- If there are multiple tables in a Task, is there a way to get the separate count for each of the table, for updates, instead of single value that has count of all updates in all tables?
Thank you
- Subscribe by Topic:
-
Configuration
-
Connectivity - Sources or Targets
-
Functionality
-
General Question
- « Previous Replies
-
- 1
- 2
- Next Replies »

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@adbdkb you left a comma after the status table name. Please remove the below comma which I highlighted.
"table_name": "attrep_status_adb_sysname_tblnm_task1",
Thanks,
Swathi

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @SwathiPulagam - that worked. Really appreciate your help.
What is the maximum value it can be set to ( How many minutes ? ) I am trying to set it to 21600 ( 6 hrs ). Is that valid?
Also, what does "memory_keep_time" do? What values should it be set for?
"cdc_notification_period": 600,
"local_transactions_storage": {
"memory_keep_time": 120
}
Is there any place where I can check what the json attributes are for and their possible values / ranges, if any?
Thanks again for your support @SwathiPulagam

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @adbdkb ,
These are undocumented parameters, support will provide these parameters based on the requirement.
As i am aware, no minimum and maximum values are defined. you can test for 6 hrs and create a support case if you encounter any issues.
Thanks,
Swathi

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @adbdkb ,
"local_transactions_storage": {
"memory_keep_time": 120
}
The above setting will represent Transactional offload tuning. You can leave the default value as it is 60 seconds. These values are tuned by the Support or Professional Services team when required.
Thanks,
Swathi

- « Previous Replies
-
- 1
- 2
- Next Replies »