Skip to main content
Announcements
UPGRADE ADVISORY for Qlik Replicate 2024.5: Read More
cancel
Showing results for 
Search instead for 
Did you mean: 
adbdkb
Creator

Qlik Replicate- How to create Kafka control topics per task?

I have a task that would get the data from DB2 and write to Kafka.  I set-up the control topics following this doc - https://community.qlik.com/t5/Knowledge/How-to-use-control-tables-topics-attrep-status-attrep-histor... 

I have a couple of questions -

  1. Can the control topic be set per task or for all tasks that have Kafka as target endpoint, the the tables will be common
  2. Is there a way to set these up such that the topic gets updated only if there is an update when using incremental.  It seems, there is a message in the topic every few seconds even if there is no data coming in from source endpoint.
  3. If there are multiple tables in a Task, is there a way to get the separate count for each of the table, for updates, instead of single value that has count of all updates in all tables?

Thank you

 

 

 

13 Replies
SwathiPulagam
Support

@adbdkb  you left a comma after the status table name. Please remove the below comma which I highlighted. 

 

 "table_name": "attrep_status_adb_sysname_tblnm_task1",

 

Thanks,

Swathi

adbdkb
Creator
Author

Thanks @SwathiPulagam - that worked.   Really appreciate your help.

What is the maximum value it can be set to ( How many minutes ? ) I am trying to set it to   21600 ( 6 hrs ).  Is that valid?

Also, what does "memory_keep_time" do?  What values should it be set for?

 

"cdc_notification_period":   600,
    "local_transactions_storage": {
             "memory_keep_time":  120
                      }

 

Is there any place where I can check what the json attributes are for and their possible values / ranges, if any?

 

Thanks again for your support @SwathiPulagam 

SwathiPulagam
Support

Hi @adbdkb ,

 

These are undocumented parameters, support will provide these parameters based on the requirement.

As i am aware, no minimum and maximum values are defined. you can test for 6 hrs and create a support case if you encounter any issues.

 

Thanks,

Swathi

SwathiPulagam
Support

Hi @adbdkb ,

 

"local_transactions_storage": {

             "memory_keep_time":  120

                      }

The above setting will represent Transactional offload tuning. You can leave the default value as it is 60 seconds. These values are tuned by the Support or Professional Services team when required.

 

SwathiPulagam_1-1657807991957.png

 

Thanks,

Swathi