Qlik Replicate- How to create Kafka control topics per task?

[adbdkb]

I have a task that would get the data from DB2 and write to Kafka.  I set-up the control topics following this doc - https://community.qlik.com/t5/Knowledge/How-to-use-control-tables-topics-attrep-status-attrep-histor... 

I have a couple of questions -

1. Can the control topic be set per task or for all tasks that have Kafka as target endpoint, the the tables will be common
2. Is there a way to set these up such that the topic gets updated only if there is an update when using incremental.  It seems, there is a message in the topic every few seconds even if there is no data coming in from source endpoint.
3. If there are multiple tables in a Task, is there a way to get the separate count for each of the table, for updates, instead of single value that has count of all updates in all tables?

Thank you

[SwathiPulagam · Accepted solution]

@adbdkb  you left a comma after the status table name. Please remove the below comma which I highlighted. 

 "table_name": "attrep_status_adb_sysname_tblnm_task1",

Thanks,

Swathi

[adbdkb]

Thanks @SwathiPulagam - that worked.   Really appreciate your help.

What is the maximum value it can be set to ( How many minutes ? ) I am trying to set it to   21600 ( 6 hrs ).  Is that valid?

Also, what does "memory_keep_time" do?  What values should it be set for?

"cdc_notification_period":   600,
    "local_transactions_storage": {
             "memory_keep_time":  120
                      }

Is there any place where I can check what the json attributes are for and their possible values / ranges, if any?

Thanks again for your support @SwathiPulagam 

[SwathiPulagam · Accepted solution]

Hi @adbdkb ,

These are undocumented parameters, support will provide these parameters based on the requirement.

As i am aware, no minimum and maximum values are defined. you can test for 6 hrs and create a support case if you encounter any issues.

Thanks,

Swathi

[SwathiPulagam · Accepted solution]

Hi @adbdkb ,

"local_transactions_storage": {

             "memory_keep_time":  120

                      }

The above setting will represent Transactional offload tuning. You can leave the default value as it is 60 seconds. These values are tuned by the Support or Professional Services team when required.

Thanks,

Swathi