How to use control tables(topics) attrep_status attrep_history attrep_apply_exceptions in Qlik Replicate Kafka endpoint

john_wang — Wed, 16 Feb 2022 10:14:44 GMT

Introduction:

This post is meant to explain how to use the control tables(topics) in Kafka EndPoint. These internal topics include:

attrep_apply_exceptions
attrep_status
attrep_suspended_tables
attrep_history

Sometimes users report the above topics were not created or not found in Kafka target endpoint.

First of these internal control topics need to be enabled in task setting , likes:

Then there are two different usages, see below detailed information.

Detailed information:

When using the Kafka target endpoint, there are two different way to decide where the messages go to.

In Kafka target endpoint setting:

1. "Publish the data to" --> "Specific topic"

In this scenario, all the internal control messages go to the same topic, in my sample it's topic "v1.topic.qlik":

2. "Publish the data to" --> "Separate topic for each table"

In this scenario the above named topics need to exist to record the potential errors in the task. Users can either create the named topics before starting the replication task or configure the brokers with auto.create.topics.enable=true in config/server.properties.

Environment

Internal Investigation ID(s):

00024935

article How to use control tables(topics) attrep_status attrep_history attrep_apply_exceptions in Qlik Replicate Kafka endpoint in Official Support Articles

How to use control tables(topics) attrep_status attrep_history attrep_apply_exceptions in Qlik Replicate Kafka endpoint

Introduction:

Detailed information:

Environment

Internal Investigation ID(s):