How to use control tables(topics) attrep_status attrep_history attrep_apply_exceptions in Qlik Replicate Kafka endpoint

[john_wang]

Introduction:

This post is meant to explain how to use the control tables(topics) in Kafka EndPoint. These internal topics include:

• attrep_apply_exceptions
• attrep_status
• attrep_suspended_tables
• attrep_history

Sometimes users report the above topics were not created or not found in Kafka target endpoint.

First of these internal control topics need to be enabled in task setting , likes:

Then there are two different usages, see below detailed information.

Detailed information:

When using the Kafka target endpoint, there are two different way to decide where the messages go to.

In Kafka target endpoint setting:

1. "Publish the data to" --> "Specific topic"

    In this scenario, all the internal control messages go to the same topic, in my sample it's topic "v1.topic.qlik":

    

2. "Publish the data to" --> "Separate topic for each table" 

    In this scenario the above named topics need to exist to record the potential errors in the task. Users can either create the named topics before starting the replication task or configure the brokers with  auto.create.topics.enable=true in config/server.properties.

    

    

 

Environment

Qlik Replicate 

Internal Investigation ID(s):

00024935