topic Re: Separate topic for each table configuration in Qlik Replicate

Separate topic for each table configuration

murali23krishna — Thu, 14 Dec 2023 05:04:56 GMT

Hello Team,

I have used a separate topic for each table configuration, and my question is, from where the topic configuration will be considered to create a topic in the Kafka Cluster by the Qlik, since we have not provided any configuration such as how many partitions the topic should have and their replication factor etc?

Re: Separate topic for each table configuration

john_wang — Thu, 14 Dec 2023 05:59:01 GMT

Hello @murali23krishna ,

Thanks for reaching out to Qlik Community!

We may overwrite topic name by $topic - To write messages to a specific topic, and it's same for other variables include partition number and key name etc.

Hope this helps.

Regards,

John.

Re: Separate topic for each table configuration

murali23krishna — Thu, 14 Dec 2023 06:54:22 GMT

Hi Thanks for the reply, I would be interested on how the topics are created by the qlik replicate when we use Kafka as target endpoint. What is the basis for creating topic and its configuration.

Re: Separate topic for each table configuration

john_wang — Thu, 14 Dec 2023 14:35:31 GMT

Hello @murali23krishna ,

Thanks for your feedback.

There are options to create topic:

create the topic manually prior to Qlik Replicate task running. Please check out Apache web page of the command kafka-topics --create --topic
if the Kafka server was configured with property auto.create.topics.enable = true then Qlik Replicate can create the topic automatically instead of use manual creation if the topic does not exist. The detailed information can be found in Apache web page Broker Configs.

Hope this helps.

Regards,

John.