topic Re: Kafka Topic parameters (acks= -1) is not at all considering in Qlik Replicate

Kafka Topic parameters (acks= -1) is not at all considering

murali23krishna — Tue, 12 Dec 2023 14:12:18 GMT

Hello Team,

We are evaluating the Kafka endpoint from Qlik and as part of that we are trying to use the tuning parameters, but I came across the below situation where I tried to configure both Kafka global and topic-level parameters using the internal parameters section as shown below, but the reload was failing always for the below reason, even though the value set as -1(all), could someone help me to understand what I am missing here?

Your response would be appreciated.

Regards,

Murali.

Re: Kafka Topic parameters (acks= -1) is not at all considering

john_wang — Tue, 12 Dec 2023 14:34:44 GMT

Hello @murali23krishna ,

Thanks for reaching out to Qlik Community!

The reason is when the enable.idempotence is set to true, we need set the the acks=all explicitly (even it's default value is all implicitly). Please add acks=all in "rdkafkaProperties" connection string and try again.

Hope this helps.

Regards,

John.

Re: Kafka Topic parameters (acks= -1) is not at all considering

murali23krishna — Tue, 12 Dec 2023 15:21:43 GMT

Thanks, it worked, again my question is acks=all is rdkafkaTopicProperties isn't it? why we need to add it under rdkafkaProperties property?

Re: Kafka Topic parameters (acks= -1) is not at all considering

DesmondWOO — Wed, 13 Dec 2023 11:19:08 GMT

Hi @murali23krishna ,

When enable.idempotence configuration is set to true, acks is required to be set to all.

Regards,
Desmond