Connectivity Issue for using Kafka as a target.

[sush_1]

Hi Team,

We are facing below mentioned error while connecting to the Kafka broker.

• SYS-E-HTTPFAIL, SYS-E-HTTPFAIL, RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-1.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY, 1 identical error(s) suppressed)..
• SYS,GENERAL_EXCEPTION,SYS-E-HTTPFAIL, RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-1.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY, 1 identical error(s) suppressed).,SYS,GENERAL_EXCEPTION,RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-1.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY, 1 identical error(s) suppressed),RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-2.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY, 1 identical error(s) suppressed) RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-1.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY) RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-2.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Failed to initialize SASL authentication: SASL Handshake not supported by broker (required by mechanism SCRAM-SHA-512) (after 0ms in state AUTH_LEGACY) RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-1.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 87ms in state APIVERSION_QUERY) RDKAFKA - 3 - ERROR: [thrd:app]: rdkafka#producer-20: sasl_plaintext://b-2.cmdevmskclusterprovis.5q5plc.c3.kafka.ap-south-1.amazonaws.com:9096/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 94ms in state APIVERSION_QUERY) Failed to get Kafka metadata: Local: Broker transport failure. _TRANSPORT

Other details :

Qlik Replicate Version : May- 2022

Apache Kafka version - 3.6.0

Authentication Method - SASL/SCRAM authentication

Protocol: SASL_SSL

Please help us in resolving this issue.

Regards,

Sushant

[john_wang]

Hello @sush_1 ,

Could you confirm whether other Kafka tools or clients are able to connect to the cluster using SASL authentication?

We recommend opening a support ticket with the task logging target_apply/target_load set to Verbose, and uploading the corresponding task diagnostic package. This will help our support team analyze the issue in detail, we'll be more than happy to assist you further.

Regards,

John.