idea Re: Kafka - Confluent Schema Registry access via Proxy - Status changed to: Delivered in Suggest an Idea

Kafka - Confluent Schema Registry access via Proxy

jjames — Wed, 18 Nov 2020 03:46:41 GMT

Hi,

One of our customers is using the Kafka offering by Confluent cloud as a data streaming platform. The data is streamed from various RDBMS sources to the Kafka instance using Qlik Replicate as a CDC solution.

Qlik Replicate does not support Confluent Schema registry access via proxy. Because of this, the customer is forced to establish the connection without any proxy which is against the infosec policies. The request is to make product enhancements so that Kafka endpoint can support connections to schema registry via proxy servers.

Apparently, we have other cloud target endpoints like Kinesis / S3 which support similar settings.

Appreciate your help in getting this accepted in the product roadmap.

Thanks,

jjames

Re: Kafka - Confluent Schema Registry access via Proxy

EyalSilner — Tue, 24 Nov 2020 21:55:16 GMT

Hi,

Just to make sure we understand your request -

Kafka endpoint is required to support connections to Schema Registry via proxy servers, but on the other hand, the connection to the Kafka brokers may continue to operate not via a proxy? (The other cloud target endpoints, like Kinesis, do not support Schema Registry, so we are not entirely sure about the comparison).

Thanks,

Eyal.

Re: Kafka - Confluent Schema Registry access via Proxy

jjames — Mon, 30 Nov 2020 22:41:47 GMT

Hi,

The request is to enable access to the schema registry via proxy. The current connection to Kafka brokers works fine as is(no proxy necessary). If not relevant, please ignore the comparison to Kinesis.

Thanks,

jjames

Re: Kafka - Confluent Schema Registry access via Proxy

EyalSilner — Thu, 17 Dec 2020 14:07:45 GMT

Hi Jjames,

We would like to clarify the Proxy requirements, so we all do not waste time on something your customer doesn’t need.

Currently, the basic configuration is Proxy Host and Proxy Port.

Several questions:

Does the customer require from Replicate to use an HTTP or HTTPS connection (HTTPS means configuring an SSL certificate authority)?
Does the customer require from Replicate to use authentication when connecting to a proxy? Currently, Replicate assumes HTTP basic (User/Pass) authentication - is this the appropriate authentication method for your customer?

Thanks,

Eyal.

Re: Kafka - Confluent Schema Registry access via Proxy

jjames — Tue, 22 Dec 2020 21:53:48 GMT

Hi Eyal,

Please see below the answers.

1) HTTP

2) It does not require authentication to be used.

Thanks,

jjames

Re: Kafka - Confluent Schema Registry access via Proxy - Status changed to: Open - On Roadmap

Shelley_Brennan — Mon, 28 Dec 2020 14:42:34 GMT

Thank you for the additional information. We are planning support for this item and would like to collect additional feedback as well to see if this would benefit other customers.

Re: Kafka - Confluent Schema Registry access via Proxy

DataGuyAtHeart — Tue, 19 Jan 2021 16:37:01 GMT

This is something my company needs also. Thanks!

Re: Kafka - Confluent Schema Registry access via Proxy

DataFlow_Eng — Thu, 08 Apr 2021 08:34:16 GMT

Hello Confluent Schema Register support Confluent Role Based Access Control RBAC in order to manage the user authenticate to the SR it needs BASIC AUTH AUTHENITCATION to the schema register, seems this option is missing as well , and would be appreciated if it would be added.

Re: Kafka - Confluent Schema Registry access via Proxy

DataFlow_Eng — Thu, 08 Apr 2021 08:35:13 GMT

This is something my company needs also. Thanks!

Re: Kafka - Confluent Schema Registry access via Proxy - Status changed to: Delivered

Shelley_Brennan — Thu, 13 May 2021 14:59:15 GMT

Support for accessing Confluent Schema Registry via proxy is now supported with the May 2021 release. Thank you!