Qlik Community

Ask a Question

Suggest an Idea

Vote for your favorite Qlik product ideas and add your own suggestions.

Announcements
QlikWorld Online 2021, May 10-12: Our Free, Virtual, Global Event REGISTER TODAY

Kafka - Confluent Schema Registry access via Proxy

jjames
Partner
Partner

Kafka - Confluent Schema Registry access via Proxy

Hi,

One of our customers is using the Kafka offering by Confluent cloud as a data streaming platform. The data is streamed from various RDBMS sources to the Kafka instance using Qlik Replicate as a CDC solution. 

Qlik Replicate does not support Confluent Schema registry access via proxy. Because of this, the customer is forced to establish the connection without any proxy which is against the infosec policies. The request is to make product enhancements so that Kafka endpoint can support connections to schema registry via proxy servers.

Apparently, we have other cloud target endpoints like Kinesis / S3 which support similar settings.

Appreciate your help in getting this accepted in the product roadmap.

Thanks,

jjames

8 Comments
EyalSilner
Employee
Employee

Hi,

Just to make sure we understand your request -

Kafka endpoint is required to support connections to Schema Registry via proxy servers, but on the other hand, the connection to the Kafka brokers may continue to operate not via a proxy? (The other cloud target endpoints, like Kinesis, do not support Schema Registry, so we are not entirely sure about the comparison).

Thanks,

Eyal.

 

jjames
Partner
Partner

Hi,

The request is to enable access to the schema registry via proxy. The current connection to Kafka brokers works fine as is(no proxy necessary). If not relevant, please ignore the comparison to Kinesis.

Thanks,

jjames

EyalSilner
Employee
Employee

Hi Jjames,

We would like to clarify the Proxy requirements, so we all do not waste time on something your customer doesn’t need.

Currently, the basic configuration is Proxy Host and Proxy Port.

Several questions:

  1. Does the customer require from Replicate to use an HTTP or HTTPS connection (HTTPS means configuring an SSL certificate authority)?
  2. Does the customer require from Replicate to use authentication when connecting to a proxy? Currently, Replicate assumes HTTP basic (User/Pass) authentication - is this the appropriate authentication method for your customer?

Thanks,

Eyal.

jjames
Partner
Partner

Hi Eyal,

 

Please see below the answers.

1) HTTP

2) It does not require authentication to be used.

 

Thanks,

jjames

Shelley_Brennan
Employee
Employee

Thank you for the additional information.  We are planning support for this item and would like to collect additional feedback as well to see if this would benefit other customers.

Status changed to: Open - On Roadmap
DataGuyAtHeart
Contributor III
Contributor III

This is something my company needs also. Thanks!

DataFlow_Eng
Contributor
Contributor

Hello Confluent Schema Register support Confluent Role Based Access Control RBAC in order to manage the user authenticate to the SR it needs BASIC AUTH AUTHENITCATION to the schema register, seems this option is missing as well , and would be appreciated if it would be added. 

DataFlow_Eng
Contributor
Contributor

This is something my company needs also. Thanks!