I recently watched a confluent-Qlik joint webinar where CDC DML as well as DDL changes in sql server were propagated to confluent kafka.
Does Qlik Replicate support Kafka as a source such that in one application, Qlik gets data from CDC source and puts into kafka sink and then in the second app, Qlik gets data from those kafka topics as a source and puts into snowflake and s3 as a sink ? The reason to do this is to avoid point to point integration and use kafka in the middle for real time latencies and multiple targets.
Depending upon the question above if kafka is supported as a source, we know that Qlik replicates DDL changes to Kafka from the source. Is the DDL change also migrated to snowflake from kafka source (assuming kafka as a source is supported)
Is the Qlik Log Stream concept the same as a kafka in the middle to handle back pressures and avoid point to point integrations ?
Replicate today doesn't support Kafka as a source.
Regarding the Log Stream, you are correct that log stream is designed to address the hub and spoke architecture reading once from the source and distributing data to multiple location to reduce performance impact on the source.
Replicate today doesn't support Kafka as a source.
Regarding the Log Stream, you are correct that log stream is designed to address the hub and spoke architecture reading once from the source and distributing data to multiple location to reduce performance impact on the source.
