topic Re: Qlik replicate CDC to RabbitMQ in Qlik Replicate

Qlik replicate CDC to RabbitMQ

ankuranand — Wed, 06 Apr 2022 16:46:20 GMT

I see Qlik replicate can push CDC to Kafka but can it also push messages to RabbitMQ?

Re: Qlik replicate CDC to RabbitMQ

lyka — Wed, 06 Apr 2022 16:48:50 GMT

Hello,

RabbitMQ is not listed as a supported target endpoint for Replicate.

For a complete list, please refer to:

https://help.qlik.com/en-US/replicate/November2021/Content/Replicate/Main/Support%20Matrix/supported_target_endpoints.htm#ar_app_supported_dbversions_993761142_1341803

To submit a feature request, please use this link:

"Getting Started with Ideas": https://community.qlik.com/t5/Qlik-Product-Insight-Blog/Getting-Started-with-Ideas/ba-p/1684011

Thanks

Lyka

Re: Qlik replicate CDC to RabbitMQ

ankuranand — Wed, 06 Apr 2022 18:43:57 GMT

Thanks Lyka.

I am trying to push QLIK as the tool of choice for data replication at my work. Does QLIK behind the scene use a publisher-subscriber approach where an instance of QLIK runs close to the publisher database and another instance runs close to the subscriber database and then there is a "messaging bus" that transfers data between the two?

My team is looking to build in-house replication on the pub-sub model with a queue in the middle. But if QLIK has a similar structure than there is no point building a similar system in-house.

Thanks,

Ankur

Re: Qlik replicate CDC to RabbitMQ

lyka — Wed, 06 Apr 2022 18:59:40 GMT

Hi Ankur,

Im not sure what your use case so i will suggest to open a support case.

Here's a video and short demo of Replicate -in case you need it

https://www.youtube.com/watch?v=3UBa5WgOfio

Thanks

Lyka

Re: Qlik replicate CDC to RabbitMQ

Michael_Litz — Wed, 06 Apr 2022 19:07:46 GMT

Hi Ankur,

It sounds like Qlik replicate will be a good fit for yo0ur replication project. Replicate has many options on how to configure "Tasks" which will copy data from a source to a target database. A replicate task usually has two phases, A full Load phase where the underlying tables are copied from source to target, and CDC phase where replicate typically reads source transaction logs to process changes to the target.

Unless using the Log stream task pair architecture replicate will normally move data directly from the source to the target database. With a Log Stream task there is an intermediate level staging area where the target side task will read from. This type of task is best suited for when you have a single source and multiple target databases.

Re: Qlik replicate CDC to RabbitMQ

lyka — Thu, 07 Apr 2022 15:58:11 GMT

Hi ankuranand,

With regards to you original question on this thread, please submit a feature request thru our Ideation.

Thanks

Lyka