Automatically enable Change Data Feed on each table from Qlik Replicate

[MoeE]

Hi,

A client needs to enable Change Data Feed on their target tables. Change Data Feed is a setting in Databricks. As they are using Databricks SQL Warehouse type compute, they are forced to enable it on each table manually. 

I am wondering if there is an internal parameter which allows us to enable this on each table automatically from the Qlik Replicate side? Otherwise, the alternative is to run a full load, stop the task, then enable the setting on each table manually.

Help with this is much appreciated as always. If there is no solution, that's ok. Thank you!

Regards,

Mohammed

[DesmondWOO · Accepted solution]

Hi @MoeE ,

We don't have internal parameters to enable the change data feed.

According to the Databricks website, we can enable the change data feed option through the CREATE TABLE statement. I suggest you try editing the syntax file, but I haven't tested it myself. 

Regarding customizing the syntax file, you can refer to this article: Qlik Replicate: How to custom target endpoint syntax.

Regards,
Desmond

[MoeE]

Hi Desmond,

Thanks for the help.

Regards,

Mohammed

[MoeE]

Hi Desmond,

Is it possible to edit the "query_syntax" section of the provider syntax.json file to add an additional new custom query that will execute on each table when the task is stopped and resumed? e.g add a new query called "add_change_data_feed":   "alter table ..."

or

Can I only edit the pre-existing queries here? 

Regards,

Mohammed

[DesmondWOO]

Hi @MoeE ,

Based on my understanding, we cannot add a new query. Additionally, not all queries are eligible for modification.

Regards,
Desmond

[MoeE]

Hi Desmond,

Ok thanks for the info.

Regards,

Mohammed