topic Re: Can I use Query Based CDC for Hadoop ? in Qlik Replicate

Can I use Query Based CDC for Hadoop ?

khchoy — Mon, 08 Feb 2021 06:37:35 GMT

Hi,

Currently , Hadoop source endpoint only supported Full load Task.

If I use Query based CDC (ODBC with CDC) , Can i use Apply change Task ?

Regards,

Kwangho

Re: Can I use Query Based CDC for Hadoop ?

lyka — Tue, 09 Feb 2021 20:39:16 GMT

Hello,

Please note that The ODBC with CDC source endpoint can be used to access sources that are not included in
Qlik Replicate’s extensive Support Matrix. However, unless enabled through Professional
Services and approved by your Account Manager, the ODBC with CDC source endpoint
should not be used. Additionally, the ODBC with CDC source endpoint should not be used to
access any sources already listed in the Support Matrix.

You should be able to use this as source for a CDC task. The option to enable "Apply Changes" depends on the target. For example if its going to hadoop target, with "apply changes" turned on then this limitation applies:

UPDATE/DELETE DMLs are not supported during change processing. If an UPDATE/DELETE DML
was captured on the source, it will be ignored on the target and a warning will be written to the log. If
the Store Changes option is enabled in the task settings, these records will be written to the Change
Table.

If you need to use ODBC with CDC, please reach out to your Account Rep or Professional Services.

Thanks,

Lyka

Re: Can I use Query Based CDC for Hadoop ?

khchoy — Wed, 10 Feb 2021 00:21:54 GMT

Thanks Lyka.

One of partner ask me about Hadoop source .

If I use Hadoop source with the ODBC with CDC (Query based CDC) and other supported target endpoint, Does target endpoint is same or have some limitation ?

Regards

Kwangho

Re: Can I use Query Based CDC for Hadoop ?

lyka — Wed, 10 Feb 2021 00:39:09 GMT

Hello,

That limitation i shared is only for Hadoop target - if using other target, please refer to the Replicate User Guide for a list of limitations.

If you plan to use Hadoop as a source via ODBC with CDC, please reach out to your Account Rep.

Thanks,

Lyka

Re: Can I use Query Based CDC for Hadoop ?

khchoy — Wed, 10 Feb 2021 03:01:13 GMT

Thanks a lot , Lyka.

I will do. your answer is very helpful for me.

Regards,

KwangHo