topic Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source in Qlik Replicate

Qlik Replication using AWS RDS Oracle database replicated by DMS as source

epanosian — Thu, 03 Nov 2022 15:39:27 GMT

Hello,

We have an AWS RDS Oracle database which is replicated using DMS (let's call it OR1). Now we would like to use OR1 (replicated Oracle database) as a Qlik Replicate source endpoint to send data to ADLS (target endpoint).

Is it feasible?

thank you,

Estifan

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

avidary_qlik — Fri, 04 Nov 2022 11:26:14 GMT

Hi team,

Assuming the RDS Oracle would act as a source in the replication task, there should not be any issue as this is supported. Our suggestion would be to consult if the bound limitations would suit your requirements, for instance, our log reader is quite performant, but has some inner limitations specifically for this endpoint during failover or server restart to consider:

https://help.qlik.com/en-US/replicate/May2022/Content/Global_Common/Content/SharedReplicateHDD/Oracle/OracleDBSource_RDS_limitations.htm

Since this would be something to better explore on a proof of concept,

We would suggest you reaching to your Qlik Account manager for you to evaluate the added value and feasibility of your project.

Please let us know if any additional questions related to the solution.

Best regards,

Avidar.

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

epanosian — Fri, 04 Nov 2022 12:08:58 GMT

RDS Oracle won't be the source. A replicated database using AWS/DMS will be the source.

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

avidary_qlik — Fri, 04 Nov 2022 12:33:10 GMT

Understood,

then why not use a direct pipeline from RDS to ADLS?

If not possible, what technology will hold the database at the end of DMS?

Thanks

Avidar

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

epanosian — Fri, 04 Nov 2022 14:17:53 GMT

1) Qlik Replicate is out standard tool to send data to ADLS.

2) Oracle (AWS)

thank you,

Estifan

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

avidary_qlik — Mon, 07 Nov 2022 10:50:43 GMT

Hi @epanosian

You can use replicate to move data from Oracle in AWS to ADLS.

Thanks

Avidar

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

epanosian — Thu, 10 Nov 2022 14:04:23 GMT

Hello,

1) Yes, I know I can use AWS to ADLS or I can use Qlik and AWS RDS

2) our standard tool to replicate from Oracle database to ADLS is Qlik.

3) this is a SaaS and vendor (because of let's assume performance) do not want to give Qlik access to source AWS RDS database and offered a database replicated by DMS.

so, question is: can I use DMS replicated AWS/RDS Oracle database as a source for Qlik to replicate to ADLS?

thank you,

Estifan

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

Bill_Steinagle — Fri, 11 Nov 2022 11:57:24 GMT

Estifan,

Hello thank you for the post to the QDI Forums. With the new Qlik Cloud Data Gateway see the link below where you could define this in the new environment with the new up and coming version of Replicate (QDI Data Integration).

https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Global_Common/Content/SharedReplicateHDD/Oracle/oracle_rds_prerequisites.htm

Thanks!

Bill

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

epanosian — Wed, 16 Nov 2022 18:39:54 GMT

Hello,

Probably I am missing something..

I am aware of "Working with Amazon RDS for Oracle". My question is : can I setup a replication using DMS replicated database (which itself is a replicated database from a 'Amazon RDS for Oracle' ) as a source ?

thank you,

Estifan

Re: Qlik Replication using AWS RDS Oracle database replicated by DMS as source

Bill_Steinagle — Wed, 16 Nov 2022 20:43:50 GMT

Estifan,

Thank you for the confirmation. I do not see the DMS Endpoint as a valid native connection however looking into the ODBC settings and we do have ODBC connection from Replicate as it has its limitations as well. Here is link to the ODBC for CDC as a Source. Hope this helps.

https://help.qlik.com/en-US/replicate/May2022/Content/Replicate/Main/ODBC%20with%20CDC/prereq_odbc.htm#ar_odbc_source_with_cdc_3709929996_13666

Thanks!

Bill