topic Re: MongoDB CDC with Oracle/Maria DB in Talend Studio

MongoDB CDC with Oracle/Maria DB

Anonymous — Sat, 16 Nov 2024 09:49:31 GMT

Hi Guys,

I have an requirement to implement CDC from MongoDB to Oracle/Maria.Can we implement the same with Talend Big Data Integeration product? I read few documents that its supported in Talend Enterprise edition for few of the RDBMS. Needed to check if it will support NoSQL also(MongoDB)?

The answer will help me to go for licenses of Talend Big Data integeration product. If not , can you please suggest if any other ETL tool supports the same?

Thanks,

Ritu

Re: MongoDB CDC with Oracle/Maria DB

Anonymous — Fri, 05 May 2017 08:23:37 GMT

Hi Ritu
MongoDB does not support CDC now.

Regards
Shong

Re: MongoDB CDC with Oracle/Maria DB

Anonymous — Fri, 05 May 2017 15:38:39 GMT

Thanks Shong for quick reply.

Re: MongoDB CDC with Oracle/Maria DB

vapukov — Sun, 07 May 2017 01:08:24 GMT

the answer:

MongoDB does not support CDC now.

need read as

Talend still does not support CDC now. (and it true not only for MongoDB)

It not mean Talend bad, it great. it mean just - no one tools on market not cover all customers needs.

But we are happy and can combine technologies for achieve result.

https://www.mongodb.com/blog/post/mongodb-and-data-streaming-implementing-a-mongodb-kafka-consumer https://www.mongodb.com/blog/post/tailing-mongodb-oplog-sharded-clusters

https://www.confluent.io/product/connectors/

https://github.com/debezium/debezium http://debezium.io

https://streamsets.com/documentation/datacollector/2.5.0.0/help/index.html#Origins/MongoDBOplog.html

You can found ideas how to create MongoDB CDC producer on a links above, than use Talend as Kafka Consumer.

I do not not test this with MongoDB, but have tests with MySQL and it work as I need.