MongoDB CDC with Oracle/Maria DB

[Anonymous]

Hi Guys,

I have an requirement to implement CDC from MongoDB to Oracle/Maria.Can we implement the same with Talend Big Data Integeration product? I read few documents that its supported in Talend Enterprise edition for few of the RDBMS. Needed to check if it will support NoSQL also(MongoDB)?

The answer will help me to go for licenses of Talend Big Data integeration product. If not , can you please suggest if any other ETL tool supports the same?

Thanks,

Ritu

[Anonymous]

Hi Ritu
MongoDB does not support CDC now.

Regards
Shong

[Anonymous]

Thanks Shong for quick reply.

[vapukov]

the answer:

MongoDB does not support CDC now.

need read as 

Talend still does not support CDC now. (and it true not only for MongoDB)

It not mean Talend bad, it great. it mean just - no one tools on market not cover all customers needs.

But we are happy and can combine technologies for achieve result.

https://www.mongodb.com/blog/post/mongodb-and-data-streaming-implementing-a-mongodb-kafka-consumer  https://www.mongodb.com/blog/post/tailing-mongodb-oplog-sharded-clusters

https://www.confluent.io/product/connectors/

https://github.com/debezium/debezium   http://debezium.io

https://streamsets.com/documentation/datacollector/2.5.0.0/help/index.html#Origins/MongoDBOplog.html

You can found ideas how to create MongoDB CDC producer on a links above, than use Talend as Kafka Consumer.

I do not not test this with MongoDB, but have tests with MySQL and it work as I need.