Data migrate from MongoDb to Sql server

[ZuhaibRana]

i am trying to migrate data from MongoDb to Sql server. MongoDb using as a Source and Sql server using as a target in qlik replicate. i am getting following errors.

1

Task 'Mongo db to sql server' encountered a recoverable error

2

Stream component 'st_0_Mongodb' terminated
Stream component failed at subtask 0, component st_0_Mongodb
Error executing source loop

3

Capture loop failed
Failed to start MongoDB watcher.

4

An error occurred during capture changes

5

Failed to start Change Processing from specified time (Timestamp{value=7108998699761532928, seconds=1655192743, inc=0})

[Vaibhav_19]

Hi @John wang

please help us with

we are Replicating data from MongoDB to BigQuery while prforming CDC we are getting same error as above but we can perform Full-Load easily.

Can you please confirm wheather we can perform CDC on Standlone MongoDB instance.

Following are the error:

1 Failed to start Change Processing from specified time (Timestamp{value=7397330334062215168, seconds=1722325183, inc=0})

2 An error occurred during capture changes

3 Capture loop failed
Failed to start MongoDB watcher.

4 Task 'Mongo_to_BQ' encountered a recoverable error

5 Stream component 'st_0_MongoDB_SRC' terminated
Stream component failed at subtask 0, component st_0_MongoDB_SRC
Error executing source loop

Thanks

[sureshkumar]

Hello @Vaibhav_19 

This Error normally happen when your source Monog DB is not compatible with Qlik replicate version.

Kindly let us know what the Qlik Replication version is and Mongo DB version?

Regards,

Suresh

[john_wang]

Hello @Vaibhav_19 ,

A standalone MongoDB instance does not support replication and high availability, hence it's impossible to run MongoDB watcher() API as No OpLog is available in the instance. The minimize requirement is a 3 nodes replica set cluster.

Regards,

John.

[Vaibhav_19]

Thanks!! SureshKumar and John for the quick response.

@sureshkumar , Using Qlik Replicate Version - MAY-2024 and MongoDB Version - "7.0.7"

[john_wang · Accepted solution]

Hello @Vaibhav_19 ,

I'm sure MongoDB version 7 is supported, see Support Matrix of Qlik Replicate 2024.5. The problem is irrelevant to MongoDB version.

Instead, the requirement is that: To enable Replicate to detect changes, MongoDB databases servers must be set up in a replica set configuration. 

Hope this helps.

John.

[Vaibhav_19]

Yes , John you are right the issue is not with MongoDB version.

The Replica set configuration is not enable on MongoDB Database Server we requested for oplog generation on MongoDB Database Server.

[john_wang]

Thank you for your feedback @Vaibhav_19 .

If you do not mind please press the "Accept as Solution" to helps users find answers.

Best Regards,

John.