Skip to main content
Announcements
UPGRADE ADVISORY for Qlik Replicate 2024.5: Read More
cancel
Showing results for 
Search instead for 
Did you mean: 
ZuhaibRana
Partner - Contributor III
Partner - Contributor III

Data migrate from MongoDb to Sql server

i am trying to migrate data from MongoDb to Sql server. MongoDb using as a Source and Sql server using as a target in qlik replicate. i am getting following errors.

1

Task 'Mongo db to sql server' encountered a recoverable error

2

Stream component 'st_0_Mongodb' terminated
Stream component failed at subtask 0, component st_0_Mongodb
Error executing source loop

3

Capture loop failed
Failed to start MongoDB watcher.

4

An error occurred during capture changes

5

Failed to start Change Processing from specified time (Timestamp{value=7108998699761532928, seconds=1655192743, inc=0})

16 Replies
Vaibhav_19
Partner - Contributor II
Partner - Contributor II

Hi @John wang

please help us with

we are Replicating data from MongoDB to BigQuery while prforming CDC we are getting same error as above but we can perform Full-Load easily.

Can you please confirm wheather we can perform CDC on Standlone MongoDB instance.

Following are the error:

1 Failed to start Change Processing from specified time (Timestamp{value=7397330334062215168, seconds=1722325183, inc=0})

2 An error occurred during capture changes

3 Capture loop failed
Failed to start MongoDB watcher.

4 Task 'Mongo_to_BQ' encountered a recoverable error

5 Stream component 'st_0_MongoDB_SRC' terminated
Stream component failed at subtask 0, component st_0_MongoDB_SRC
Error executing source loop

Thanks

sureshkumar
Support
Support

Hello @Vaibhav_19 

This Error normally happen when your source Monog DB is not compatible with Qlik replicate version.

Kindly let us know what the Qlik Replication version is and Mongo DB version?

 

Regards,

Suresh

john_wang
Support
Support

Hello @Vaibhav_19 ,

standalone MongoDB instance does not support replication and high availability, hence it's impossible to run MongoDB watcher() API as No OpLog is available in the instance. The minimize requirement is a 3 nodes replica set cluster.

Regards,

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
Vaibhav_19
Partner - Contributor II
Partner - Contributor II

Thanks!! SureshKumar and John for the quick response.

@sureshkumar , Using Qlik Replicate Version - MAY-2024 and MongoDB Version - "7.0.7"

john_wang
Support
Support

Hello @Vaibhav_19 ,

I'm sure MongoDB version 7 is supported, see Support Matrix of Qlik Replicate 2024.5. The problem is irrelevant to MongoDB version.

Instead, the requirement is that: To enable Replicate to detect changes, MongoDB databases servers must be set up in a replica set configuration

Hope this helps.

John.

 

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
Vaibhav_19
Partner - Contributor II
Partner - Contributor II

Yes , John you are right the issue is not with MongoDB version.

The Replica set configuration is not enable on MongoDB Database Server we requested for oplog generation on MongoDB Database Server.

john_wang
Support
Support

Thank you for your feedback @Vaibhav_19 .

If you do not mind please press the "Accept as Solution" to helps users find answers.

Best Regards,

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!