Mongo - copy collection(s) with data from source MongoDb to target MongoDb

jvesely — Fri, 15 Nov 2024 23:26:37 GMT

Hi,

Definitely new to Talend, so please let me know if the details I supply aren't enough.

Input:

SourceDB name, IP, port.
TargetDB name, IP, port
List of collections

Ask:

Connect to source
For each collection in the list
- Create collection in target DB
- Copy all data from source to target

I guess the questions are:

1. Can this be done in Talend without having to specify the schema for each collection that has to be copied, so basically "taking the data as it comes" / dynamic schema?

2. If this can be done, is Talend even the best choice for this or would I be forcing circles into squares?

Thanks a lot,

Jan

Re: Mongo - copy collection(s) with data from source MongoDb to target MongoDb

jvesely — Tue, 07 Dec 2021 14:44:42 GMT

Found a solution:

Create Talend job to parse all the parameters
Create a Java routine to handle to collection copying, including documents and indexes
Let the job call the routine

topic Mongo - copy collection(s) with data from source MongoDb to target MongoDb in Talend Studio

Mongo - copy collection(s) with data from source MongoDb to target MongoDb

Re: Mongo - copy collection(s) with data from source MongoDb to target MongoDb