set Operation not working as expected in tMongoDBOutput
Hi,
This is regarding a data migration project, where we have to update data in Mongo DB.
We have a collection in Mongo with multiple arrays and objects. The total count of documents in that collection is 600 million. In that there is a particular object with 5 fields inside it. The objective is to build a pipeline to integrate data from multiple source tables and then update that particular object (2 existing fields and add a new field).
In Mongo, we use the $set operation to update values of specific fields without disturbing the other fields.
Similarly, in Talend, we tried using the set operation and it completely overwrites the object. The fields inside the object that are not part of the update are getting removed. The object is left with the new field and the 2 fields which were updated.
Is this expected behavior in Talend? Or is there any other way to perform update operation on Mongo through Talend.
