idea Re: Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source in Suggest an Idea

Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source

Adam_Brillhart — Tue, 23 Feb 2021 18:59:12 GMT

We are using Replicate with a MongoDB Source and an Oracle Target.

We would really like the AR_H_COMMIT_TIMESTAMP/AR_H_TIMESTAMP header columns to be populated with a timestamp value that has greater precision than a second.

Other sources populate those columns down to the millisecond, but it only goes down to the second with a MongoDB Source.

The MongoDB Oplog does contain a commit timestamp field that has the greater precision, but the current one that is being pulled from the Oplog only goes down to the second.

Re: Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source - Status changed to: Open - Collecting Feedback

Shelley_Brennan — Mon, 08 Mar 2021 13:54:04 GMT

Replicate relies on the official MongoDB Change Streams API which only reports on the commit timestamp down to the second, not millisecond. It may be stored in the Oplog in milliseconds but Replicate is not designed to read directly from Oplog. I would suggest opening a case with MongoDB support to see if they can expose the timestamp in milliseconds via the API at which point Replicate could report on the data you are looking for. And we will raise this with MongoDB support as well on our side.

Re: Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source

Adam_Brillhart — Mon, 12 Apr 2021 15:14:22 GMT

@Shelley_Brennan

Hi Shelley,

I was wondering if you could tell me the specific API call from from the MongoDB Change Streams API that is being used by Replicate to get that commit timestamp value?
I'm not sure if you have raised a MongoDB Support ticket yet, but we will use that info to raise a MongoDB Support ticket as well.

Thanks.

Re: Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source

Shelley_Brennan — Thu, 22 Apr 2021 12:46:58 GMT

Yes, we rely on https://docs.mongodb.com/manual/reference/change-events/ - specifically clusterTime.

From now on, please track this idea from the Ideation por...

Meghann_MacDonald — Wed, 02 Aug 2023 16:16:31 GMT

From now on, please track this idea from the Ideation portal.

Link to new idea

Meghann

NOTE: Upon clicking this link 2 tabs may open - please feel free to close the one with a login page. If you only see 1 tab with the login page, please try clicking this link first: Authenticate me! then try the link above again. Ensure pop-up blocker is off.

Re: Replicate - Add millisecond precision to Commit Timestamp (header column) for MongoDB Source - Status changed to: Closed - Archived

Ideation — Wed, 02 Aug 2023 16:16:33 GMT