select 100 rows from Mongo

[jyeragi]

How do I replicate 100 top or latest records from mongo to snowflake using QLIKreplicate.

[Dana_Baldwin · Accepted solution]

Hi @jyeragi 

Here are some links on how to use a filter to achieve what you are looking for:

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Custom...

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Custom...

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Custom...

This link shows an example:

https://community.qlik.com/t5/Knowledge/Filter-for-last-90-days-of-data-in-Qlik-Replicate/ta-p/18807...

Regards,

Dana

[Heinvandenheuvel]

Is this a repeating (daily? hourly?) activity, or a when-requested job?

Anyway, it seems to me that Replicate is too big a hammer for this job.

Hein

[john_wang · Accepted solution]

Hello @jyeragi , copy @Heinvandenheuvel  @Dana_Baldwin ,

In Qlik Replicate MongoDB access is thru APIs (not thru SQL) and it's different than Relational DBs so the common filter does not work for MongoDB source Endpoint, eg "Fullload Passthru Filter" expression is totally ignored in MongoDB source task, no way to add the filter there for example ".limit(100)" - it does not work at all.

The available option in filter is using "_id" field. for common usage I create an dedicated article How to filter records by unique identifier "_id" in MongoDB source  .

Hope it helps.

Regards,

John.

[jyeragi]

Thanks John. That was the perfect example.

You are right the expression builder does not like the condition instead the filter condition works fine.

[john_wang]

Hello @jyeragi ,

I got a better way for replicate 100 top or latest records from MongoDB: you may create a view in the same database which will map to the 100 top or latest records so far it's much easier for you to use the view in Replicate.

Hope this helps.

John.