topic select 100 rows from Mongo in Qlik Replicate

select 100 rows from Mongo

jyeragi — Fri, 22 Apr 2022 23:10:25 GMT

How do I replicate 100 top or latest records from mongo to snowflake using QLIKreplicate.

Re: select 100 rows from Mongo

Dana_Baldwin — Fri, 22 Apr 2022 23:21:30 GMT

Here are some links on how to use a filter to achieve what you are looking for:

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Customize%20Tasks/task_expression_builder.htm?_ga=2.28535612.1645637533.1650662466-853514680.1627666136

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Customize%20Tasks/tasks_recordSelection.htm

https://help.qlik.com/en-US/replicate/May2021/Content/Global_Common/Content/SharedEMReplicate/Customize%20Tasks/tasks_expressOther.htm?_ga=2.28535612.1645637533.1650662466-853514680.1627666136

This link shows an example:

https://community.qlik.com/t5/Knowledge/Filter-for-last-90-days-of-data-in-Qlik-Replicate/ta-p/1880761

Regards,

Dana

Re: select 100 rows from Mongo

Heinvandenheuvel — Sat, 23 Apr 2022 12:46:03 GMT

Is this a repeating (daily? hourly?) activity, or a when-requested job?

Anyway, it seems to me that Replicate is too big a hammer for this job.

Hein

Re: select 100 rows from Mongo

john_wang — Sun, 24 Apr 2022 12:37:11 GMT

Hello @jyeragi , copy @Heinvandenheuvel @Dana_Baldwin ,

In Qlik Replicate MongoDB access is thru APIs (not thru SQL) and it's different than Relational DBs so the common filter does not work for MongoDB source Endpoint, eg "Fullload Passthru Filter" expression is totally ignored in MongoDB source task, no way to add the filter there for example ".limit(100)" - it does not work at all.

The available option in filter is using "_id" field. for common usage I create an dedicated article How to filter records by unique identifier "_id" in MongoDB source .

Hope it helps.

Regards,

John.

Re: select 100 rows from Mongo

jyeragi — Sun, 24 Apr 2022 15:23:01 GMT

Thanks John. That was the perfect example.

You are right the expression builder does not like the condition instead the filter condition works fine.

Re: select 100 rows from Mongo

john_wang — Mon, 20 Jun 2022 14:11:34 GMT

Hello @jyeragi ,

I got a better way for replicate 100 top or latest records from MongoDB: you may create a view in the same database which will map to the 100 top or latest records so far it's much easier for you to use the view in Replicate.

Hope this helps.

John.