filer mongo db doc while full load in Qlik Replicate job

[psaxen2f]

hi,

i've mongodb collection having linear docs and wants to load data based on field value.

example:  here is my doc

{
"_id": "8f64c337-9352-405c-bf6d-9ccda9c46195",
"orderId": "8f64c337-9352-405c-bf6d-9ccda9c46195",
"harmonyOrderId": "test-1",
"harmonyFillRxTransId": "test-1",
"orderNbr": "1234",
"batchId": "2",22
"selectedDate": "Thu, Feb 12, 2021",
"selectedTime": "09:05 pm",
"userSelectedStore": "32045",
"createDateTm": "05/11/2021 17:51:54.662",

}

and want to load where "createDateTm" is equal or greater then 3 months from now.

Thanks in advance.

[john_wang · Accepted solution]

Hello @psaxen2f ,

Welcome to Qlik Community forum and thanks for reaching out here!

MongoDB access is different than other regular RDBMS or systems, it's impossible to filter it directly, see User Guide limitation Table content filters are not supported.

Looks to me there are some workarounds:

1- Define VIEW to filter the docs and access the VIEW in Qlik Replicate. however it works for Full Load ONLY task, it does not work for CDC.

2- We may try to use _id to filter records as partial of _id  values represents the doc creation time. Detailed information can be found at Replicate - How to filter records by unique identifier "_id" in MongoDB source.

Hope this helps.

John.

[psaxen2f]

Hi @john_wang ,

thank you so much for the quick help. i'll try the view option because _id field is using UUID kind of custom value so cant use the range feature.

Regards,

Pankaj Saxena

[john_wang]

Hello @psaxen2f ,

Thanks for the feedback!

Good luck with resolving the issue.

John.

[SushilKumar]

Hello team,

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

Regards,

Sushil Kumar