Pass thru filter

[suvbin]

Hi Team,

We set the pass thru filter as 

OBJTP='abc'

repctl.cfg --> the setting is already enabled for pass thru filter.

But its not working. the number of records its extracting is wrong. How to resolve this.

Does the task work for only full load task or will it work for full load + cdc task?

Thanks.

[john_wang]

Hello @suvbin ,

Thanks for reaching out to Qlik Community!

Passthrough filter works for Full Load stage ONLY. it does not impact the CDC result.

Hope this helps.

John.

[suvbin]

Thank you John for you response .

sorry for the confusion and asking you again .

Wanted to understand that this pass thru filter will work for full load only task . Am in correct ?

so our task is set for full load + cdc. And we enabled this pass thru filter . 

and it is not working . 

[john_wang · Accepted solution]

Hello @suvbin ,

Never mind for the confirmation, we're here to glad help, always 🙂

In Qlik Replicate, the 'filter' function is undertook by 3 different areas (see below). Their functions may be overlap, or they can cooperate with each other, depends on your needs. So far you can build up complex filter conditions in Qlik Replicate:

1. Filter Conditions
   Impacts both Full Load and CDC 
   The "Filter Conditions" has best performance (as the expression will be executed in source side database if possible) but it does not support complex expressions
2. Record Selection Condition
   Impacts both Full Load and CDC 
   The "Record Selection Condition" supports complex expressions include dynamic input values however the performance is not as good as "Filter Conditions", because in latter filter mode, the rows will be retrieved from source DB, transferred to Replicate machine then being filtered in Replicate server, prior to apply to target side database. It may take more resources (CPU, and especially IO and network)
   
3. Fullload Passthru Filter
   Impacts Full LoadONLY (even the task is enabled both Full Load and CDC ). The query will be delivered to source DB for executing and retrieves needful rows and sends to target side.

I hope this clear out the doubts.

John.

[deepaksahirwar]

Dear @suvbin ,

I have some solution to your query.

Make sure that the pass thru filter is enabled in the repctl.cfg file by adding the line “enable_passthrough_filter”: true.

Check the syntax of the filter and make sure it matches the source database. You can use SQLite syntax with filtering.

Verify that the filter is applied to the correct table and task. You can use the Filter tab in the Table Settings window.

IMP Note:

1. That the pass thru filter works only for the initial full load and not for the subsequent cdc changes. 

2. If you want to filter the cdc changes, you may need to use a different method, such as a transformation or a target filter.

I hope this helps you.😊

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

Best Regards,

Deepak 

[SushilKumar]

Hello team,

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

Regards,

Sushil Kumar