topic Re: Pass thru filter in Qlik Replicate

Pass thru filter

suvbin — Fri, 26 Jan 2024 11:29:40 GMT

Hi Team,

We set the pass thru filter as

OBJTP='abc'

repctl.cfg --> the setting is already enabled for pass thru filter.

But its not working. the number of records its extracting is wrong. How to resolve this.

Does the task work for only full load task or will it work for full load + cdc task?

Thanks.

Re: Pass thru filter

john_wang — Fri, 26 Jan 2024 11:36:05 GMT

Hello @suvbin ,

Thanks for reaching out to Qlik Community!

Passthrough filter works for Full Load stage ONLY. it does not impact the CDC result.

Hope this helps.

John.

Re: Pass thru filter

suvbin — Fri, 26 Jan 2024 12:06:46 GMT

Thank you John for you response .

sorry for the confusion and asking you again .

Wanted to understand that this pass thru filter will work for full load only task . Am in correct ?

so our task is set for full load + cdc. And we enabled this pass thru filter .

and it is not working .

Re: Pass thru filter

john_wang — Fri, 26 Jan 2024 12:53:42 GMT

Hello @suvbin ,

Never mind for the confirmation, we're here to glad help, always 🙂

In Qlik Replicate, the 'filter' function is undertook by 3 different areas (see below). Their functions may be overlap, or they can cooperate with each other, depends on your needs. So far you can build up complex filter conditions in Qlik Replicate:

Filter Conditions
Impacts both Full Load and CDC
The "Filter Conditions" has best performance (as the expression will be executed in source side database if possible) but it does not support complex expressions
Record Selection Condition
Impacts both Full Load and CDC
The "Record Selection Condition" supports complex expressions include dynamic input values however the performance is not as good as "Filter Conditions", because in latter filter mode, the rows will be retrieved from source DB, transferred to Replicate machine then being filtered in Replicate server, prior to apply to target side database. It may take more resources (CPU, and especially IO and network)
Fullload Passthru Filter
Impacts Full LoadONLY (even the task is enabled both Full Load and CDC ). The query will be delivered to source DB for executing and retrieves needful rows and sends to target side.

I hope this clear out the doubts.

John.

Re: Pass thru filter

deepaksahirwar — Fri, 26 Jan 2024 13:07:38 GMT

Dear @suvbin ,

I have some solution to your query.

Make sure that the pass thru filter is enabled in the repctl.cfg file by adding the line “enable_passthrough_filter”: true.

Check the syntax of the filter and make sure it matches the source database. You can use SQLite syntax with filtering.

Verify that the filter is applied to the correct table and task. You can use the Filter tab in the Table Settings window.

IMP Note:

1. That the pass thru filter works only for the initial full load and not for the subsequent cdc changes.

2. If you want to filter the cdc changes, you may need to use a different method, such as a transformation or a target filter.

I hope this helps you.😊

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

Best Regards,

Deepak

Re: Pass thru filter

SushilKumar — Mon, 29 Jan 2024 10:35:33 GMT

Hello team,

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

Regards,

Sushil Kumar

Re: Pass thru filter

atk — Mon, 13 Apr 2026 18:56:28 GMT

@john_wang thanks for your explanation but I have a follow up question. I am currently using Fullload Passthru Filter in the Qlik on a date column and would like to use the same date column in parallel load to improve the performance of full load? Is that achievable ?

Re: Pass thru filter

john_wang — Wed, 15 Apr 2026 15:14:03 GMT

Hello @atk ,

Yes, the Full Load Passthrough Filter can be used together with Parallel Load on the same columns.

Regards,

John.