topic Filter data in the table with date column in Qlik replicate task in Qlik Replicate

Filter data in the table with date column in Qlik replicate task

Naga_vivek — Thu, 14 Mar 2024 13:42:09 GMT

Hi Team

In one of our Qlik replicate task. we need to filter the full load data for one of the column with some date range (ex: Datarange column > 1 jan 2018).

1. only full load And we need to apply this filter

2.incremental data must not be filtered with this condition.

Is there any process that we can achieve this requirement through Qlik replicate. If so please let us know on the approach so we can follow.

Source end point : MS SQL server

Target Endpoint : CSV file.

Thanks

N Vivek

Re: Filter data in the table with date column in Qlik replicate task

john_wang — Thu, 14 Mar 2024 13:48:35 GMT

Hello @Naga_vivek ,

Thanks for reaching out to Qlik Community!

Yes, the Fullload Passthru Filter is what you are looking for.

Hope this helps.

John.

Re: Filter data in the table with date column in Qlik replicate task

aarun_arasu — Thu, 14 Mar 2024 14:21:26 GMT

Hello @Naga_vivek ,

You may refer to below article for more insight.

https://community.qlik.com/t5/Official-Support-Articles/Filter-for-last-90-days-of-data-in-Qlik-Replicate/ta-p/1880761

Regards

Arun

Re: Filter data in the table with date column in Qlik replicate task

Heinvandenheuvel — Thu, 14 Mar 2024 14:55:52 GMT

Full-load passthru as per @john_wang

If that for some reason is not desirable, then you can filter for the data field AND a header field like transaction id which will be zero for full-load.

Just create a small experiment with a tiny (5 rows?) narrow (3 columns ?) table with date and transform to add ALL the header columns. Now full-load, and then insert a few (2?) rows then and update on one and a delete on an other and evaluated the target. You'll see which header column suits you best to distinguish CDC events from full-load.

Re: Filter data in the table with date column in Qlik replicate task

DesmondWOO — Fri, 15 Mar 2024 04:34:17 GMT

Hi @Naga_vivek ,

Please find my example below:

FullLoad Passthru Filter does not provide "test" function to check the syntax. If you encounter error during full load, please set SOURCE_UNLOAD to TRACE level. You should find the complete SQL statement in the task log.

Regards,
Desmond