Filters on Cluster and Pool tables

amitw — Wed, 31 Jul 2024 12:19:05 GMT

Hi Team ,

We have a requirement where we have to load a subset of data from SAP ECC system to Databricks for a Cluster table BSEG.

Can we use full load passthrough filter in this scenario ?

If we use record selection filter , will it bring all the table data on Replicate server before filtering the records that need to be moved to the target ?

Thanks,

Amit

Re: Filters on Cluster and Pool tables

OritA — Thu, 01 Aug 2024 07:43:34 GMT

Hi,

First in general, when using passthru filte the criteria indicated in the filter is used in the where clause of the select command that is performed by Replicate. So, it selects from the database only the rows that meet the criteria.
Therfore the answere to your question is yes, you can use passthru filter. If you wish to perform partial full load you can use the passthru filter. FYI - the following community article includes explanation on how to do it.

https://community.qlik.com/t5/Official-Support-Articles/Qlik-Cloud-Data-Integration-How-to-enable-Full-Load-Passthru/ta-p/2433033

FYI - if you use CDC filter then this filter the CDC changes after being read.

Regards,

Orit

topic Re: Filters on Cluster and Pool tables in Qlik Replicate

Filters on Cluster and Pool tables

Re: Filters on Cluster and Pool tables