Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi Team ,
We have a requirement where we have to load a subset of data from SAP ECC system to Databricks for a Cluster table BSEG.
Can we use full load passthrough filter in this scenario ?
If we use record selection filter , will it bring all the table data on Replicate server before filtering the records that need to be moved to the target ?
Thanks,
Amit
Hi,
First in general, when using passthru filte the criteria indicated in the filter is used in the where clause of the select command that is performed by Replicate. So, it selects from the database only the rows that meet the criteria.
Therfore the answere to your question is yes, you can use passthru filter. If you wish to perform partial full load you can use the passthru filter. FYI - the following community article includes explanation on how to do it.
FYI - if you use CDC filter then this filter the CDC changes after being read.
Regards,
Orit