Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I need to filter the data from the source and it is the same column and the same filter for all tables in a Task. is there a way to create a global filter like the global transformation?
Hello @pnvsriram ,
Yes, it's easy. You can use Global Filter to achieve that. Global Filter is supported from Replicate version 2021.5. If you are running lower versions eg 6.6/7.0 then you need upgrade to version 2021.5.
I'm pasting my demo, it filters rows based on the common column "ID" (in the filter expression you use "$ID") which appears in all tables, if the value of "ID" is larger than 2 then the rows will be replicated to target side, otherwise will be ignored. It take actions for both Full Load and CDC.
Hope this helps.
Regards,
John.
Steps to create the global filter:
Hi @john_wang
thank you so much, you're right I'm on an older version and using the tool from the AWS market place and I have to find a way to upgrade to the latest version.
Hello @pnvsriram ,
Yes, it's easy. You can use Global Filter to achieve that. Global Filter is supported from Replicate version 2021.5. If you are running lower versions eg 6.6/7.0 then you need upgrade to version 2021.5.
I'm pasting my demo, it filters rows based on the common column "ID" (in the filter expression you use "$ID") which appears in all tables, if the value of "ID" is larger than 2 then the rows will be replicated to target side, otherwise will be ignored. It take actions for both Full Load and CDC.
Hope this helps.
Regards,
John.
Steps to create the global filter:
Hi @john_wang
thank you so much, you're right I'm on an older version and using the tool from the AWS market place and I have to find a way to upgrade to the latest version.