Do not (full) load data if source is empty and send a notification if this is the case
Unfortunately, we have the challenge that certain source systems sporadically do not provide any data. In these cases zero records are simply transferred to the target db without generating any error. However, it would still be better for us to keep the outdated data from the last run than to truncate the table and load nothing to it.
Is there a way in Replicate to prevent a full load in case the source table is completely empty?
Ideally, we should also receive a notification if the full load has been suspended due to the missing data. What are the possibilities here?
Unfortunately, I have not made any progress in my search for a solution here.
Source data type could be AWS Aurora Cloud for PostgreSQL and Microsoft SQL Server.
Regarding suspention of a table, it is possible to define a notification rule for suspention of table. This can be done using the notification of type: 'Tasks Events' --> 'Errors and warnings'--> 'Table processing was suspended due to errors'
Regarding the question: 'Is there a way in Replicate to prevent a full load in case the source table is completely empty' - Replicate does not have any option for conditional Replication. i.e. when task is run it will run according the setting that were defined and it will take the source data as it is.
If you wish, you can open an ideation request for the functionality that you would like to have.
Regarding suspention of a table, it is possible to define a notification rule for suspention of table. This can be done using the notification of type: 'Tasks Events' --> 'Errors and warnings'--> 'Table processing was suspended due to errors'
Regarding the question: 'Is there a way in Replicate to prevent a full load in case the source table is completely empty' - Replicate does not have any option for conditional Replication. i.e. when task is run it will run according the setting that were defined and it will take the source data as it is.
If you wish, you can open an ideation request for the functionality that you would like to have.
