topic Re: Do not (full) load data if source is empty and send a notification if this is the case in Qlik Replicate

Do not (full) load data if source is empty and send a notification if this is the case

JonasK — Mon, 05 Jun 2023 05:12:22 GMT

Unfortunately, we have the challenge that certain source systems sporadically do not provide any data. In these cases zero records are simply transferred to the target db without generating any error. However, it would still be better for us to keep the outdated data from the last run than to truncate the table and load nothing to it.

Is there a way in Replicate to prevent a full load in case the source table is completely empty?

Ideally, we should also receive a notification if the full load has been suspended due to the missing data. What are the possibilities here?

Unfortunately, I have not made any progress in my search for a solution here.

Source data type could be AWS Aurora Cloud for PostgreSQL and Microsoft SQL Server.

Target date type is Oracle.

Many thanks in advance!

Jonas

Re: Do not (full) load data if source is empty and send a notification if this is the case

OritA — Mon, 05 Jun 2023 07:46:52 GMT

Hi Jonas,

Regarding suspention of a table, it is possible to define a notification rule for suspention of table. This can be done using the notification of type: 'Tasks Events' --> 'Errors and warnings'--> 'Table processing was suspended due to errors'

Regarding the question: 'Is there a way in Replicate to prevent a full load in case the source table is completely empty' - Replicate does not have any option for conditional Replication. i.e. when task is run it will run according the setting that were defined and it will take the source data as it is.

If you wish, you can open an ideation request for the functionality that you would like to have.

Thanks & regards,

Orit

Re: Do not (full) load data if source is empty and send a notification if this is the case

JonasK — Mon, 05 Jun 2023 12:58:21 GMT

Hi Orit,
Thanks a lot for your reply and your reference to the ideation process!

BR
Jonas

Re: Do not (full) load data if source is empty and send a notification if this is the case

Dana_Baldwin — Mon, 05 Jun 2023 22:31:33 GMT

Help users find answers! Don't forget to mark a solution that worked for you! If already marked, give it a thumbs up!