topic Exceptions handling for Google BigQuery as a target in Qlik Replicate

Exceptions handling for Google BigQuery as a target

vdna101 — Tue, 13 Feb 2024 12:43:37 GMT

currently Qlik Replicate doesn't support exceptions table error handling option for BigQuery.
See https://help.qlik.com/en-US/replicate/November2023/Content/Replicate/Main/Google%20Cloud%20BigQuery/bigquery_limitations_postgresql_source.htm

- Are there any plans to support the exceptions table error handling option for BigQuery in Qlik Replicate?

- Are there some aletrnative methods to handle and track exceptions?

- Will error-related information (incl. SQL-Statement) be stored in the log file with the log level set to "trace"?

For example: when error on insert due to the wrong timestamp format occurs?

- Any Other ideas?

Re: Exceptions handling for Google BigQuery as a target

sureshkumar — Tue, 13 Feb 2024 13:28:44 GMT

Hello @vdna101

If the option "Apply changes using SQL MERGE" in Change Processing Tuning is unchecked, then log exception table option will be enabled in Apply Conflicts.

Regards,
Suresh

Re: Exceptions handling for Google BigQuery as a target

vdna101 — Tue, 13 Feb 2024 14:03:59 GMT

Hi Suresh
attrep_apply_exceptions is currently not supported for the Big Query as a target according to Qlik Replicate Documentation.

Re: Exceptions handling for Google BigQuery as a target

sureshkumar — Thu, 15 Feb 2024 01:55:02 GMT

Hello @vdna101

I agree with you, but when we uncheck the option "Apply changes using SQL MERGE", we can set the exception table in Apply conflicts settings. Kindly test it once.

Regards,

Suresh

Re: Exceptions handling for Google BigQuery as a target

DesmondWOO — Thu, 15 Feb 2024 07:06:27 GMT

Hi @vdna101 ,

Let's say, cannot find a record to update (0 rows affected), the update statement will be logged into the attrep_apply_exception table.

Regarding "The Log record to the exceptions table error handling option for Apply Conflicts and Data Errors is not supported.", I think it may be a limitation with using SQL MERGE. I would suggest to create a support ticket to verify with R&D.

Regards,
Desmond

Re: Exceptions handling for Google BigQuery as a target

vdna101 — Fri, 16 Feb 2024 09:13:22 GMT

Hello Suresh and Desmond

thank you very much for your support.

Our test with Qlik Replicate applying changes to Big Query target shows, that the attrep_apply_exception table gets a new error log record (0 rows affected) when an update on a non existing record in the target table occurs.

The real system behavior in that case differs from the documented limitation:
"The Log record to the exceptions table error handling option for Apply Conflicts and Data Errors is not supported."

Best Regards, Vadim

Re: Exceptions handling for Google BigQuery as a target

DesmondWOO — Fri, 16 Feb 2024 09:42:55 GMT

Hi @vdna101 ,

As the behavior differs from the documentation, I would suggest to create a support ticket to clarify the behavior.

Regards,
Desmond

Re: Exceptions handling for Google BigQuery as a target

vdna101 — Fri, 16 Feb 2024 10:06:21 GMT

thank you, support ticket created