Error Handling of CDC task

iti-attunity-sup — Fri, 10 May 2024 09:26:52 GMT

Hello Experts

Our customer has upgraded v2022.05 to v2023.11 and encountered the problem below:

In 2022.05, when the following warning occurred, CDC task continued without any errors.

[TARGET_LOAD ]I: Load finished for table 'ADM'.'XXXXX' (Id = 1). 85627944 rows received. 0 rows skipped. Volume transferred 98611582288. (streamcomponent.c:3976)
[TARGET_LOAD ]I: TPT statistics for table 'REP.YYYYY': Operator=LOAD, CPU time=1115.296875, Received Rows=85627944, Sent Rows=85627944, Applied Rows=85627917 (teradata_tpt_engine.cpp:778)
[TARGET_LOAD ]W: Not all rows have been loaded successfully for 'REP'.'YYYYY' due to possible 'TPT LOAD' errors. Consult Target 'xxxx_E?' / 'xxxx_L?' Error / Log tables contents. (teradata_tpt_engine.cpp:786)
[TARGET_LOAD ]I: teradata_terminate_tpt(...) successfully applied conn->Terminate() method for task identified by UUID '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_tpt_engine.cpp:839)
[TASK_MANAGER ]I: Loading finished for table 'ADM'.'XXXXX' (Id = 1) by subtask 1. 85627944 records transferred. (replicationtask.c:3012)
[TARGET_LOAD ]I: teradata_stop_imp(...) stopping task identified by UUID '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_endpoint_imp.c:857)
[TARGET_LOAD ]I: teradata_free(...) freeing resources for task identified by UUID '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_endpoint_imp.c:878)
[TARGET_LOAD ]I: teradata_disconnect(...) disconnecting for task identified by UUID '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_endpoint_imp.c:92)
[TARGET_LOAD ]I: teradata_disconnect(...) disconnecting Data Connection succeeded for task identified by '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_endpoint_imp.c:104)
[TARGET_LOAD ]I: teradata_disconnect(...) No active Lookup Connection to disconnect from was detected for task identified by '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_endpoint_imp.c:122)
[TASK_MANAGER ]I: Subtask #1 ended (replicationtask_util.c:591)

However the behavior has changed after upgrading to v2023.11.
After the same warning occurred, it is detected as an error and the table is suspended.

[TARGET_LOAD ]I: Load finished for table 'ADM'.'XXXXX' (Id = 1). 85986652 rows received. 0 rows skipped. Volume transferred 99014228864. (streamcomponent.c:4076)
[TARGET_LOAD ]I: TPT statistics for table 'REP.YYYYY': Operator=LOAD, CPU time=1126.937500, Received Rows=85986652, Sent Rows=85986652, Applied Rows=85986625 (teradata_tpt_engine.cpp:781)
[TARGET_LOAD ]W: Not all rows have been loaded successfully for 'REP'.'YYYYY' due to possible 'TPT LOAD' errors. Consult Target 'xxxx_E?' / 'xxxx_L?' Error / Log tables contents. (teradata_tpt_engine.cpp:789)
[TARGET_LOAD ]I: teradata_terminate_tpt(...) successfully applied conn->Terminate() method for task identified by UUID '74a9fd96-8335-5944-bb67-6aaa83fb3782' (teradata_tpt_engine.cpp:846)
[TARGET_LOAD ]E: TPT data acquisition failed [1020403] (teradata_endpoint_imp.c:1480)
[TARGET_LOAD ]E: Handling End of table 'REP'.'YYYYY' loading failed by subtask 1 thread 1 [1025000] (endpointshell.c:3069)
[TASK_MANAGER ]W: Table 'ADM'.'XXXXX' (subtask 1 thread 1) is suspended. TPT data acquisition failed; Handling End of table 'REP'.'YYYYY' loading failed by subtask 1 thread 1 (replicationtask.c:3208)

Is there any options to ignore the warnings/errors and continue the task like v2022.05?

Any advice would be appreciated.

Regards,
Kyoko Tajima

Re: Error Handling of CDC task

Dana_Baldwin — Fri, 10 May 2024 16:58:22 GMT

Hi @iti-attunity-sup

I don't see anything in the release notes as to why this was changed, I assume to make users more aware of potential data integrity issues. You can simply unsuspend the table and have it continue but you'll still have data issues on the target - and that doesn't exactly answer your question, you want the task to continue without any manual intervention if I understand correctly. I suspect there is not.

But to get a definite answer, we would need to engage our internal support team - and we don't have a way to elevate issues to them via a community post. Please open a support case to pursue this further.

I hope this helps!

Thanks,

Dana

Re: Error Handling of CDC task

iti-attunity-sup — Mon, 13 May 2024 00:23:20 GMT

Hello Dana

Thank you for your reply.

I opened a case for this issue.

Regards,

Kyoko Tajima

topic Re: Error Handling of CDC task in Qlik Replicate

Error Handling of CDC task

Re: Error Handling of CDC task

Re: Error Handling of CDC task