topic Re: Bulk apply operation failed in Qlik Replicate

Bulk apply operation failed

TaylorN — Thu, 20 Feb 2020 04:42:42 GMT

I am getting many of the below errors in my task log. My source is Oracle 11g and target is Azure SQL DB. The updates do indeed get applied, but I would prefer they are done in bulk (much faster)

00003336: 2020-02-20T13:48:35 [TARGET_APPLY ]I: Bulk apply operation failed. Trying to execute bulk statements in 'one-by-one' mode (bulk_apply.c:2312)
00003336: 2020-02-20T13:48:35 [TARGET_APPLY ]I: Applying UPDATES one-by-one for table '<tablename>' (56) (bulk_apply.c:4810)
00003336: 2020-02-20T13:48:35 [TARGET_APPLY ]I: Switch back to bulk apply mode (bulk_apply.c:4907)

Re: Bulk apply operation failed

Ted_Manka — Tue, 25 Feb 2020 20:27:05 GMT

Please check your target database for 'attrep_apply_exceptions' table for details on the issue that is leading to the the one-by-one.

Re: Bulk apply operation failed

TaylorN — Tue, 25 Feb 2020 20:50:56 GMT

There were no exceptions in the table. I ended up just switching to transactional apply anyway, as I need to ensure referential integrity is maintained.

Re: Bulk apply operation failed

Ted_Manka — Wed, 26 Feb 2020 16:49:15 GMT

Hello @TaylorN ,

Correct, you need to get to the root problem that is causing the task to exit batch apply mode and forcing it into 1-1. Did you check the target database for 'attrep_apply_exceptions' table yet?

Thank you,

Ted Manka

Re: Bulk apply operation failed

TaylorN — Wed, 26 Feb 2020 20:03:32 GMT

@Ted_Manka as I said, there were no exceptions in the table

Re: Bulk apply operation failed

Ted_Manka — Wed, 26 Feb 2020 21:22:14 GMT

Hello @TaylorN ,

I apologize I missed your statement before, clearly you stated that, I am sorry.

If there is nothing in the table then we need to up the logs on target_apply and start looking for errors / warnings. Also what version are you on? I have been told by the team that there has been fixes so solve similar issues.

Can you also check your exception handling for the task and ensure it is set to write the record to the exception table?

Thank you,

Ted Manka

Re: Bulk apply operation failed

TaylorN — Wed, 26 Feb 2020 21:29:56 GMT

@Ted_Manka , no worries 🙂

I have all exceptions being logged except for the update statement. That now performs an insert if the target row is missing.

I believe I’m running v6.4 (not sure which build)

Re: Bulk apply operation failed

Ted_Manka — Wed, 26 Feb 2020 21:41:29 GMT

@TaylorN ,

You can find the exact version number at the very top of your task log file.

Thank you,

Ted Manka

Re: Bulk apply operation failed

TaylorN — Wed, 26 Feb 2020 21:56:15 GMT

@Ted_Manka , version is 6.4.0.457

Re: Bulk apply operation failed

Ted_Manka — Tue, 03 Mar 2020 18:27:45 GMT

@TaylorN we didn't find anything that was fixed or causing tasks to be forced into 1 by 1 mode. I would suggest increasing target_apply logging to at least trace if not verbose to see errors that are coming out. Please increase, reproduce the problem then look to see what error / problem happened just before it got kicked to 1 by 1 mode.

Thank you,

Ted Manka

Re: Bulk apply operation failed

Gaurav2 — Thu, 11 Nov 2021 13:08:35 GMT

Did we get the solution for it? I am also getting the same error.

Re: Bulk apply operation failed

SaranyaK — Sun, 17 Apr 2022 13:29:13 GMT

Any solution on this? I am getting the same error as well?

Re: Bulk apply operation failed

john_wang — Sun, 17 Apr 2022 13:52:58 GMT

Hello @SaranyaK , @Gaurav2 ,

The error messages means the Batch failed (while the apply mode is "Batch Optimized Apply"), Replicate cannot apply the whole batch in one transaction (eg one row get PK violation in the batch, one row cannot be found etc) so Replicate has to switch to one-by-one mode automatically and try to apply the separate rows in the batch in one-by-one mode. after all the rows in the batch were applied Replicate will switch back to Batch Apply mode automatically.

There are many reasons may lead the error, helpful troubleshooting options:

1. Check the "attrep_apply_exceptions" table to see if any information

2. set TARGET_APPLY to Verbose to get more detailed information from task log file to know the reason

Hope this helps.

Regards,

John.

Re: Bulk apply operation failed

SaranyaK — Sun, 17 Apr 2022 13:58:26 GMT

Thanks John for the respose.

There is no rows in attrep_apply_exceptions. This started happening right after upgrade of Qlik from 6.6 to 2021, was wondering if any setting need to be available to load the varchar(max) column in 2021 version. A case 00033794: Bulk insert fail for CLOB columns has ben opned so checking if anyone had a similar issue... Thanks again.

Re: Bulk apply operation failed

john_wang — Sun, 17 Apr 2022 14:41:08 GMT

Hello @SaranyaK ,

Quick check on the case shows the information is insufficient:

1. The TARGET_APPLY logging level was not set to Verbose

2. The data in the task log file are encrypted by default, we cannot read the contents to understand the reason. You can follow the steps to decrypt task-log-files to understand more.

Regards,

John.

Re: Bulk apply operation failed

lyka — Wed, 20 Apr 2022 18:55:00 GMT

Hi Saranya,

Based on your case, this appears to be an issue with the version you are using. Please upgrade to V2021.05 SP10

Thanks
Lyka