Replicate Task Crashing - Recovers but sometimes takes hours. - Unknown '0' native error detected while SQL_ERROR

[Jolley]

Hi QLIK Community!

Has anyone experienced this error before? We are nearly maxing RAM (252GB out of 256GB) on the replicate server. Could a spike in volume of changes in this task cause this task to fail if there is not enough memory on the server? Thank you! Bryan Jolley - Conifer Health Solutions

00011068: 2023-01-18T13:57:40 [SOURCE_CAPTURE ]I: Throughput monitor: Last DB time scanned: 2023-01-18T12:10:06.357. Last LSN scanned: 000090fc:00269d20:00e1. #scanned events: 57. (sqlserver_log_utils.c:4958)
00011068: 2023-01-18T13:57:37 [SOURCE_CAPTURE ]E: SqlStat: Can't retrieve exception Information. [20014] (sqlserver_log_processor.c:4383)
00011068: 2023-01-18T13:57:37 [SOURCE_CAPTURE ]E: Unknown '0' native error detected while SQL_ERROR is flagged / SQLSTATE is not empty. [1020102] (sqlserver_log_processor.c:4389)
00011068: 2023-01-18T13:57:40 [SOURCE_CAPTURE ]E: Encountered an unexpeceted error. [1020102] (sqlserver_endpoint_capture.c:1035)
00004640: 2023-01-18T13:57:40 [TASK_MANAGER ]I: Task error notification received from subtask 0, thread 0, status 1020102 (replicationtask.c:3433)
00011068: 2023-01-18T13:57:40 [SOURCE_CAPTURE ]E: Error executing source loop [1020102] (streamcomponent.c:1917)
00011068: 2023-01-18T13:57:40 [TASK_MANAGER ]E: Stream component failed at subtask 0, component st_0_FMLYCH [1020102] (subtask.c:1396)
00011068: 2023-01-18T13:57:40 [SOURCE_CAPTURE ]E: Stream component 'st_0_FMLYCH' terminated [1020102] (subtask.c:1565)
00004640: 2023-01-18T13:57:40 [TASK_MANAGER ]W: Task 'FMLYCH' encountered a recoverable error (repository.c:5837)
00014608: 2023-01-18T13:57:40 [SORTER ]I: Final saved task state. Stream position 000090fc:00269d20:00e1, Source id 843622209, next Target id 791490797, confirmed Target id 791490793, last source timestamp 1674072606044000 (sorter.c:770)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:40 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00004640: 2023-01-18T13:57:41 [TASK_MANAGER ]I: Subtask #0 ended (replicationtask_util.c:591)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK ERROR WARNINGS] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00009424: 2023-01-18T13:57:45 [UTILITIES ]I: Mail "[vbcfrmreplpra01.tenethealth.net\QLIK TASK ERROR] FMLYCH:encountered errors" sent successfully (notification_manager.c:1916)
00004640: 2023-01-18T13:57:50 [SERVER ]I: Stop server request received internally (server.c:2393)
00004640: 2023-01-18T13:57:50 [TASK_MANAGER ]I: Task management thread terminated (replicationtask.c:4348)
00004664: 2023-01-18T13:57:53 [SERVER ]I: Client session (ID 1622560226) closed (dispatcher.c:193)
00004664: 2023-01-18T13:57:53 [UTILITIES ]I: The last state is saved to file 'D:\Qlik\Replicate\data\tasks\FMLYCH/StateManager/ars_saved_state_000001.sts' at Wed, 18 Jan 2023 21:57:40 GMT (1674079060164239) (statemanager.c:642)
00010492: 2023-01-18T13:57:53 [SERVER ]I: The process stopped (server.c:2520)
00010492: 2023-01-18T13:57:53 [AT_GLOBAL ]I: Closing log file at Wed Jan 18 13:57:53 2023 (at_logger.c:2535)

[john_wang · Accepted solution]

Helll @Jolley ,

Thanks for your reaching out!

This is a rare error.  In general it's an environment issue, for example the env was not setup correctly (please check Preparing the Microsoft SQL Server database for replication ), or the SQL Server Version is not supported etc. Would you please let us know:

1- the Replicate version;

2- The SQL Server server version and the SQL Server ODBC Client version, or SQL Native Client version.

We'd love to suggest you open a support ticket and attach the  Diag Package with SOURCE_CAPTURE set to Verbose if the problem persist.

Good Luck,

John.

[Jolley]

Hi John! 

Thank you very much for the quick feedback. We just upgraded to Replicate and QEM May 2022. I also found that the ODBC Microsoft SQL Driver we were using was 17.5 and QLIK recommends 17.6. We did the upgrade this weekend and the ODBC change. I will keep you posted. We have not had the issue since the upgrade.

Thanks again you all can close this or if you'd like to give it a few weeks i'll report back if the error persists. At that point i'll submit a verbose log if we continue to see the same errors!

Have a great day!

Bryan Jolley - Conifer Health Solutions

[john_wang]

Hello @Jolley ,

Glad to hear that and thank you so much for the update. I'm in Chinese New Year holiday, excuse me for the delay.

Regards,

John.