topic We hit into error with a task in SQL server source endpoint due to partition in Qlik Replicate

We hit into error with a task in SQL server source endpoint due to partition

desmondchew — Fri, 29 Sep 2023 00:47:10 GMT

We are replicating from SQL server into Snowflake target.

The task has been running fine until giving error lately. It can recover by itself but it triggers a lot of notification alerts. How can we fix this?

Stream component 'st_0_AX_EU' terminated
Stream component failed at subtask 0, component st_0_AX_EU
Error executing source loop
Endpoint is disconnected
Encountered an unexpeceted error.
Failure in processing captured event.
Failure in parsing / processing DDL record.
Failed in checking whether partition ID 72057598489657344 is a user table
Error occurred during Get DDL type
Failed on getting table definition for table 'dbo.DIMENSIONS'
sqlserver_get_partition_list(...) failed in executing statement '
select cast(sysPart.partition_number as varchar(10)) as partition_number
FROM sysobjects sysOb, sys.partitions sysPart
where sysOb.id=sysPart.object_id
and index_id in (0,1) -- 0 = heap , 1 = clustered index , 2 or greater = nonclustered index
and schema_name(sysOb.uid) = 'dbo' and sysOb.name= 'DIMENSIONS'
order by sysPart.partition_number
'
RetCode: SQL_ERROR SqlState: HYT00 NativeError: 0 Message: [Microsoft][SQL Server Native Client 11.0]Query timeout expired
Failed (retcode -1) to execute statement: '
select cast(sysPart.partition_number as varchar(10)) as partition_number
FROM sysobjects sysOb, sys.partitions sysPart
where sysOb.id=sysPart.object_id
and index_id in (0,1) -- 0 = heap , 1 = clustered index , 2 or greater = nonclustered index
and schema_name(sysOb.uid) = 'dbo' and sysOb.name= 'DIMENSIONS'
order by sysPart.partition_number
'

Re: We hit into error with a task in SQL server source endpoint due to partition

DesmondWOO — Fri, 29 Sep 2023 01:27:50 GMT

Hi @desmondchew ,

Based on the error message, Replicate encountered a timeout error when querying sysobjects and sys.partitions. Please try to increase internal parameter "executeTimeout".

Regarding Replicate triggers a lot of notification alerts, could you provide more information:

- notification message
- notification event type, e.g. Any error, Any warning
- when timeout occurs, how many notifications are triggered

Regards,
Desmond

Re: We hit into error with a task in SQL server source endpoint due to partition

desmondchew — Fri, 29 Sep 2023 02:31:11 GMT

Hi,

The error is related to [ATTUNITY.domain.com\Any errors] .

I will try to increase the executeTimeOut.

Re: We hit into error with a task in SQL server source endpoint due to partition

john_wang — Fri, 29 Sep 2023 02:43:36 GMT

Hello @desmondchew ,

Besides DesmondWoo's comment, we also noticed you are running an unsupported ODBC Client version:

RetCode: SQL_ERROR SqlState: HYT00 NativeError: 0 Message: [Microsoft][SQL Server Native Client 11.0]Query timeout expired

In supported Replicate versions the prerequisite is Install Microsoft ODBC Driver 18.1 at both Windows and/or Linux Replicate server. If you are running an old version of Replicate then please upgrade Qlik Replicate to supported versions. (Replicate version 2023.5 is highly recommended)

Hope this helps.

Regards,

John.