Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
We are currently using Qlik Replicate November 2024, with a z/OS source and Azure SQL Database as the target, and we are experiencing significant performance issues and delays during large-scale delete operations.
Specifically, when bulk deletes are triggered on the source, the replication process appears to handle them as row-by-row deletes on the target side, which is causing major latency and performance degradation.
Our task is configured in Transactional (CDC) mode, and switching to Batch mode is not an option due to business requirements.
We would like to understand:
Any insights or recommendations would be greatly appreciated.
Hi @Rueda ,
This appears to be more of a tuning-related issue. Since I’m not fully familiar with your environment and current task configuration, some possible tuning approaches could include:
Place the critical tables in a Transactional Apply task
Move less critical or high-volume tables into a separate Batch Apply task
Test different delete handling modes and apply settings
However, as any recommendation may be inaccurate without a complete understanding of the environment and configuration, we would recommend engaging PS for a deeper review and tuning assessment.
thanks,
John.
Hello @Rueda ,
This behavior looks reasonable to me:
Transactional (CDC) mode can be slow, especially when the target table does not have a Primary Key or Unique Index.
Deletes are processed row-by-row. This is by design and not considered a defect.
I’d like to better understand why Batch mode is not an option in this scenario.
thanks,
John.
Client want to ensure the transactions in the same order as they are created in Source system.
Hi @Rueda ,
This appears to be more of a tuning-related issue. Since I’m not fully familiar with your environment and current task configuration, some possible tuning approaches could include:
Place the critical tables in a Transactional Apply task
Move less critical or high-volume tables into a separate Batch Apply task
Test different delete handling modes and apply settings
However, as any recommendation may be inaccurate without a complete understanding of the environment and configuration, we would recommend engaging PS for a deeper review and tuning assessment.
thanks,
John.