topic Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik in Qlik Replicate

Qlik replicate is creating Sorter files and disk is full No Response from Qlik

srikar22 — Fri, 28 Jun 2024 18:14:10 GMT

Qlik replicate is creating Sorter files and disk is full No Response from Qlik

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

srikar22 — Fri, 28 Jun 2024 18:15:03 GMT

No CS we have give 2 numbers and none works they all go to VM

We have a P1 ticket opened but no response.

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

narendersarva — Fri, 28 Jun 2024 21:00:25 GMT

Hi @srikar22

I see you have raised a case and our support engineer is working on it.

Case notes:

Problem Hypothesis : task fail, disk space full, sorter file

Troubleshooting Done: from reading the task log

Next Action Items: customer need to check if target endpoint working.
- customer need to increase the disk space, or reload
- reason is that without disk space, task cannot resume.

Thanks
Naren

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

DesmondWOO — Sun, 30 Jun 2024 17:53:10 GMT

Hi @srikar22 ,

Since disk space is full, most likely the sorter files are corrupt. You need to restart the task from earlier position so that Replicate can retrieve those transactions again.

Regards,
Desmond

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

srikar22 — Tue, 02 Jul 2024 02:14:07 GMT

We never got a solution for this case.

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

srikar22 — Tue, 02 Jul 2024 02:15:28 GMT

Naren Please check your response for the previous opened case we never got a solution for our issue.

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

SushilKumar — Tue, 02 Jul 2024 04:19:39 GMT

Hello @srikar22

Would like to mention here Enviromental related issue does Affect the Working of Qlik replicate. Qlik replicate create Sorter file when there is long running transaction happen on the Source db. and it didn't find commit for the operation yet.

Cause any replication tool is designed to process only Committed data.

As Sorter file corruption QR keeps track info of source DB transaction in internal file and TWASP and Sorter file are those as QR ask OS to push some info into those internal files then OS process not able to complete the due to no Space left on device to complete the operation.

Hence when the process started again if Space is cleared or made available then it finds incomplete information which we consider corruption.

to resolve the issue, we ask to resume the task from the timestamp so that it processes the logs and generate Sorter files again.

If you caught up into issue with sorter or disk Space full issue frequently. Request you to engage PS (Consulting paid Service) They will Evaluate your Solution as Whole and recommended best practices as per business SLA and Data volumes process Required.

Regards,

Sushil kumar

Re: Qlik replicate is creating Sorter files and disk is full No Response from Qlik

SachinB — Tue, 02 Jul 2024 06:51:04 GMT

Hello @srikar22 ,

The twsp files are transactions that have not been applied to target yet. Sorter files will accumulate if there are either a big transaction from source that is not committed yet or because of transactions not applied yet or applied and we didn’t get a confirmation for them yet

You cannot control the size of the sorter file however you can configure AR to use more memory and longer transaction timeout

Designer --> Task Settings --> Change Processing --> Change Processing Tuning --> Transaction Offload Tuning)

We need to identify where the bottle neck is by providing the enhance logs to us, However we have seen that the case assigned to TSE and they will get back to you accordingly.

Regards,

Sachin B