Qlik replicate is creating Sorter files and disk is full No Response from Qlik

[srikar22]

Qlik replicate is creating Sorter files and disk is full No Response from Qlik

[srikar22]

No CS we have give 2 numbers and none works they all go to VM

We have a P1 ticket opened but no response.

[narendersarva]

Hi @srikar22 

I see you have raised a case and our support engineer is working on it.

Case notes:

Problem Hypothesis : task fail, disk space full, sorter file

Troubleshooting Done: from reading the task log

Next Action Items: customer need to check if target endpoint working.
- customer need to increase the disk space, or reload
- reason is that without disk space, task cannot resume.

Thanks
Naren

[DesmondWOO]

Hi @srikar22 ,

Since disk space is full, most likely the sorter files are corrupt. You need to restart the task from earlier position so that Replicate can retrieve those transactions again. 

Regards,
Desmond

[srikar22]

We never got a solution for this case.

[srikar22]

Naren Please check your response for the previous opened case we never got a solution for our issue.

[SushilKumar]

Hello @srikar22 

Would like to mention here Enviromental related issue does Affect the Working of Qlik replicate. Qlik replicate create Sorter file when there is long running transaction happen on the Source db. and it didn't find commit for the operation yet. 

Cause   any replication tool is designed to process only Committed data. 

As Sorter file corruption QR keeps track info of source DB transaction in internal file and TWASP and Sorter file are those as QR ask OS to push some info into those internal files then OS process not able to complete the due to no Space left on device to complete the operation.  

Hence when the process started again if Space is cleared or made available then it finds incomplete information which we consider corruption.

to resolve the issue, we ask to resume the task from the timestamp so that it processes the logs and generate Sorter files again. 

If you caught up into issue with sorter or disk Space full issue frequently. Request you to engage PS (Consulting paid Service) They will Evaluate your Solution as Whole and recommended best practices as per business SLA and Data volumes process Required.

Regards,

Sushil kumar

[SachinB]

Hello @srikar22 ,

The twsp files are transactions that have not been applied to target yet. Sorter files will accumulate if there are either a big transaction from source that is not committed yet or because of transactions not applied yet or applied and we didn’t get a confirmation for them yet

You cannot control the size of the sorter file however you can configure AR to use more memory and longer transaction timeout

Designer --> Task Settings --> Change Processing --> Change Processing Tuning --> Transaction Offload Tuning)

We need to identify where the bottle neck is by providing the enhance logs to us, However we have seen that the case assigned to TSE and they will get back to you accordingly.

Regards,

Sachin B