Phoenix detected: Server Watchdog is hung

[BTIZAG_OA]

Hello all,

Today i had following errors with QS Engine Service crashing also its created a crash dump on the following folder

C:\ProgramData\Qlik\Sense\Engine\CrashDumps

Couldnt find any info about "Watchdog is hung" error on the community/knowledgebase. Are there anyway that i can prevent this happen in the future?

Spoiler

423445 20210915T135012.150+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 68bdffc4-f016-4196-a28a-c45f6215ac19 domain\serviceuser LogChain: Request stuck report (begin) 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 68bdffc4-f016-4196-a28a-c45f6215ac19


423446 20210915T135012.150+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 41f39ffa-4ea0-4ace-b119-936b96fe5d92 domain\serviceuser StdServer: ExecContext (depth 0): Fiber(000003CBCC1EF420)<id=2870 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CA8B073020)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>> 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 41f39ffa-4ea0-4ace-b119-936b96fe5d92


423447 20210915T135012.156+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 c1bf02e1-5e74-4d68-8fc5-674d84d87296 domain\serviceuser LogChain: Request stuck report (end) 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 c1bf02e1-5e74-4d68-8fc5-674d84d87296


423448 20210915T135012.156+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 f721b426-dda3-4c8c-9fca-bc7cc2185c02 domain\serviceuser StdServer: Not waiting or awaiting 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 f721b426-dda3-4c8c-9fca-bc7cc2185c02


423449 20210915T135012.162+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 2b3a455e-ab50-4ec4-937a-a4f4f28af92c domain\serviceuser StdServer: ExecContext (depth 2): Fiber(000003DA1DB8A820)<id=2224 #susp=0 pnd=0 lpnd=6>CAnyRequest(0x0000029AC940B720)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>> 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 2b3a455e-ab50-4ec4-937a-a4f4f28af92c


423450 20210915T135012.163+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 d25dc213-0b2e-444f-8119-48bf4b1cf95d domain\serviceuser StdServer: Waiting on monitor CMon<slvl=90 rlvl=1 age=-1 cu=<Fiber(000003DA1DB8A820)<id=2224 #susp=0 pnd=0 lpnd=6>CAnyRequest(0x0000029AC940B720)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>>> #aw=0 #w=26> 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 d25dc213-0b2e-444f-8119-48bf4b1cf95d


423451 20210915T135012.224+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 ca309230-7822-43bd-8576-6a5182f19970 domain\serviceuser StdServer: ExecContext (depth 1): Fiber(000001D1925B8820)<id=1047 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CA50C7D058)<hasQv=1 hasFiber=1 bprio=1>CQvReq(0x000003CA50C7D020)<f=Global::OpenApp pUnk=0x0000024CB44A4820 hasFiber=1 onbr=2532444 id=1 strd=1 fin=0 isVal=0 ex=0 eex=0 tm=-1 blk=0> 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 ca309230-7822-43bd-8576-6a5182f19970


423452 20210915T135012.225+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 84c04d17-f9e9-4b46-b87e-19470e14e137 domain\serviceuser StdServer: Waiting on monitor CMon<slvl=5 rlvl=1 age=-1 cu=<Fiber(000001D1925B8820)<id=1047 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CA50C7D058)<hasQv=1 hasFiber=1 bprio=1>CQvReq(0x000003CA50C7D020)<f=Global::OpenApp pUnk=0x0000024CB44A4820 hasFiber=1 onbr=2532444 id=1 strd=1 fin=0 isVal=0 ex=0 eex=0 tm=-1 blk=0>> #aw=0 #w=121> 0 Internal Engine 20210915T135012.153+0300 18088 20136 0 20210910T182201.000+0300 84c04d17-f9e9-4b46-b87e-19470e14e137


423453 20210915T135012.274+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 631e6ddf-653b-45f3-8204-b98e4f1297ae domain\serviceuser StdServer: ExecContext (depth 0): Fiber(000001D1202CBC20)<id=884 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CACED90920)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>> 0 Internal Engine 20210915T135012.152+0300 18088 20136 0 20210910T182201.000+0300 631e6ddf-653b-45f3-8204-b98e4f1297ae


423454 20210915T135012.418+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 46ed3c83-6378-4bf3-9483-73c8dd4f34b0 domain\serviceuser LogChain: Request stuck report (begin) 0 Internal Engine 20210915T135012.152+0300 18088 20136 0 20210910T182201.000+0300 46ed3c83-6378-4bf3-9483-73c8dd4f34b0


423455 20210915T135012.419+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 9a2b7217-25e2-439d-b3d3-f20715d7cd0f domain\serviceuser LogChain: Request stuck report (end) 0 Internal Engine 20210915T135012.152+0300 18088 20136 0 20210910T182201.000+0300 9a2b7217-25e2-439d-b3d3-f20715d7cd0f


423456 20210915T135012.424+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 1a1fe5a6-3f02-4c89-a83b-1f85f56d2c6a domain\serviceuser StdServer: Not waiting or awaiting 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 1a1fe5a6-3f02-4c89-a83b-1f85f56d2c6a


423457 20210915T135012.425+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 86381975-026d-4e74-bedb-e9d793167d83 domain\serviceuser StdServer: ExecContext (depth 2): Fiber(000003DA1DB8A820)<id=2224 #susp=0 pnd=0 lpnd=6>CAnyRequest(0x0000029AC940B720)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>> 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 86381975-026d-4e74-bedb-e9d793167d83


423458 20210915T135012.431+0300 ERROR QLIKSERVERNAME System.Engine.Engine 328 823ce2f5-d26a-4c82-980f-7147a8ef9197 domain\serviceuser StdServer: Waiting on monitor CMon<slvl=90 rlvl=1 age=-1 cu=<Fiber(000003DA1DB8A820)<id=2224 #susp=0 pnd=0 lpnd=6>CAnyRequest(0x0000029AC940B720)<hasQv=0 hasFiber=1 bprio=0><pQvReq=CQvReq(null)<>>> #aw=0 #w=26> 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 823ce2f5-d26a-4c82-980f-7147a8ef9197


423459 20210915T135012.432+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 dd77efa6-79d8-4522-b951-1f918528740e domain\serviceuser StdServer: ExecContext (depth 1): Fiber(000001D1925B8820)<id=1047 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CA50C7D058)<hasQv=1 hasFiber=1 bprio=1>CQvReq(0x000003CA50C7D020)<f=Global::OpenApp pUnk=0x0000024CB44A4820 hasFiber=1 onbr=2532444 id=1 strd=1 fin=0 isVal=0 ex=0 eex=0 tm=-1 blk=0> 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 dd77efa6-79d8-4522-b951-1f918528740e


423460 20210915T135012.437+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 5c68c8f8-07d1-40a2-acb6-0361db13fcd1 domain\serviceuser StdServer: Waiting on monitor CMon<slvl=5 rlvl=1 age=-1 cu=<Fiber(000001D1925B8820)<id=1047 #susp=1 pnd=0 lpnd=6>CAnyRequest(0x000003CA50C7D058)<hasQv=1 hasFiber=1 bprio=1>CQvReq(0x000003CA50C7D020)<f=Global::OpenApp pUnk=0x0000024CB44A4820 hasFiber=1 onbr=2532444 id=1 strd=1 fin=0 isVal=0 ex=0 eex=0 tm=-1 blk=0>> #aw=0 #w=121> 0 Internal Engine 20210915T135012.151+0300 18088 20136 0 20210910T182201.000+0300 5c68c8f8-07d1-40a2-acb6-0361db13fcd1


423461 20210915T135012.437+0300 INFO QLIKSERVERNAME System.Engine.Engine 328 cb44ac24-bf7d-4b29-9407-6c97ff121c28 domain\serviceuser StdServer: End suspend handling for app [db0a0fab-a31f-4d01-ae93-8b7717711938] 17f1d79a-0b84-4a0b-9294-69e77f8e64d9 domain2 36649 20210915T135012.164+0300 14188 20136 a236306a-a2d0-44ba-917e-04be27b2f97e 20210910T182201.000+0300 cb44ac24-bf7d-4b29-9407-6c97ff121c28


423462 20210915T135016.980+0300 INFO QLIKSERVERNAME System.Engine.Engine 382 53ae8d4d-887c-40d1-8d99-b7da8ae2df24 domain\serviceuser StdServer: End suspend handling for app [db0a0fab-a31f-4d01-ae93-8b7717711938] e1cd407a-d602-4259-8363-e65612cc8f90 domain1 n9026096 20210915T135016.980+0300 4224 20136 f6614ff1-ee60-41d7-830f-9ac758ce9a9b 20210910T182201.000+0300 53ae8d4d-887c-40d1-8d99-b7da8ae2df24


423463 20210915T135017.169+0300 INFO QLIKSERVERNAME System.Engine.Engine 328 2168cd75-9d80-47ec-b542-60a1087c0831 domain\serviceuser Engine: Server aborted. Reason for restart: Phoenix detected: Server Watchdog is hung. 0 Internal Engine 20210915T135017.157+0300 18088 20136 0 20210910T182201.000+0300 2168cd75-9d80-47ec-b542-60a1087c0831


423464 20210915T135017.170+0300 ERROR QLIKSERVERNAME System.Engine.Engine 34 cc512595-0789-4d74-84a4-3bc38a574e4f domain\serviceuser Restart: Server aborted trying to recover by restart. Reason for restart: Phoenix detected: Server Watchdog is hung. 0 Internal Engine 20210915T135017.157+0300 18088 20136 0 20210910T182201.000+0300 cc512595-0789-4d74-84a4-3bc38a574e4f


423465 20210915T135017.171+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 3e52fe6b-d22d-48ce-a7fb-dd3d04f48de2 domain\serviceuser Core dump: Writing core dump file to C:\ProgramData\Qlik\Sense\Engine\CrashDumps\Coredump_12.388.3_20136_415693723.dmp 0 Internal Engine 20210915T135017.163+0300 18088 20136 0 20210910T182201.000+0300 3e52fe6b-d22d-48ce-a7fb-dd3d04f48de2
423466 20210915T135017.901+0300 ERROR QLIKSERVERNAME System.Engine.Engine 382 a74fb25b-9525-4f31-ad35-269474fbc5f6 domain\serviceuser Core dump: Core dump result = 1 0 Internal Engine 20210915T135017.889+0300 18088 20136 0 20210910T182201.000+0300 a74fb25b-9525-4f31-ad35-269474fbc5f6


423467 20210915T135018.055+0300 INFO QLIKSERVERNAME System.Engine.Engine 382 3307d1e1-bdac-4318-b5a7-f66d5cc0f640 domain\serviceuser Debug: Done Running 0 Internal Engine 20210915T135018.052+0300 20156 20136 0 20210910T182201.000+0300 3307d1e1-bdac-4318-b5a7-f66d5cc0f640


423468 20210915T135019.178+0300 INFO QLIKSERVERNAME System.Engine.Engine 34 205d2fe1-d0e2-450e-b7c5-0a93b17bb1f3 domain\serviceuser System: Closing - Purge: Purging 0 Internal Engine 20210915T135019.078+0300 15748 20136 0 20210910T182201.000+0300 205d2fe1-d0e2-450e-b7c5-0a93b17bb1f3

[mjht]

Is there any information about this?  I am seeing this on my Qlik Sense Server May 2021 Patch 12.  All I see in community refers to Qlikview Server ... not Qlik Sense and nothing recent.

[Chip_Matejowsky · Accepted solution]

Hi @mjht,

Qlik Sense and QlikView share the QIX engine, so the meaning of the Phoenix error is the same in both products.  At a high level, It refers to a watchdog component within the engine service which was determined to be hung and restarted itself.  Hope this helps!

Best Regards