Hi,
We are seeing a small percentage of VMs failing after users log in and start opening work apps. When the failure occurs the problematic VM is showing Agent Unreachable in Horizon Admin and users gets disconnected from the session. When looking at VM in vCetner after the user is kicked out the VM shows no signs of life, SMB and RDP connections are timing out, however pings are getting responses. The problem is not host or pool specific. We have seen this behavior on all hosts and all pools. We are on Windows 10 (1909) with Horizon Agent 7.11 and VMWare tools 11.0.0. The parent has been optimized with b1151 build of optimizer tool.
What we see as a common pastern when the failure occurs is High CPU utilization in debug log
DEBUG (09F4-0A3C) [ws_perfmon] System CPU use: 99%
INFO (09F4-0A3C) [ws_perfmon] CPU-ALARM: cpu use = 99%
INFO (09F4-0A3C) [ws_perfmon] High CPU use: pid=1288, sessionId=1, name=dwm, user=Window Manager\DWM-1, percent=45.7
INFO (09F4-0A3C) [ws_perfmon] High CPU use: pid=5872, sessionId=1, name=explorer, user=CORP\vshang, percent=11.6
INFO (09F4-0A3C) [ws_perfmon] High CPU use: pid=5260, sessionId=0, name=WmiPrvSE, user=NT AUTHORITY\NETWORK SERVICE, percent=8.1
INFO (09F4-0A3C) [ws_perfmon] High CPU use: pid=2372, sessionId=0, name=svchost, user=NT AUTHORITY\NETWORK SERVICE, percent=4.4
and network failure in blast
[INFO ] 0x03c0 bora::Log: [VVCSessionManager] BlastSocketGetSessionMapEntry: SessionMap does have entry for vAuth:SX8SUc*****, sessionWrapper->vAuth:SX8SUc*****.
[INFO ] 0x03c0 bora::Log: [VVCSessionManager] BlastSocketHandleNetworkFailure: cookie is present for session: 1
[INFO ] 0x03c0 bora::Log: [Authentication] BlastSocketDropCookie: Cookie:7fKrF2***** dropped. Ref Count = 0.
[INFO ] 0x03c0 bora::Log: VVC: Closing the NCDeclined Channel, name: blast-mks, channelId: 7
[INFO ] 0x03c0 bora::Log: VVC: AbortChannel for channel blast-mks almost done.
[INFO ] 0x03c0 bora::Log: VVC: Closing the NCDeclined Channel, name: blast-audio, channelId: 9
[INFO ] 0x03c0 bora::Log: VVC: AbortChannel for channel blast-audio almost done.
[INFO ] 0x03c0 BlastSessionMgr::HandleConnectionClose: Handle BlastSocket connection close, vAuth:SX8SUc*****, vvcSessionId:1, Reason:VDPCONNECT_NETWORK_FAILURE (4)
[INFO ] 0x03c0 BlastSessionMgr::HandleConnectionClose: Shutdown OnConnectionClose for cnx:1
[INFO ] 0x03c0 BlastSessionMgr::DestroySession: cnx:1 closeReason:VDPCONNECT_NETWORK_FAILURE (4) flags:0x0
Any assistance with troubleshooting is greatly appreciated.
Thank you