I have a virtual machine that keeps locking up and I cannot figure it out. The CentOS (LAMP) running cpanel on a virtual machine keeps locking up. All the other VMs on the server are running just fine.
It is running VMware 5.5 with latest vmware tools and cpanel installed CentOS iso.
'uname -a' on the VM produces:
Linux 2.6.32-358.23.2.el6.x86_64 #1 SMP Wed Oct 16 18:37:12 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
I am not seeing any major traffic spikes. The entire server is not responsive, it consumes all memory and never recovers from the issue. This time it ran for about 5 days until the virtual machine locked up.
I have increased the priority to high for all resources. The load on the server in esxtop is virtually zero (0.04).
The error messages that I am getting on the console of the virtual machine when it locks up are:
Out of memory: Kill process 2177 (mysqld) score 57 or sacrifice child
Killed process 2177, UID 498, (mysqld) total-vm:2477088kB, anon-rss:140928kB, file-rss:16kb
Out of memory: Kill process 19974 (httpd) score 9 or sacrifice child
Killed process 19974, UID 99, (httpd) total-vm:370868kB, anon-rss:24280kB, file-rss:100kb
And then it repeats over and over again about "out of memory" and kill process httpd. Here are a couple screenshots of the lockup.
I have contacted cpanel support, but they have been very limited in the amount of resources they can provide to tracking down the issue. Could this be an issue with the hardware? Why are all of the other VMs just fine? Is there any additional information that I can post to help diagnose or any steps I can take?
Any and all replies of what else I can track down would be greatly appreciated.