Forum outage 8/12/17

Forum News, Announcements and any issues you're having with the forum

Moderator: myglaren

User avatar
xantia_v6
Forum Admin Team
Posts: 7908
Joined: 09 Nov 2005, 23:03
x 512

Forum outage 8/12/17

Post by xantia_v6 »

We apologise for the unscheduled downtime.

The issue was (from our perspective) caused by a lock-up in the hypervisor system which manages this server. This piece of software is run by the hosting company and is outside of our control.

Unfortunately the lock-up occurred while a database write operation was being processed on our server and after the system was rebooted by the hosting company our site did not start because it detected a database corruption. I have now manually restarted our database, and it appears to be working correctly.

If you notice any odd behaviour on the site, or anything that looks like data corruption, please report it.

Note that this hypervisor has been causing us intermittent speed problems for a few weeks now, and we were already planning to migrate to a different type of server node before the end of the year.
Hell Razor5543
Donor 2021
Posts: 12014
Joined: 01 Apr 2012, 09:47
x 1513

Re: Forum outage 8/12/17

Post by Hell Razor5543 »

Yay! I was suffering from withdrawal symptoms. Now I feel better.
User avatar
Paul-R
Donor 2020
Posts: 5441
Joined: 07 May 2009, 16:24
x 803

Re: Forum outage 8/12/17

Post by Paul-R »

Welcome back. A page starting

General Error
SQL ERROR [ mysqli ]
Connection refused [2002]
BACKTRACE

was not a suitable substitute!
User avatar
white exec
Moderating Team
Posts: 7384
Joined: 21 Dec 2015, 13:46
x 1445

Re: Forum outage 8/12/17

Post by white exec »

Thanks, Mike, for keeping on top of this. That was quite some outage.
User avatar
xantia_v6
Forum Admin Team
Posts: 7908
Joined: 09 Nov 2005, 23:03
x 512

Re: Forum outage 8/12/17

Post by xantia_v6 »

The timing was unfortunate, as it coincided with my bed-time.

In this case it would probably not have helped to have someone else with server access, as the procedure for correcting a corrupt database journal is a bit technical, and I only knew how to do it because the same thing happened earlier in the year.

LS say that the new KVM hardware should be tested and ready at the beginning of 2018.