Site Outages

Latest guild news and progression.

Site Outages

Postby Maelos on Mon Jun 15, 2009 5:50 pm

We've had a couple outages the past 24 hours. One was last night for about 2 hours and today for another 4 hours or so. I've been battling a combination of hardware and OS issues. No data has been lost and I'm in the process of performing a full backup of everything (database and websites are backed up nightly). Things should be stable for the time being but I expect to take another outage sometime this weekend to fully correct the root cause.

Sorry about the inconvenience. I'll be issuing refunds per the non-existent SLA.
User avatar
Maelos
Officer
 
Posts: 1290
Joined: Wed Apr 11, 2007 10:31 pm

Re: Site Outages

Postby Starsaturn on Mon Jun 15, 2009 6:10 pm

You didn't try to download dhcp last night did you?
Stupid should hurt, a lot.
User avatar
Starsaturn
Member
 
Posts: 914
Joined: Wed Jan 30, 2008 4:23 pm
Location: Seattle

Re: Site Outages

Postby Maelos on Mon Jun 15, 2009 7:12 pm

Starsaturn wrote:You didn't try to download dhcp last night did you?


Now that you mention it ...
User avatar
Maelos
Officer
 
Posts: 1290
Joined: Wed Apr 11, 2007 10:31 pm

Re: Site Outages

Postby Alephe on Tue Jun 16, 2009 9:38 am

I expected 5 9's uptime. This is a slap in the face.
E .· ` ' / ·. F
Your tears fuel me.
User avatar
Alephe
Officer
 
Posts: 2614
Joined: Thu Aug 16, 2007 11:49 pm
Location: San Jose, CA

Re: Site Outages

Postby Sigira on Tue Jun 16, 2009 6:26 pm

if only you had a good configuration framework for managing large numbers of Redhat Linux based systems. This issue could have been avoided. :P
User avatar
Sigira
Member
 
Posts: 237
Joined: Sun Jul 08, 2007 9:58 pm

Re: Site Outages

Postby Maelos on Sun Jun 21, 2009 11:17 am

Most of the work I needed to do to the site is done. I need to take one more outage in a week or so to add hardware and that should be it.
User avatar
Maelos
Officer
 
Posts: 1290
Joined: Wed Apr 11, 2007 10:31 pm

Re: Site Outages

Postby Alephe on Sun Jun 21, 2009 11:38 am

Our site gets enough traffic to require a hardware upgrade?!
E .· ` ' / ·. F
Your tears fuel me.
User avatar
Alephe
Officer
 
Posts: 2614
Joined: Thu Aug 16, 2007 11:49 pm
Location: San Jose, CA

Re: Site Outages

Postby Maelos on Sun Jun 21, 2009 3:04 pm

Alephe wrote:Our site gets enough traffic to require a hardware upgrade?!


Obviously not just this site running on the server. This is actually a virtual machine now, so I have a few others on it as well.
User avatar
Maelos
Officer
 
Posts: 1290
Joined: Wed Apr 11, 2007 10:31 pm


Return to News

Who is online

Users browsing this forum: No registered users and 1 guest

cron