Wesbite & Forum Outage 10th Dec 2016

[EEVblog]

Down for over 12 hours.
It was the fault of Hostgator:
https://forums.hostgator.com/12-09-16-15-00-multiple-t345474.html

Cue the people who say "switch to a real host" in 3, 2, 1...

[ez24]

It was tough going

[NottheDan]

Switch to a real gator, mate 


Just getting it out of the way.

[TheSteve]

I highly doubt they have any intention of admitting what really happened.

[Muttley Snickers]

I learnt how to change my nickname on the EEVblog IRC site, and then I learnt that I could join the IRC channel from my smart TV, this wouldn't have happened if the forum was up and running so not all was wasted really.

Thats all I have to offer up in the way of positives.   

[SeanB]

Not a problem, just went and got through a little of the YT backlog, and went to bed.

[jonovid]

Down for over 12 hours.
It was the fault of Hostgator:

Dave maybe We're gonna need a bigger server 

[timb]

Jesus, I don't know how HostGator is still is business... They were a crappy, subpar host 10 years ago when I was in the hosting industry, I guess much doesn't change...

Dave, if you ever decide to rent a dedicated VM on a cluster somewhere, I've got some good recommendations. It's a lot cheaper than you think! I'd also be happy to administrate it for you.

[FrankBuss]

Well, why don't you switch to a real host? Did you at least negotiate unlimited traffic, as it is standard e.g. at http://1and1.com , where my server runs (and I had never a timeout of 12 hours, just a short reboot in the last year. I recommend this for my customers, too, they would lose quite some money with 12 hour outages) ? Same at http://www.ovh.com . Looks like many of the big providers offers this.

Long time ago I had a server with max traffic and then a notification and additional costs. It got hacked and was used as a warez server for a day until I fixed it. Cost this month was multiple times the normal cost.

[Jay_Diddy_B]

Hi group,

When there is an outage like this, In my mind it just reinforces, what a great thing we have here. 

I have to admit that I was getting withdrawal...

Regards,

Jay_Diddy_B

[Brumby]

Aside from the separation anxiety, I noticed I knocked off a couple more items from my 'To Do' list than I expected.  Luckily SWMBO didn't.

[ez24]

Is this outage a record?

[SeanB]

Is this outage a record?

No, there were 40 years of Dave's life when the blog was not available. Don't know how he survived that.

[EEVblog]

Here is Hostgators explanation:
https://www.hostgator.com/blog/122016-dedicated-server-outage/

[djos]

Down for over 12 hours.
It was the fault of Hostgator:
https://forums.hostgator.com/12-09-16-15-00-multiple-t345474.html

Cue the people who say "switch to a real host" in 3, 2, 1...

Maybe if you switched to a high-end hosting provider like AWS.... oh wait... 

[tautech]

Here is Hostgators explanation:
https://www.hostgator.com/blog/122016-dedicated-server-outage/

Condescending crap.

[djos]

Condescending crap.

Mostly yes but I don't doubt they broke their network and a spanning tree loop (or propagation) compounded it - I've seen it happen in several Org's while a Major Incident Manager.

[EEVblog]

Down for over 12 hours.
It was the fault of Hostgator:
https://forums.hostgator.com/12-09-16-15-00-multiple-t345474.html
Cue the people who say "switch to a real host" in 3, 2, 1...

Maybe if you switched to a high-end hosting provider like AWS.... oh wait... 

Bingo.
Everyone thinks that their hosting providers shit doesn't stink.

[djos]

Maybe if you switched to a high-end hosting provider like AWS.... oh wait... 

Bingo.
Everyone thinks that their hosting providers shit doesn't stink.

The amusing thing about that was their systems total inability to deal with external power sags using UPS and start the GenSets up before the batteries drained - a total DC 101 Fail!

[Muttley Snickers]

I don't know enough about ISPs and hosting services to make any logical comment but I do know one thing, at least they had the decency to offer up an explanation and apology which is more than some other mobs do.

On the day in question the error message I kept getting showed that the EEVblog Cloudfair Host located in Hong Kong was offline, I should have saved a snapshot to verify but didn't, I'm still getting the odd brief outage for a few minutes here and there as recently as this morning.

[tautech]

I don't know enough about ISPs and hosting services to make any logical comment but I do know one thing, at least they had the decency to offer up an explanation and apology which is more than some other mobs do.

On the day in question the error message I kept getting showed that the EEVblog Cloudfair Host located in Hong Kong was offline, I should have saved a snapshot to verify but didn't, I'm still getting the odd brief outage for a few minutes here and there as recently as this morning.

Hello, mine showed Sydney, what's going on here ? 

Yep, I should have grabbed a screenshot too.

[mtdoc]

All I know is that of the 4 forums I regularly visit, this is the only one that has regular outages....

[FrankBuss]

Down for over 12 hours.
It was the fault of Hostgator:
https://forums.hostgator.com/12-09-16-15-00-multiple-t345474.html
Cue the people who say "switch to a real host" in 3, 2, 1...

Maybe if you switched to a high-end hosting provider like AWS.... oh wait... 

Bingo.
Everyone thinks that their hosting providers shit doesn't stink.

Well, that was a 2 hour outage at AWS because of a power outage. Hostgator was a 16 hour outage because of a configuration problem. Bigger datacenters like 1and1 have UPS, backup UPS and diesel generators for longer power outages.

[djos]

Well, that was a 2 hour outage at AWS because of a power outage. Hostgator was a 16 hour outage because of a configuration problem. Bigger datacenters like 1and1 have UPS, backup UPS and diesel generators for longer power outages.

The outage was caused by poor configuration of the DC BMS and UPS integration.

The BMS didn't know how to handle a grid voltage sag (aka brown out) and just ran the ups batteries flat because it didn't know to call up the generators.

I managed a tier 3 spec Colo DC up till a few years ago and this sort of Charlie Foxtrot just boggles the mind.

[Ice-Tea]

Just wondering, can't get to the "show new replies" page for a few days now... I get this:

Code: [Select]

502 - Bad Gateway

We are sorry for the inconvenience that this error may be causing you. We are aware of the issue and are working to resolve it, please be patient.

There is no need to report this error.

Thank you for your patience,
Dave & gnif
Is that part of this issue or something else?