General > General Technical Chat

The BIG EEVblog Server Fire

<< < (10/36) > >>

Ultrapurple:
Whatever the cause of the fire and resultant outage, congratulations to all concerned for getting EEVblog (and presumably many other systems) back up and running - even at mildly reduced capacity - so quickly.

tggzzz:

--- Quote from: EEVblog on April 08, 2021, 03:41:53 am ---The lesson here is, whilst it's great to have a fully redundant automatic backup server, it was kinda silly to have it in the same datacenter!

--- End quote ---

You're not the first to notice that, and won't be the last.

The Brown's Ferry fire very nearly caused two nuke reactors to meltdown. It was caused by a candle :)

Talking about the control circuits (my emphasis):

--- Quote ---Speaking of tape recorders, there was one really interesting phone conversation between J. R. Calhoun, the chef of TVA’s Nuclear Generation Branch at the time and Frank Long of the NRC (and reported by a Canadian website):
    Calhoun: Yah, you know everything for those two units comes through that one room. It’s common to both units, just like the control room is common to both units.
--- End quote ---

https://hackaday.com/2018/12/06/fail-of-the-week-1975-the-browns-ferry-nuclear-incident/

tggzzz:

--- Quote from: peter-h on April 08, 2021, 09:06:11 am ---One has to do several things at the same time, including a database snapshot every day or so and keep the snapshots for many months.

--- End quote ---

... and test the backups.

Old story: backups to tape drive completed successfully, but when needed the tapes were found to be blank. The tape head was electrically connected but hanging loose away from the tapes!

Ed.Kloonk:

--- Quote from: MadScientist on April 08, 2021, 10:01:18 am ---
--- Quote from: Ed.Kloonk on April 08, 2021, 09:53:59 am ---

My money's on switchboxes. They really can and do indeed release magic black smoke.

--- End quote ---

Hmm, normally the changeover systems are in the genset space not the supported devices space, the switchgear there would be in use daily using the grid supplies etc and wouldn’t or shouldn’t fail like it did. ( if it did ) , sometimes the changeover system burns out , but again this should be significantly airgapped

--- End quote ---

Don't underestimate the power of fire protection systems and the fire department.

A plant near me recently had the control room catch fire. Such a mess. The panel where the fire started was vaporized. The adjacent panels had the wiring behind get so hot that all that is left looks like the wiring in a cheap mattress. The auto fire suppression system went nuts and sprayed yellow/orange gunk all over other panels not near the fire. And the boys that were sent to fix it all now need counseling, because of 60+? years of control mods that nobody kept track of.

Management: "But will it be all working again by this time next week?"

 :popcorn:

MadScientist:
All their reports say they had a mechanical genset  failure resulting in a fire. So this isn’t a switch gear fault I suspect. The issue seems to be the proximity  of servers to the Gensets. It sounds like they were in the same space  :palm:

Navigation

[0] Message Index

[#] Next page

[*] Previous page

There was an error while thanking
Thanking...
Go to full version
Powered by SMFPacks Advanced Attachments Uploader Mod