OT: It's all gone wrong...

OT: It's all gone wrong...

Author
Discussion

CarZee

Original Poster:

13,382 posts

273 months

Tuesday 18th June 2002
quotequote all


a trip has just gone on our UPS system. We've lost power to the entire datacentre.

That's 2000+ servers and all the associated networks.

A woman just came on the tannoy to tell everyone that service will be resumed by 3pm

IMO we'll be lucky if everything is working properly by the end of the day.. by which I mean midnight.

And they've been planning a power down for about 6 months... was supposed to happen this weekend

muppets..

oh yeah - and I'm now laughing at everyone who doesn't have a modem on their PCs

ap_smith

1,997 posts

272 months

Tuesday 18th June 2002
quotequote all
hahahaha, f'kin brilliant.

A bit of overtime then CarZee?

CarZee

Original Poster:

13,382 posts

273 months

Tuesday 18th June 2002
quotequote all
Perhaps, and for reasons I'll share with you privately, not the best day for that to happen for me..

pigme

196 posts

269 months

Tuesday 18th June 2002
quotequote all
Come on then CarZee, tell all, no one else is listening... shhhh.

neil_cardiff

17,113 posts

270 months

Tuesday 18th June 2002
quotequote all
Oh well not as bad as the secretary who deleted the contacts public folder from our exchange server - over three thousand entries.

One click took us three days to get around to restoring the the folder, and as those in the know, know, publics folders are a bitch to get back.

CarZee, can I come work for you? Seems like the lady on the tannoy has more sense than everybody put together at my place...

GregE240

10,857 posts

273 months

Tuesday 18th June 2002
quotequote all
Bad luck CarZ, but c'mon man, do enlighten us.

Twin Turbo

5,544 posts

272 months

Tuesday 18th June 2002
quotequote all
Ah! But she didn't say WHICH 3PM, did she!

CarZee

Original Poster:

13,382 posts

273 months

Tuesday 18th June 2002
quotequote all
Well, made it home..

Like I said Greg, it's an offline story and it's really nowhere as interesting as the hype might end up being...

To all those concerned parties, we have dual distributed UPS. Except it transpires that the U stands for Unpredictable, or was it Unreliable.. either way, FWIW, in every company I've worked at where distributed UPS systems are installed, there's been an outage at least once a year.

As for the DR plan, well I provide services for a company who put it's two DR sites adjacent to and opposite sides of a Gasometer on the Heathrow flight path..

Dave_H

996 posts

289 months

Tuesday 18th June 2002
quotequote all
quote:

I provide services for a company who put it's two DR sites adjacent to and opposite sides of a Gasometer on the Heathrow flight path..



D'oh!

go-go

193 posts

274 months

Thursday 20th June 2002
quotequote all
Someone needs IT help ?