Power Outage Takes Wikimedia Down
Baricom writes "Just a few weeks after a major power outage took out well-known blogging service LiveJournal for several hours, almost all of Wikimedia Foundation's services are offline due to a tripped circuit breaker at a different colo. Among other services, Wikimedia runs the well-known Wikipedia open encyclopedia. Coincidentally, the foundation is in the middle of a fundraising drive to pay for new servers. They have established an off-site backup of the fundraising page here until power returns."
They'll turn the lights off.
Coincidentally, the foundation is in the middle of a fundraising drive to pay for new servers.
"You see, guys? This is what could happen if we ever ran out of money. Now cough up some dough!"
The coolest voice ever.
So like PBS, they bring the service down to remind you they need the cash to provide you with the service you wanted to see but they just brought down.
After returning from the power outage, the servers have just been slash-fried.
I found this useful information about power outages:o utage
http://www.wikipedia.org/search?/power_
A power outage has taken down wikipedia! as a community we must carry the torch!
Paul Grosfield - the quicker picker upper.
Even when the servers go back on, they'll be slashdotted.
As that economic genius, Eric Cartman taught us:
1) Get something other people love
2) Don't let them use it
3) Profit!
It doesn't hurt if you are running a fund drive at the same time, either.
To make laws that man cannot, and will not obey, serves to bring all law into contempt.
--E.C. Stanton
Meanwhile, the devs are working fairly furiously to get it back up
;)
Don't worry, we'll take care of your backup servers in the meantime.
The coolest voice ever.
it's as though 300,000 people cried out and were suddently silenced ...
and then somebody diffed the change and made them speak again
As soon as I saw "Power corrupts. Power failure corrupts absolutely" I thought, the damn commies finally did it! But no, not hacked by commies...just by a renegade circuit breaker.
www.kiwilyrics.com - a wiki for lyrics
Real datacenters don't have PeeCees.
Oh, maybe one, out at the guard's desk.
So we have to take the master offline (actually just acquire a write lock on the DB, it can still answer SELECTs), tar up its (massive) database, scp it to the slaves, start the master, stop the slaves, untar the database, restart the slaves, and restart replication.
You forgot the part where you have to take the chicken across first, because the fox won't eat the grain if you leave them alone.
So, _this_ is where I should be posting my outage reports! And here I've been sending them only to people who would care.
"Slashdot...outage reports for nerds! Stuff that doesn't matter to me!"
Lol!
-buf
He thinks I'm a god now!
perhaps I just inadvertently reached clear
Apparently one of their MySQL databases got corrupted as well. Figures. You'd think with all that volume they'd be wise enough to use a DB that can withstand a hard powercycle without losing data.
Just remember, friends don't let friends use MySQL for important data.
:::eyes my UPS::::
::::ponders for a momment::::
:::eyes the serial cable that gracefully shuts down said computer in the event of a power failure::::
:::ponders some more::::
:::eyes the spare UPS sitting in the corner that used to be connected to a database server::::
Hmm, I think i'm almost onto something here, but i just can't seem to nail it down...
-Chris
--an unbreakable toy is useful for breaking other toys--
From their website:
,in one of the only true NOC's in the southeast. Neutelligent has huge fiber commitments with the following carriers, totalling over 4.5 gigs: UUNET, Level 3, and EPiK. By doing so, that will ensure 0:00 down time, not 1%, we mean 0% downtime.
Neutelligent owns and operates it's data centers. Neutelligent is not co-located in someone else's data center. We are located in downtown Tampa,FL.
So now they'll have to put up a page to say "The temp page that says that our site is down is down. We are working aorund the clock to get the temp page back up.".
"When the atomic bomb goes off there's devastation...but when the atomic bong goes off there's celebraaaaation!"
Imagine what would happen if there would be a link on wikipedias main site to slashdot and from slashdot back to wikipedia...Boom?