As Hurricane Season Looms, It's Disaster-Preparedness Time
Nerval's Lobster writes "In 2012, hurricane Sandy smacked the East Coast and did significant damage to New Jersey, New York City, and other areas. Flooding knocked many datacenters in Manhattan offline, temporarily taking down a whole lot of Websites in the process. Now that fall (and the tail end of hurricane season) is upon us again, any number of datacenters and IT companies are probably looking over their disaster-preparedness checklists in case another storm comes barreling through. Ryan Murphey, who heads up design and capacity planning for PEER 1 (which kept its Manhattan datacenter running during the storm by creating a makeshift bucket brigade to carry fuel to the building's 17th floor), offers a couple basic tips for possibly mitigating damage from the next infrastructure-crushing disaster, including setting up emergency response teams and arranging contracts for maintenance and fuel in advance."
Looming? Most North American hurricanes this year have already happened! Is this some kind of spam?
How many emergenices has lower Manhattan had in the past 12 years? Stupid is, is stupid does. MOVE!
Hurricane season has been going on for a few months now. Why the hell would a data center or organization review their hurricane/storm related disaster checklists now instead of, oh, you know, before hurricane season? Any organization complacent and negligent enough to wait till the end of the hurricane season to review/correct their checklists probably isn't going to actually care about the checklist anyway.
"When you sit with a nice girl for two hours, it seems like two minutes. When you sit on a hot stove for two minutes, it
You should have designed and tested your hurricane preparedness plan back in April or May. If you waited until now to "look into it" then you are being irresponsible.
I was looking for a reason to lay in a supply of scotch. I already have the generator and transfer switch.
Arberg here we come!
>> which kept its Manhattan datacenter running during the storm by creating a makeshift bucket brigade to carry fuel to the building's 17th floor
No fire code violations there, right? I'd love to be an attorney near this one. "So, you burned down the building trying to keep a couple of servers running, when you could have just co-located your equipment in a smarter place (like anyone who knows what they're doing would have done)."
Never modern have there been so few hurricanes by Oct 1 as there were in 2013. Meteorologist blame a "cooler" ocean. We still have another couple months to the season. nd bad ones have occurred late like Sandy.
We have our servers in a data centers in inland Oregon/Washington. There has never been a hurricane or typhoon within a thousand miles, seismic events are rare, the area is used to large amounts of rain so flooding has minimal effect, the weather is temperate so there is rarely extremes in heat or cold and Tsunamis would have to get past the coast range mountains to be an issue. Basically, nothing ever happens there. I would recommend anyone with important data at least have a DR location in a low risk geographical area.
I opened the article, searched for "replication"...nothing. The only backups mentioned are the generators. Seriously? Skimmed a bit further and the author states that they came up with their disaster plan *after* Sandy hit. I didn't read the article enough to know what their situation was exactly, but lesson one, plan for the disaster *before* it hits.
How many emergenices has lower Manhattan had in the past 12 years? Stupid is, is stupid does. MOVE!
Nice! Stopped at 2001 - did we?!
And why move when the government will just declare a "disaster area" and you get check for your decision on a lviing space.
Oh, I'm with you man! Why is that millionaires can have those beach front homes that they KNOW are not insurable and yet, the inevitable hurricane comes and wipes them out, they get their check at their primary home and build anew. And in the meantime, the poor bastards in the reclaimed wetlands are stuck in some shelter and have to wait for FEMA to cut them a check so that they can get another residence.
Yes sir, I'm with you!
As far as I'm concerned, if your residence is in a known hurricane - flooding - earthquake- tornado-tsunami- etc... path and you can't get commercial insurance, then TOUGH SHIT!
The Free Markets have pronounced sentence - you live in a shit hole: so suck it NC, SC, FL, TX, AR, KS, OH, TN, KY, CA, OR - well the entire South Midwest and West Coast. You suck!
And since NY and DC is a target for terrorists - you SUCK TOO! And it's WORSE! If you people weren't such assholes, then maybe the terrorists wouldn't have attacked you scumbags.
After all, NY IS home to the WallStreet Asshole - crooks who are scumbags. Wait, they also have homes in CT! Those fuckers! CT is a shit hole too!!
And MA?! Mitt Romney - that Mormon-Wallstreet-rich kid scumbag who got everything easily! ANd Maine too! Steven King's novels are so cookie cutter! I mean really - Evil supernatural something tricks good guy. Good guy find a way to beat evil. Blah de blah da!
And don't get me started on MI - Detroit?!? Good greif! That city damns them all!
Fuck it! Nuke it all!
I am enjoying your website. I would like to buy your wormhole technology. Please contact me.
Look, we don't have to re-invent the wheel. A hurricane preparedness kit is EXACTLY the same as Zombie Survival Kit minus the shotguns.
Looks like none of these people paid attention to the ISP that kept running during Katrina. His blog starts here: http://interdictor.livejournal.com/2005/08/28/
I'm not sure I want to take the advice from a guy who's emergency plans ended up with him using a bucket brigade to keep his DC open...
No, sorry. Being clever in the midst of a disaster does not make you good at emergency IT planning.
We as a society are doomed if we get hit with a disaster worse than Sandy.
Sandy was a tropical storm. Not a hurricane. No, there wasn't anything "super" about it.
1. Require all new housing within 10 miles of a coast to be built either on stilts or with a ground floor only used for garage, mud room, and guest room.
2. Remove all insurance subsidies for housing withing 10 miles of a coast. All of them. No exemptions.
3. Raise power systems 10 feet up, to allow for storm surge flooding.
4. Redraft flood drainage and screening to anticipate storm surges 10 feet in elevation in all locations. Yes, this means almost all of Florida.
5. Mandate emergency power systems for apartment and all buildings taller than 3 stories have solar panels, either passive or PV electric, for at least enough energy to keep minimal power usage, if within 10 miles of a coast. Even when stormy, these work, usually at 70-80 percent of sunny periods, and allow for service interruptions that can take months during anticipated 100 year storms, that will occur (not might, will) every 2-3 years.
Climate change is here, boys and girls. Sticking your heads in the sand does nothing.
-- Tigger warning: This post may contain tiggers! --
For your emergency survival kit, take a good long look at all the options for camping gear. If you aren't prepared for a month of camping, alone, way out in the wilderness, with just your emergency kit, you aren't prepared for a fire/flood/hurricane/earthquake. You'd be amazed at the dozens of small things you will need (or seriously want) but would never think of until you try a few days of camping.
* Hiking water filter or lots of purification tablets (1 gallon per person, per day)
* Multi-gallon water containers, and camp shower
* Tent or large tarp
* Air mattress & pump, or foam pad
* Heavy blankets or sleeping bag
* Heavy waterproof jacket, several changes of clothes, perhaps shoes, etc.
* Plenty of dehydrated food, and salt
* Lighter/matches, propane canisters and 1-burner stove, plus cooking pot/pan and utensils
* Prescription drugs, or just aspirin, antacids, etc.
* First aid kit with numerous bandages, antiseptic (iodine/alcohol), burn ointment, and sewing kit.
* Large knife/hatchet/saw
* Shovel, toilet paper, and soap.
* Toothbrush, toothpaste, and deodorant
* Solar AA/AAA battery and cell phone charger combo
* Spare LED flashlight
* AM/FM/shortwave radio, and perhaps CB/FRS/GMRS/Ham radios
* Compass and a map
* Probably a few others that slipped my mind.
And be sure most of the above is in fully submersible, water-tight containers, like freezer bags or food storage bins.
Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
Slashdot, you are really a piece of shit.
That makes sense. Hurricane season has been going on for a few months now. Why the hell would a data center or organization review their hurricane/storm related disaster checklists now instead of, oh, you know, before hurricane season? when Hurricane come then electric may be cut. that why you need a generator . i think we should visit website: http://mayphatdiencu.vn/ and buy a new generator.
At least none so far. There have only been two small ones.
I guess Global Warming doesn't cause killer hurricanes after all.
2013 is the year hurricanes seem to be taking a vacation. /Florida!
I am the unwilling control for my Origin.
Or just get a cooler that runs off propane. You would get a hell of alot more use out of that. http://www.propanecooler.com
>> which kept its Manhattan datacenter running during the storm by creating a makeshift bucket brigade to carry fuel to the building's 17th floor
No fire code violations there, right? I'd love to be an attorney near this one. "So, you burned down the building trying to keep a couple of servers running, when you could have just co-located your equipment in a smarter place (like anyone who knows what they're doing would have done)."
When you're doing things like HFT, colocation in a different geographical area is a non-option. They're eking out every microsecond they can, even going so far as to use microwave for communications when possible instead of fiber simply for the reduced latency. Putting the servers way the hell out somewhere away from Wall Street is not helpful.
Surely you don't think that these companies have large datacenter operations in Manhattan just for the cheap real estate?
Somehow, I doubt that they were doing HFT after Hurricane Sandy.