Hurricane Floyd Shuts Red Hat Down Temporarily
I've received notes from a few different places that Red Hat will
be taking down its onsite servers for the duration of the Hurricane
Floyd. The staff is leaving at 3 today and the place will be closed
on Thursday. If Floyd doesn't cause any serious problems the
web and ftp servers (as well as the *@redhat.com
email addresses) will come back up soon by friday. Update: 09/15 01:01 by CT : FTP and WWW are mirrored offsite, and assuming DNS propogates properly service
should continue without problems.
Communications lines are fairly sturdy. Your thinking of an 'E' bomb.
-- I'm the root of all that's evil, but you can call me cookie..
Speaking from an alternate viewpoint (as always):
Many of my most problematic (both their fault and ours)customers (I do tech support) reside in Florida. With the widespread precautionary evacuations, our office has been able to claw out from under a heap of accumulated backwork because the phones have fallen mercifully silent.
I don't suppose Hurricane Gert can be Slashdotted into heading towards Florida and prolong the serenity of the Help Desk floor?
(Disclaimer: Not wishing widspread havoc on anyone except a select few customers who, by their very nature, don't know who I'm referring to *whistles innocently*)
Rafe
V^^^^V
Rafe
Opinions expressed by the author may not actually exist in the wild.
Wasn't the Internet orginally designed to survive a nuclear attack? These days a back hoe snaps a cable and suddenly all of Chicago is offline for three days. As for Red Hat, I don't think it's makes a difference because they're web site is blasse and you can never get into their FTP site anyway because it's always packed with downloaders.
:)
I am sorry for spouting off then.
Steve Ruyle
Ex Libris Veritas
Um no, Visual Basic is so easy, it shouldn't even count as a language. Ive had days where I have had a hangover, and I can still do Visual Basic and SQL....and I think the storm should take a detour....so there :-) I dont think we're in kansas anymore to-to!
Some of you may have heard reports of Hurricane "Gert" following in Floyd's dread path. IGNORE this false report! That is simply COMMUNIST PROPAGANDA! Hurricanes are natural. Any statistical analysis will show that this year's hurricane average is actually below average. GO BACK TO WORK! KEEP LOOKING DOWN! STOP TALKING!
"Substantially all of our communications hardware and our other computer hardware operations related to our Web site are located in Herndon, Virginia. Fire, floods, HURRICANES, tornadoes, earthquakes, power loss, telecommunications failures, break-ins and similar events could damage these systems."
...
"Our insurance policies may not adequately compensate us for any losses that may occur due to failures or interruptions in our systems. WE DO NOT PRESENTLY HAVE ANY SECONDARY "OFF-SITE" SYSTEMS OR A FORMAL DISASTER RECOVERY PLAN."
RedHat SEC filing is he re. (page 13)
Very ingenious to chain them to their desks by the way, I shall promote that idea if you do not mind.
And yeah, verily did the prophets of RedHat predict that there would soon be a great wind in the upcoming year:
Red Hat Linux 5.0 (Hurricane) Login: _
Don't label something "offtopic" unless you know the topic well enough to tell what's on topic.
Is that sarcasm?
We wanted to set up a webcam, but power to most of the building was turned off, so we get to just ping the router to see if things are up. :)
people THINK that indutrialization is responsible, the fact is that the temperature of the earth varies quite significantly. There have been several large varriations of temperatures in the past century. There were many large storms in the 50-60, then it slowed down, and now its going back up. The coldest time recorded i believe was in the mid 1850's. The net difference since 1850 is several degrees, but i doubt its that significant compared to the last 10,000 years. It is possible that in 100 years there may be fear of global cooling (guess who the enviromentalists will blame that on).
The global warming is happening, however nobody has yet proven it is a result of industrialization, its just environmentalists have made you believe this.
We have to reduce pollution, but we shouldn't do it in a knee jurk reaction to "global warming" at the cost of many peoples jobs.
Isn't this fantastic? This really is the first time I have seen the "de-centralized" property of the Internet in action.
Back when ARPA-net was designed, important data was mirrored accross the country in the event of an atomic explosion. I wonder if there is a market for such a "Emergancy Mirroring Service." I am suprised the insurance companies aren't all over this one already!
-AP
someone send that to microsoft...hehe
JediLuke
JediLuke
-Do or Do Not, There is no Try
You IDIOT!!! They are 120 miles INLAND!!!
I recall reading somewhere (and I could be mistaken) of a scientific study that showed more and more hurricanes are going to swing up and hit the east coast instead of swing under or over florida. I believe the culprit was global warming (which is caused by industrialization, which appears to be more concentrated in the northeast).
Would you risk that much equipment in 90+ MPH winds?
Seems odd that they only put on a 60mph proof roof, yet they put in lovely wood paneling and marble (fake?) floors. Maybe the building is leased? It would be a pity of something happens to it. It's really nice place.
We measure the times between power outages with our NetWare 4.11 server. (The UPS shuts it down after 5 mins without power).
The best our power company has done so far is 197 days. I wasn't happy.
Incidentally, the server is grossly over-specified for the job. It's a Dell PowerEdge 233Mhz box with ~40GB of disk and 384MB RAM. It serves 50 users so fast that they don't know it's there. It's unusual to see processor usage go over 3%. I like NetWare.
Ahh, an investment of time and effort now, could save them time and money later. I'm from Charleston, SC, and I've never seen a company move their computers to a safer place. I'm impressed that Red Hat is thinking ahead so well. I made good money after Hugo setting-up new machines. So many people leave their computers on the floor and/or near a window. The most serious preparation I've seen so far, is placing the computers on desks in case of flooding. Unfortunately, downtown Charleston is only 7 feet!! above sea level. I'm still sitting in my office in Charleston, and my company wasn't thoughtful enough to box up computers. Hell, they weren't even thoughtful enough to close. "Customers are more important than rain...," so says the PWB. I parked my car in the middle of the the second floor of a parking garage near King, and I'm getting a little worried about it now because lots of things are starting to blow around. Well, if the power goes out and our propane-powered generator blows off of the top of the building, then I get to leave (or go hide), because the computers and the phone system won't work.
Mailing lists are not being mirrored.
Christopher A. Bohn
cb
Oooh! What does this button do!?
we don't have hurricanes...and earthquakes are few and far between...come to Sunny CALIFORNIA!
JediLuke
JediLuke
-Do or Do Not, There is no Try
*all* ??? What about the plant in guadalajara?
I'm surprised that not more people sees the storm as just another ploy from RedHat to become the next M$;-)
Je ne parle pas francais.
"people THINK that indutrialization is responsible, the fact is that the temperature of the earth varies quite significantly. There have been several large varriations of temperatures in the past century. There were many large storms in the 50-60, then it slowed down, and now its going back up. The coldest time recorded i believe was in the mid 1850's. The net difference since 1850 is several degrees, but i doubt its that significant compared to the last 10,000 years. It is possible that in 100 years there may be fear of global cooling (guess who the enviromentalists will blame that on). "
What has happened in the last 100 or 200 or even 500 years is, for the most part, unimportant. People need to start thinking on a much longer-term time scale than their considerably short lives. The global warming problem is important in this respect. The problems with global warming models occur on time spans of several 100's to 1000's of years. What's would happen in the next 50 or 100 years is irrelevent. This is why it is important to assume that "global warming" theory is correct, even if it is hogwash. Only now, at basically the beginning, do we stand a reasonable chance of determing an outcome that may not be realized for several hundred years. If we can act in a way that would logically benefit the future, is it not our responsibility to do so? In all reality, is does not make sense to spend 20-100 years arguing about the data when the time to act is now. The only thing that could happen as a result of immediate action is a better world.
Red Hat also hosts the GNOME.org site, which does appear to be down at this time. (There may be mirror sites, but DNS has not been set up to send you there automatically.)
Software sucks. Open Source sucks less.
Electricity in these parts is not highly reliable; our UPSs seem to scream in protest about once a week, and every few months someone drives into a power pole and, whoops, there goes the power for an hour or three... There are few buried power lines except for the last distribution stage, so the whole infrastructure is extremely fragile. This situtation took me by surprise when I moved to NC from the midwest (MN and WI), where nearly all the power is buried and a power loss is something to write home about.
Time to go kick myself again for not buying a generator for home when they were relatively cheap. Maybe they'll be cheap again after Y2K fizzles. :-)
-- "Ever wonder why the SAME PEOPLE make up ALL the conspiracy theories?"
Heard on the net, in an uptime war thread, first talk about NT, then talk about Unix, then a guy piped up with a call he'd had recently to replace a disk in a company's NetWare server, the apps disk went down, but nobody in the company knew where the server was, the tech finally found it by tracing cables in the ceiling, the poor server was buried in the back of a stockroom, and had been up for slightly over five *years*, still running NetWare 2.15.....
Well, this is great. I waited and waited to get a power backup for my Linux server, and now I'm kicking myself for not getting one yet. Because I'm in New Jersey, I'm not getting as much of the hurricane as RedHat is, so it's not worth it for me to shut down the server completely 'till the storm is over. But if it does lose power, I'll be pretty pissed.
Maybe Floyd should do a detour through Redmond, as well..
A friend of mine works tech support at Red Hat, and they spent yesterday shutting down and boxing up desktops and stuff so that if the roof blows off the building, they can relocate the office quickly.
Why is this a possible problem? Apparently, Red Hat's roof is only rated up to sustained winds of 60mph. Considering the last forcast put us at winds of 80+ mph when it hits the Triangle, it might take a little extra time for Red Hat to get things rolling again. I hope they *have* someplace to relocate to.
Some of those support guys had uptime measured in months. Too bad. Now that they're down, though, some of the older ones can be upgraded. Penguin mints are just the thing.
I don't blame them for boarding up and getting out of there for Floyd, but wouldn't it have been possible to server their webpage and other services off of another machine - they do have other offices, right?
From a network engineering viewpoint, I am completely enchanted with the idea that we can build networks that will be available to online communities regardless of little inconveniences like category 4 hurricanes.
... :)
It stands as proof of the importance of the work that the geek community is doing that systems are regularly put into place that will withstand natural disasters. If this stuff wasn't important, companies wouldn't go to the lenghts that they do to make sure their web sites are up regardless of natural disasters and rogue backhoes. Here's to internet resiliency (assuming, of course, that the 'NIC doesn't screw up RedHat's zone propagation
good. fast. cheap. (pick any two, you can't have all three)
I don't blame them for boarding up and getting out of there for Floyd, but wouldn't it have been possible to serve their webpage and other services off of another machine - they do have other offices, right?
My company did something I'm very proud of - They shipped a bunch of volunteers from Tech Support in our Orlando office, and set them up in temporary office space in California, to assure service continuity.
This is responsible business practice.
If you call my company, and get through to tech support, then you probably know what company I'm talking about. Tho I'm posting anonymously, because I'm not sure if it's kosher to make this public knowlege, tho I'm not sure why it wouldn't be. Our company is a little paranoid about stuff like this.
Scratch, scratch. Yeah I do remember this happening.
M$ Spokesperson -
Lightning and hail cause the server to loose power. Yeah that's our story and we're sticking by it.
Ok not quite the same thing, but still...
"Some companies loose their services because of a thunderstorm - it takes a major hurricane to shut down RedHat!"
Comeone RedHat! where's the balls.. At least set
up a webcam for us poor smucks in the northeast
to check this thing out:) J/K
Go home.. board up.. Hope everything stays safe
down there. Can't have my favorite distro and its
staff washed out to sea can we.
Malice95
The internic used to require (or perhaps just strongly advise) that there be nameservers for each domain in separate geographical locations, with separate internet feeds. Seems like that would have been a good idea at a time like this.
Drugs, drugs, drugs. 99.7 "The Fox" is in Atlanta. I'm from Concord (just outside of Charlotte), and 99.7 is a country station. Dude, lay off those reds.
but hurricanes pack quite a bit more power than even atomic bombs. you gotta love mother nature.
I tried to find the article I read. In a quick search of the web, it appears that global warming will cause more intense storms. It also appears that El Nino causes less hurricanes to form in the Atlantic. Here are some links.
9 6/hurr_apr96/node6.html a nina/ s .html
http://www.usc.edu/org/seagrant/elnino/
http://typhoon.atmos.colostate.edu/forecasts/19
http://www.disasterrelief.org/Disasters/980728l
http://web.mit.edu/newsoffice/nr/1998/hurricane
Fascinating information. How we are changing the planet without having much control over what we are doing.
backup.
in a word, this is yet another benefit of open source. think of it - how many places does nt and other microsoft source exist? the latest redhat sources are her in ireland. they're all over the usa, europe, australia...
in fact depending on what the shuttle astronauts took up with them the source to linux (debian) was even in space.
so even if the redhat office gets washed away, redhat development can keep going. the same is true for any gpl'ed linux distro.
US Citizen living abroad? Register to vote!
Reuters(tm): "A spokeswoman for Microsoft said that Red Hat's outage is proof that Linux should not be considered stable and reliable. 'Microsoft servers, located on the West Coast, will continue to operate normally throughout the duration of this storm'."
Hurricane Fran. AQ
I'm not crazy. I've just been in a really bad mood for the last 29 years.
Well, Red Hat may have packed up and gone elsewhere, but I decided to stick it out. Not much going on yet (10:00 PM). A lot of flooding. We are supposed to get slammed around midnight. I was without power for a couple of hours, but as soon as it came back on I was visiting my favorite page. Do I get a t-shirt for that or something? Anyway, I'll probably be in the dark in a few hours, winds are starting to pick up. But I'll be bcak to check out the latest geek news in a few days. Wish us luck
It is possible to harden electronics against EMP. In fact, a mild hardening is always done on all long-haul power and phone lines since solar flares can produce the same effect, but at a much lower level. Both caused induced currents in conductor loops, but nuclear explosion EMPs have a far shorter 'rise' time than solar flares, and IIRC it's this rapid rise time, not the total power delivered, that causes problems to unhardened electronics.
For every complex problem there is an answer that is clear, simple, and wrong. -- H L Mencken
Here's a neat clip from RedHat's site:
Priority Mobile Health
Michael Boatright, CEO
For Priority Mobile Health, an emergency service provider, Red Hat Linux turned out to be hurricane proof. During Hurricane Georges, Mobile Health's NT server crashed and the Red Hat Linux server took up the slack. Before long, the Red Hat server was also carrying local government offices, giving them a Web site to post vital weather information, warnings and road closings that received thousands of hits during the hurricane. Not bad for a Pentium 133 on Red Hat Linux.
See, Red Hat should have nothing to fear. Good luck guys, and hope all turns out for the best!
The ozone hole is now shrinking and should be fully recovered in around 75 years at the current rate, as technology continues to improve it will be at an accelerated rate
Technology is not to blame, it is what will ultimatly help. At this time technology somethimes involves pollution, but in the long run it will help
I do agree that we have to look towards the long term, but what do we do if the earth starts to naturally cool?
Anyway, the hurricans have to do with la nina or whatever it's called
What more can I say? Id expect that a company like Red Hat had its Servers co-located at some type of data-processing-center environment and not in their local basement.
In the lond term, the earth is actually beginning what should be a warming trend (in the glacial/interglacial sense). This "should" happen over periods on the order of 10-50 thousand years (or more in some cases). We just need to ask what we are doing, that is unrelated to natural processes, to speed up the trend. When this question has been answered (personally I think it has), then the time to act is now.
I'm here at IBM-RTP, where we will *also* be closing up tomorrow.. no, it's not all of IBM, but it *is* the single largest IBM site on the planet, as well as being manufacturing for all of IBM PC (servers, desktops, etc)
Various ramblings
the internet can and will survive anything... it's just a matter of whether or not the hardware is still around to manifest it physically...
Insert mind here.
Why dont they just DNS to another site? You wouldnt even know they were down. We have a huge data center in JAX and everything went smoothly here after evac. ;)
~4.5mill and they cant set up a second office
-Kris
This just might be why my download of the latest Xfree86 rpms just stopped. :)
At least now I know it wasn't my problem.
Finkployd
Well, not too far from RTP you start to get into Charlotte radio stations, and 99.7 "The Fox" is the greatest radio station I've ever listened to. (Plus, it's the home of John Boy and Billy's Big Show, one of the greatest syndicated shows in the southeast!)
-Chris
*For the record, this is a hoax and not an actual article*
YDNet, Raleigh NC. - Many analysts expressed continued concerns today over the reliability of the Linux operating system. This operating system has recently made in-roads into the server market with support from major companies such as IBM.
However, it appears that, along with it's lack of multi-processor support and poor performance serving static web pages, the operating system lacks another feature required for the enterprise market: the ability to withstand a category 4 hurricane.
This problem came to light today as Redhat software prepared for Hurricane Floy by shutting down all computers at the Redhat site. This stand in sharp contrast to Microsoft's Windows 2000 operating system, which is currently being modified to better withstand large storms (see www.windows2000test.com). Analysts agree that Microsoft has more experience experience in recovering from this type of failure than any other enterprise operating system vendor.
Fred Foolish, an MCSE in the Raleigh area, was heard to say "Yeah... Maybe Linux is enough for a small company, but for companies that need to withstand more than a light sprinkle, enterprise class reliability is needed".
Fred Mud at Microsoft agreed. "One of the best features of our high-value proposition product, Microsoft Windows 2000,software is its ability to quickly recover from storms. Microsoft has a lot of experience in the area of post-storm recover " Mud also dismissed the announcement that most redhat.com services would continue, noting that it is generally agreed by enterprise analysts that Linux still needs to work on Enterprise Class features like clustering, saying "It's just impossible I tell you!"
Redhat software was not reached for comment at their Bahamas office in time for this story.
-- Slashdot sucks.
good job for floyd.. i mean i get to miss school tommorow because of it!! Of coarse it blows that all the redhat folks won't get to go on the redhat site, but I'm a slackware guy anyway. I just hope my power doesn't go out, my linux box will not be happy with me.
char *stupidsig = "this is my dumb sig";
If they'd left even a couple of low-priority machines up and running and they stayed up the whole time, they coulda said "Linux: The O/S that can withstand a Hurricane". It's a no-lose bet either, because if the storm took them out no one could blame the O/S.
It would seem that moderator priviledges are being given out to trained monkeys now.
- A.P.
--
"One World, one Web, one Program" - Microsoft promotional ad
"Remember when the U.S. had a drug problem, and then we declared a War On Drugs, and now you can't buy drugs anymore?"
It would seem that moderator priviledges are being given out to trained monkeys now.
- A.P.
--
"One World, one Web, one Program" - Microsoft promotional ad
"Remember when the U.S. had a drug problem, and then we declared a War On Drugs, and now you can't buy drugs anymore?"
If the building's trashed, they're not going to stay up or be able to come back up after the storm roars through. This is a CYA, let's keep things as "up" as possible throughout the the situation.
It makes a LOT of sense, what they did...
I am not merely a "consumer" or a "taxpayer". I am a Citizen of the State of Texas
Hey, a hurricane is coming? Wait a second, I think I know what that meens . . . . . . no school!!! Yippeee!
Whether /. users love or hate RedHat, I think we can all agree that we hope that everyone in the area gets out alive.
Usually I'm a cynical bastard, but hurricanes tend to humble me a little.
If there's one thing I've learned, it's not to fsck with Internic unless there's just no other way. As for redhat, by the time DNS updates, the storm will be over! So why bother fscking up DNS at all?
Dude...the Electromagnetic Wave would ruin electronics on a wide scale...rendering them as usless as a pile of rubble...
JediLuke
JediLuke
-Do or Do Not, There is no Try
Well, their stock is up 2 points, so I'm guessing it's OK.. ;-P
-- I'm the root of all that's evil, but you can call me cookie..