University of Twente NOC Destroyed
JanJoost writes "Around 08.00 CET today the University of Twente Network Operations Center, which amongst other things hosts a SURFnet PoP as well as security.debian.org and non-us.debian.org, caught fire.
The UT, which hosted the HAL in august last year is completely unreachable and is not likely to come back up any time soon. The fire department has given up every hope on protecting the server area and is now trying to protect the surrounding buildings.
More information can be found at the Telegraaf,
Planet Internet and Twentsche Courant.
Pictures can be found here and here.
It's a shame to see a great infrastructure go down in flames like this."
From debian-devel, here's a slightly (only slightly) more informative blurb
... I hope nobody was hurt.
After that, I wish them luck getting back online.
42 - So long and thanks for all the fish.
More images can be found on http://www.bsdfreaks.nl/files/brand.htm
.sig: No such file or directory
Hope everyone made it out...
Would a Halon (sp?) system have prevented damage in the server room?
Capacity usage of the world largest interconnection lines roughly halved today.
The cause of this is thought to be a steadily decline in warez/divx/mp3 traffic. The underlying reason for that is still unknown.
..to see how this could be prevented in the future. How much fire protection do NOCs owned by the big boys (Verio, WorldCom) have? Offsite backups, too, I hope?
Don't get me wrong, but I'm sure that MS did that. As this (Linux) is a community project, I believe this is our best opportunity to knee MS.
Hey how about a link in English for those who are unfortunately unilingual?!?
Ben
"which amongst other things hosts a SURFnet PoP as well as security.debian.org and non-us.debian.org "
security.debian.org and non-us.debian.org are GONE (well, burning, hopefully data can be recovered). Yes there's mirrors, but it still sucks.
Free Mac Mini
This shows the vunerability of putting all computers in one building. To have a safe network one needs to spread (duplicate) the information over several computer at several locations. How far apart these locations has to be is depending on how important you data is.
It is a shame that a building hosting so many good initiatives should be the one to go, but as always: there is no excuse for not have a backup. By that I don't only mean that tape that always seems to go missing when needed, but multiple sites (or at least buildings) that provide redundancy.
I hear the next version of ReiserFS is supposed to have protetion for this... :-)
-CM
To never keep back-ups in the same physical location.
This SIG pulled due to lack of funding. (This damn war is costing too much!)
Yowch :( That looks like one hell of a fire. I certainly hope there were recent backups. I'll observe a moment of silence for all that data gone up in smoke, and I suggest a 15 ping salute.
I really hope everyone got out ok... Its always a shame to see a NOC go down, especially one of a university where communication is quite vital... DK
It's the fastest university network in the netherlands, and it's running a lot of mirrors (debian mirrors and others). The most important thing: terabytes of warez. :)
(I believe it was the BSA lighting the fire :) )
.sig: No such file or directory
This is something I keep hearing from people, particularly those who balk at paying for upgrades to expensive fire suppression systems. "They're always built so well that there's never been a case of a server room destroyed by fire." I always did doubt that, and now whenever they tell me that, I can point to this.
What a shame.
You can never go home again... but I guess you can shop there.
Debian is not secure anymore?
From the description it sounds like this is one of the major Debian archives. Not a Debian user, or Dutch speaker, so I'm guessing from the original post.
The University of Twente's attempts to overclock the new AMD Opteron and Nvidia GeForceFX card in the same case are declared a failure. "We certainly won't be building a Beowolf cluster of these..." commented a spokesperson.
UNIX? They're not even circumcised! Savages!
"The room where SURFnet network hardware stands has been given up by firemen."
Never tell the firemen there is only linux geeky stuff on the computers, you need to tell them about your terabytes of porn to get them to work harder.
those crazy Dutch and their roaches
There are places where the networks are not touching,and there are places where they are-Boeing's Lori Gunter
Someone took "firewall" too seriously? :) :p)
(and this isn't *flame*bait
"The majority is always sane, Louis." -- Nessus
http://slashdot.jp
Better submit this one to Bugzilla...
Was anyone killed?
If not, was anyone hurt?
If not, do they have insurance?
If they do... well, I'm sure someone just lost their masterpiece pr0n directory, but otherwise, things like this happen. (ask Hemos) You have to make it through such things. In this case, it was a commercial (educational) building and no one is homeless, so it's less of a tragedy than usual. Let's hope that they rebuild with something better and newer.
That said, I get the feeling that those plumes of smoke really are millions of dollars floating away in the wind...
lo0.ar5.enschede1.surf.net 3613: Nov 20 07:20:50.927 UTC: %ENV_MON-2-TEMP: Hotpoint temp sensor(slot 18) temperature has reached WARNING level at 61(C)
few seconds later on the local side:
lo0.cr2.amsterdam2.surf.net 1146: Nov 20 07:20:56.458 UTC: %CLNS-5-ADJCHANGE: ISIS: Adjacency to ar5.enschede1 (POS2/0) Down, interface deleted(non-iih)
... got backups. Only fools ditch the backup procedure!
If the actually have backups it's only a matter of money/time before sites will be up'n'running again.
Thomas S. Iversen
But that's no problem, all i need to do is apt_get...
Does this mean that there will be no more apt_get interesting +5 posts in a while?
I hope Debian practices good management principles by having offsite backup.
Best Slashdot Co
That in the next year, most new OS documenation and projects will have several URLs built in for all online stuff (gentoo's Portage; TLDP; having a sourceforge page and a mirror, for example).
OS people learn quickly from mistakes like this.
Note to ACs: I won't mod you up, even if you are being funny or insightful. So take a chance! It's not real life!
They should've used a firewall.
good thing i can read dutch or else all these links would have been useless for me ;-)
They're not gone. They're just experiencing a Distributed Combustion Denial-of-Service attack.
In case one might be interested, Essent mirrored security.debian.org.
You can use debian.essentkabel.com to download the latest security updates (in case you haven't already). Please note this is NOT an official mirror.
Daxy's Networking Blog
Who posted a link to UT's webserver on slashdot?
Duct tape + WD40 => DevOps
Also, here's what seems to be the only close up I could find of the fire. pics
No man is an island, But if you take a bunch of dead guys and tie them together, they make a pretty good raft.
vaporware ?
the last syslog entry from AR5.Enschede1.surf.net to SARA: :-)
Nov 20 08:20:51 lo0.ar5.enschede1.surf.net 3613: Nov 20 07:20:50.927 UTC: %ENV_MON-2-TEMP: Hotpoint temp sensor(slot 18) temperature has reached WARNING level at 61(C)
Effective as it was, Halon was also a major ozone-hole cause, so it has been outlawed in most countries by now.
Two years ago a fireworks explosion leveled several city blocks. What is it with that place?
> ping -n 21 non-us.debian.org
Pinging non-us.debian.org [130.89.175.34] with 32 bytes of data:
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Request timed out.
Ping statistics for 130.89.175.34:
Packets: Sent = 21, Received = 0, Lost = 21 (100% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 0ms, Average = 0ms
Is there anything that could cause this naturally? I mean, judging from the pictures it looked fairly large and out of control...I hope no one caused this purposefully. I've never had to deal with a catastrophe like this, luckily...I send my best wishes of luck and hope to those involved and pray no one got hurt. =(
Zech Harvey, MCSE, MCDBA, CCNA
Dangerous server rooms
There are (should be) no mirrors of the security.debian.org ftp site. They want people to get the most recent updates, so they want them to avoid mirroring delays.
The SURFNet network was the managing server for the Keyserver.org organisation. An open and distributed network for the PGP keys.
Is that what happens to a web server when an article housed on it gets posted on Slashdot?
Time for them to switch to FreeBSD. With mirrors all over the world I don't have to worry about where to go for the source.
However, any fire destroying the building is a *bad* thing and if it's arson I hope they pin his nuts to the wall. I hope the data in the NOC is restored quickly.
Now, you see, this didn't happen through some random electrical spark or from some warez-eliminating conspiracy, the truth is that this building was just fine -- until it was slashdotted. Those pictures, well, those were posted later on. I mean, seriously, the link probably said "mad warez now!" for the first few minutes, then they changed it and put the fire story up.
Moral of this story: never underestimate the power of the slashdot effect.
Here's an update from SARA (that's where I work), the network operator for SURFnet. SURFnet is very busy ordering new equipment and fixing the 2 x 10 Gbit/s lamda's to Enschede. We hope to restore connectivity a.s.a.p. Greetings, Marco
Boy Scouts Of America? Which merit badge would that be?
"Witnesses saw a large balding man monkey dancing from the scene and a slim geeky man with glasses trailing behind continuously adjusting his glasses." An in other news....
The Dutch LFS FTP mirror was also hosted at the University of Twente, which means it's also down. The Dutch HTTP mirror should work properly, since it's outside utwente.nl space.
Last news is that HP (Who supplied most of the UT backbone equipment) is on its way with emergency equipment to have things up and running somewhere tomorrow.
...was good for something. My DSL d/l-speed doubled after the Cisco's at UT got smoked. :-)
"Honey, I feel a certain distance between us..." "Really? A 31ms ping ain't that bad..."
If you ever smell smoke in a computer enviroment, take it serious! I once was in a computer pool room and only the smell of burning paper made me aware of the fire. Only then i realized a beeping noise, simlar to the noises some computers or cardreaders make to draw maintainace attention towards them.
In that environment an old fashion siren would have been a much better solution.
Time to find out if their disaster recovery procedures work... There'll be a heck of a lot of running around trying to get some kind of infrastructure back in place now, I'd imagine.
I have yet to see any machine translators that will do Dutch to English.
The fire did not start in the server rooms. What happened was that a fire started in one of the lecture rooms (and a smallish one at that, number A108) that just happened to be in the same wing of the TWRC building that also housed the server rooms (yes, multiple). It then proceeded to take out two entire wings and threaten other buildings nearby as well as the library.
Now, I would *love* to see a halon system capable of stopping that...
Owh, and the fire seems to be under control by now, as evidenced on http://webcam.traserv.com/
(which you can contrast to http://www-infstud.sci.kun.nl/~arthurvl/ispy.jpg (taken at about 09:40 CET this morning)).
Let this be a lesson to all system archetechts: don't put stuff in only one place -- it could catch fire. With all the debian mirrors out there, I don't expect this to cause all that much trouble (obviously, if people had been hurt, that would be another matter, but apparently everyone got out in time).
Sig:Why copyright isn't a fundamental human right
Slashdot strikes again?
A large fire broke out in one of the college buildings at the UT in Enschede. The area has been closed off.
The fire broke out around 8:00 Wednesday morning. Nobody was injured. The fire department evacuated a number of buildings in the immediate area. It's expected that extinguishing the fire will take the rest of the day.
The fire caused damage in the tens of millions of euros in the IT services, among others, revealed (dean? I think) F. van Vught.
Van Vught said that backups of the network information had been made. "All information is saved". Classes will continue this week, due to tests. There were only a few students on the campus area Wednesday. Most test could not proceed on Wednesday.
In the burned building, used by the UT IT department, a part of the Management school was destroyed. The network was known as one of the fastest in Europe. An emergency network is now being deployed.
I believe, the open and distributed network of Keyserver.net (distibuted network of PGP keyservers) was hosted by SURFNet. This network is a distributed network holding PGP and OpenPGP keys. The loss the to UT NOC could have an impact on the updating of key-rings across the keyserver.net network.
The arson and destruction of private property badges. If a car burnt as well, they're well on their way to achieving the elusive 'inciting riots' and 'urban terrorist' badges. These last two were proudly held by a select few: Ted Kazinsky, Che Guevera, and Jimmy Carter
You think that I'm crazy, you should see this guy!
El Reg have an article up (http://www.theregister.co.uk/content/6/28204.html ) paying particular note to the warez / pr0n side of things.
that's what I call a flame war :-)
I agre with this with security patches you need to have them as fast as you can. Shame the servers are gone :-( hopefully they find a good new spot for them.
Actually, Debian security updates are usually also added to the proposed-updates section, which means that they are available on nearly all Debian mirrors worldwide.
Something like /etc/apt/sources.list should work well.
deb ftp://ftp.XX.debian.org/pub/debian/ proposed-updates main contrib non-free
deb ftp://ftp.XX.debian.org/pub/debian-non-US/ proposed-updates/non-US main contrib non-free
(replace XX with your ISO country code) in your
You can find mirrors on Debian's website.
O frabjous day! Callooh! Callay!
It started elsewhere. What about other fire supression systems? Sprinklers and the like?
Best Slashdot Co
I wonder if CNN's gonna broadcast something like "CIA has found links suggesting, that al-Qaida is responsible for this act of terrorism." ;-)
For security patches. and the non-us section. And a lot of other mirror are down now ;-((((
worldlingo.com has one.
O frabjous day! Callooh! Callay!
When a fire starts outside of the systemsroom you can have all the Halon gas you want, but it won't help. And if it would, the water used by the firedepartment would drown all machines. This is not just a datacenter which went up in flames, it's two wings of a whole building, which also happened to host the utwente.nl datacenter.
Now we can find out how secure and hardened Debian really is. You are as good as your latest backup.
BACKUPS BACKUPS BACKUPS Off-site! I've had enough of people who are talking about RAID-5 because 5TB tape drive arrays are too slow. Always keep your BACKUPS!
A caveman dreams of being us, the incalculable power and riches. We dream of being Q, then what?
[Apologies for the poor translation, no time for a better attempt]
The burning building contains the IT department and a part of the faculty of Business Administration [Closest I could come up with: Bestuurskunde]. The building has three storeys.
The university fears the loss of its network facilities and is trying to save the main computer. According to a spokesman this network is amongst the fastest in Europe. Most classes are expected to resume as normal today. [According to other sources, this is an exam week, meaning few classes anyway. This is also a reason that few students were around so chances were that this also reduced potential casualties]
The fire department is fighting the fire with 25 firefighters and expects to need the entire day to extinguish the fire. No dangerous materials have been released by the fire at this point. At the moment nothing is known about the cause of this fire.
I am geographically illiterate. How is "Twente" pronounced -- Twenty? Trent? Tweent? Twit?
Hmmm...
It looks like your REAL datacenter's web server just went down in flames, and the link's only in a comment, not the main story!
"A terrorist is someone who has a bomb but doesn't have an air force." -William Blum
You can't install new halon systems, but existing ones are still legal (in Canada, anyway).
However, I wouldn't want to have to fill out all the paperwork involved with a discharge! We had an accidental discharge (a leak, I believe) and they decided it was enough impetus to remove the system.
I think they are using CO2 now. The advantage of Halon is that you can breathe quite comfortably in an atmosphere that will not sustain fire. CO2 works just about as effectively but will not sustain life.
OTOH, more recent studies have shown that just because you can still breath in a Halon infiltrated environment doesn't mean that there are no health effects!
I expect there are more CO2 systems going in now, with lots of alarms to make sure people get out before the atmosphere gets unlivable.
Michael
I mean seriously, each tower collapsed because it was hit by its own plane. If one tower had been in NY, one in California and both were still hit by a plane each, the result would be exactly the same.
The lesson should be: Primary back-up is a very good start, but secondary/tertiary back-up is the thing if it's that critical.
Kjella
Live today, because you never know what tomorrow brings
could a slashdot effect save it?
I just lost my breakfast. Thanks ever so much.
If you want to read about the fire, go here. Apparently UT was a major node for KazAA, and'a primo source for warez and pr0n.
Wanted: One witty yet thought provoking
I hope they had an offsite backup!!!
The local Microsoft sales office reported on a recent visit of a corporate "fireman".
Yeah, yeah, whatever. In case you were not paying attention: the entire *building* (which happened to contain most core routers etc. - there are servers in other buildings as well, but they kinda lost connectivity) burnt down. This building not only contained the IS department (which, I'm sure, has active fire protection in its most data centers), but also normal offices, classrooms, etc. Once an entire structure is on fire and collapsing in flames, there's only so much your fire suppression system can do. In this case, it will most likely have evaporated... Fire suppression systems only help if a fire is *starting* in a protected area, not if the entire structure the system is in is collapsing in flames
Yes, security.debian.org, non-us.debian.org, qa.debian.org, and nm.debian.org were hosted on our machine there. Work on restoring all of them to another machine is already in progress. Packages aren't too much of a problem; the infrastructure running there will take a little longer to rebuild.
Fortunately the majority of the critical infrastructure was kept in CVS.
This brings to the forefront of my mind the fact my organization is currently devising disaster recovery plans for our new building.
The NIH Computer Center Disaster Recovery Plan is available online somewhere in pdf format and provided a good deal of insite.
Does anyone else have good hints on texts and outline for good disaster recovery plans?
___________________________________________
ACK
As you write it - Twente. Take 'Twenty' and replace the 'y' with the sound of the 'e' in the same word. DK
Now their whole network is Fire Wire based.
In Maryland a couple days ago several businesses in the same building burned to the ground after a medical supply company caught fire. The company supplied oxygen tanks.
Best Slashdot Co
${FLAG} waves in background, jet fighters fly by in a missing man formation, a lone bugler plays Taps.
How apt. :)
Looks like some bad karma generated from all those moron apt-get debian zealots.
Big deal, it's a fire and all the true zealots have been making the move to gentoo anyways.
... finally gets to make an appearance in earnest.
'lp1 on fire'
Real Daleks don't climb stairs - they level the building.
There I am wondering why my Debian machine's update script won't work, I bring up slashdot and find this story.
there's this:
l dl ingo_translator.html ....
http://www.worldlingo.com/products_services/wor
Fry: heh, Yakov Smirnoff said it
Leela: No he didn't.
...I was updating my debian & was checking
r ns.png
slashdot out of boredom because there seemed
to be a network problem.
[screenshot]
http://flaez.ch/scratch/twente_bu
Some damn fool wrote an assembly program that used the dreaded HCF instruction, didn't they?
Best Slashdot Co
Maybe I shouldn't have released that code after all...
Yours Truly,
Dan Kaminsky
DoxPara Research
http://www.doxpara.com
Comment removed based on user account deletion
...straight from the horse's mouth here.
There are some pictures, official news and infos.
-- Serge K. Keller
Quote from debian-devel-announce
At around 8 this morning (local time) a fire started in the computing facilities of Twente University. This affects Debian, since one of our servers (satie) is hosted there. At this moment it seems very likely that the machine can not be recovered from the fire.
The following services are currently down as a result of this:
security.debian.org
non-us.debian.org
nm.debian.org
qa.debian.org
We are working to restoring these services on another machine and hope to have things in mostly working order by tomorrow. Security advisories are still available at http://www.debian.org/security/
Wichert.
lp0 on fire!!!
(sorry, couldn't help myself...)
If bad puns were like deli meat, this would be the wurst
Nice? 'Arseonism' kinda gave it away.
I think upon furthur investigation, redhat is going to be held responsible for the fire - pure jealousy.
Whoops! Someone Spilled Beer on the Server!
The advantage of Halon is that you can breathe quite comfortably in an atmosphere that will not sustain fire. CO2 works just about as effectively but will not sustain life.
You've obviously never been in a Halon dump. Either that or you consider burning in your lungs to be "quite comfortable". Not to mention that if you're standing under one of the discharge nozzles at a dump you can get a nasty case of frostbite.
I've personally been through two 1211 dumps and had to enter a computer room and drag staff out after an FM200 dump. It takes about two days to completely stop coughing.
- If we aren't supposed to eat animals, then why are they made out of meat? - Steven Wright
See what happens when you get a beowulf cluster of those things? Ka-boom!
it's obvious that this fire was really caused by the RIAA/MPAA terrorists trying to target 'piracy terrorism'. It was only a matter of time before this new pre-emptive strike policy targetted the Really Free World: Western European Universities (The american ones don't count - they are just brands).
there are dead people, they won't tell you though.
welcome to the real world.
A friend and I once talked of developing a bunker somewhere out in California, preferably near a desert of some sort.
Above-ground military-like encampment, bunker deep below the earth, presumably safe from conventional and nuclear weaponry. Halon/etc. as well. You didn't see the warning lights? Sucks to be you, the data must be saved!
Now *that* would be a data center.
Actually, thinking back, this reminds me of various cyberpunk games I've played. The megacorps usually had installations like this. Hmm. Maybe we'll see a switch to better-secured locations in the future.
Damn. Too bad there's not more venture capital out there. *chuckle* What with the threats du jour today, I'm willing to bet that someone with an underground lair(tm) could make a pretty penny off of paranoid system administrators who are worried about their company's data.
Looks like somebody forgot to patch the firewall. *ducks*
--
If you moderate this, then your children will be next.
.. and they could have halt -n'd with a legitimate reason..
Still from what I can see with my nonexistent Dutch nobody was hurt and backups were fairly solid, which is about all you can ask for at a time like this.. Still, you know what this means.. NEW TOYS!!!!
I guess you could say it was NOCed out.
Just curious if everyone is ok, and if they have found a cause yet..
*insert M$ terrorist joke here*
---- Booth was a patriot ----
Twente's high-speed network was originally constructed to provide students with access to high-speed Internet access for their studies. It soon became one of the major hubs for peer-to-peer exchange programs like KaZaA. This perceived misuse of Internet resources caused former Dutch education minister Loek Hermans to comment: "It would be nice if the students at Twente University would use their fast connections for information and education purposes, instead of downloading huge amounts of porn."
Phil, just me
"Cattle Prods solve most of life's little problems."
You know, fuckit, one day someone, somewhere, may come up with something really cool like cold fusion, zero point energy, whatever... and no one will know about it.. Why is that? Because it'll be bloody slashdot'ed right out of existence within five minutes of being posted. goddamnit.
Request failed: printer on fire.
Because Mr AC, the "grandparent" isn't a freaking goatse.cx link.
I'm surprised noone has screamed "OH NO TERRORISM" yet.
Seems like everytime something happens we have to blame the evil terrorists first...then find out what actually happened.
At least no one lost their life in this fire. Well, unless you are a server. Hopefully this will turn out to be an accident and not arson or botched terrorist act. It always bums me out when inocent servers lose their lives ;)
"I bow to no man" - Riddick
World's Most Dangerous Server Rooms
Yes, I'm a bad bad person. But evil will always triumph, because good is dumb.
Ug... will someone please shoot me now? The "grandparent" is indeed a goatse.cx link. And I need some sleep. Sheesh, I never thought I'd have to apologise to an AC...
Is this what happens when you're slashdotted by God?
Hahaha! Even better. I had failed to notice the spelling due to a serious lack of sleep / coffee. Thank you.
Might this fire have something to do with this, one cannot escape wondering?
Nah. Al Gore already took that name. Or was it the 'Information superhighway'?
Maybe it was a flame war between students? Were they overclocking? The dangers of using FireWire. Were their harddrives Quantum Fireballs? (They are now) Is this what you get when you try to hot-swap them?
Other sad jokes will no doubt follow.
That'll piss off the warez monkeys. They were a source of several really big sites...
:-)
Kind of hard for them to complain though.
This is a translation from the telegraaf (which, btw, isn't the best newspaper in holland, but anyway..)
"University network down from fire"
"ENSCHEDE - A fire in the computing center from the university of Twente (UT) in Enschede has caused a few 10's of millions of euros damage on Wednesday.
The fire, which broke out about 8:00am, has disabled the universities network. There were no injuries. The fire department has cleared out several buildings in the nearby facinity. The IT departments of the UT and a part of the business studies department were housed in the building where the fire broke out. The building was three stories high.
The fire department fought the fire with several dozen people and estimated that they would need the whole day to get the fire under control. There are, until now, no dangerous substances released. The cause of the outbreak is not yet known.
According to Van Vught, a backup of the network's data has been made. "All data have been safely stored". Because of exams, there were no classes at the time. There were also few students on the campus on wednesday. Exams on wednesday have been cancelled.
Staff at the UT want to set up a temporary network, which can take several days. Thousands of staff and students can not make use of the campus network until a temporary network has been installed.
One on-looking business studies student is shocked (?): "incredibly sad. It means that I can't do my assignments. Doubtless, a temporary building will need to be set-up to help the situation". The Saxion Polytechn in Enschede has made room available.
The web-site from the Enschede city council is not available because of the fire. The council used the servers from the UT. The Saxion Polytech is also without internet access for the same reason."
Okay, this translation is a wee-bit too literal, but it's understandable.
Michael.
So wait, the University of Twente NOC caught fire. Why? Was there a story posted on Slashdot's front page that linked to a server at their location? Or was this fire caused by something other than a hardy slashdotting?
Why bother.
Microsoft said they were looking for new strategies to counter the rise of linux, but who woulda thought they'd go this far?
I am a viral sig. Please copy me and help me spread. Thank you.
Seeing this happen just a few hours after the story about Which desktop distro will die first? is quite scary.
</sarcasm>
Nouvelles de jeux et technologies en français. TC
I bet they were stress testing Athlon T.birds there.
I understand from a post a ways down that the University is currently having financial difficulties. Does anyone know if there's been something setup, whether for the University in general or Debian in specific to accept donations? I know (even though I don't use Debian) that I would contribute a few dollars to help them pay for all the new equipment, and I suspect that there's more'n a few geeks out there who feel the same way.
the University of Twente
Most famous alumnus: Elmer Fudd
click
Next time use the allmighty <a> tag.
Utwente - The proof that admins shouldn't smoke
Apparently, klecker.debian.org (194.109.137.218) is now hosting security.debian.org (as seen in NS updates propagating).
have you been defaced today?
I wouldn't. Any halon system capable of doing that would literally be a killer in its own right.
Slashdot - News for Herds. Stuff that Splatters.
That's exactly what the Mojo Nation folks are doing now. Info at http://www.mojonation.net/.
fencepost
just a little off
...I believe you have my stapler?
Come on guys, where are the conspiracy theories???
UT hosted HAL2001 last year, surely it was the FBI / CIA / KGB / SMERSH / Mysterons / [enter your bad guys of choice...] getting back at those pesky linux hackers?
Did we slashdot these guys latley?
Free messageboards and more! Your girlfriend's seen myWang
Apparently, having fire supression gear in the lab was something these masters of infrastructure never thought of. Personally, anything involving Debian and fire sounds like a good thing to me. Now, if only the rest of the project would go up in flames..I can only dream.
sure, they kill everyone in the room, but they're also pretty good at putting out fires. What are they using... water?
For one thing, the NOCs and the switching centers of the major switched carriers aren't always even in the same building. The only people in the switching centers are people that need to be there and switching centers of major carriers all even occasionally share a building (maybe bad from a single-point-of-failure standpoint, but it means that they all get to exploit a single well-designed and well-placed building for a slightly more reasonable cost). The hardware rooms are all temperature controlled, are on replenishable power backup systems (to account for theoretically unlimited time off-grid), and protected from fire by gas systems (like Halon). They also generally don't have anything flammable anywhere (how did this fire get started anyway?). You've got to remember, in the US anyway, phone companies are considered utilities and governed by special rules as a result. If a city were being firebombed and police had ordered that civilians not be allowed on the streets, switch operators would be an exception to that rule. It's highly unlikely any of our switching centers would fail from much besides a natural disaster (floods have interrupted service before) or a deliberate attack.
...here's an example of why you should give it to him.
Gee whillickers. That sucks. I've heard great things about their infrastructure, mostly about HAL and how it went.
I can't read Dutch, or whatever the hell those articles were posted in, but, does anyone know how exactly the fire started? As we speak, I'm getting dressed with one hand and typing this with the other, on my way over to my own Uni's ops room. Just have to make sure my babies are ok.
Informatus Technologicus
apt-get
Oh come on, where's all of the jokes about the "School of Hard NOCs"?
"The School of Twente Hard NOCs offers course on Fire Safety"
42
..wel, there was nobody hurt or killed.
There has been a lot of asbestos freed, but otherwise it's ok. Everything is backuped and HP will have a small part of the network up by tomorrow.
To get the whole network up will take 3 weeks, insides say.
The main point is, is that the warez servers are not affected (I'm NOT kidding), that's because they are mostly located in the dormitories of the campus and not in the computer center.
security, qa & non-us.debian.org ARE down...but there are mirrors, mentioned elsewhere in this topic.
Moderation: +4. Modded 70% Funny and 30% Overrated. 100% Saturated.
How about this one:
Write free software
????
Insure Everything
Light a Match
PROFIT!
Since Debian doesn't have a 40 Billion dollar monopoly warchest to draw from, I'm assuming that some funds will need to be raised to get new boxes. This is a perfect time for uses to step up and make a contribution back.
*** Sigs are a stupid waste of bandwidth.
Hopefully Bruce Perens was in the building at the time.
I want to delete my account but Slashdot doesn't allow it.
now the GI's have free run! we are doomed! doomed!!!!!!!!!!!!
this sig steers like a cow. and i can prove it
can be found at the official backup utwente site:
/
http://srv1ut.utwente.virtu.nl/nieuws/items/brand
Moderation: +4. Modded 70% Funny and 30% Overrated. 100% Saturated.
Who the hell cares about debian or the people, as long as the warez are okay!
Psst! Anyone know where I can get a hold of the Doom3 alpha?
Business insurance is more costly, but has better service. If the word gets out that a certain company isn't able/willing to pay claims on policies with high quarterly premiums expeditiously, then all the companies that used to buy from that agency will go elsewhere. Fast.
Best Slashdot Co
OMG.. Arnold.c64.org wasnt hosted at UTWENTE was it?
"I bet I'll get blamed for this." --Mayor Quimby
Maybe it wasn't such a good idea to replace the consoles with laptops...
e rI D=14867&QuestionID=14929&CatID=40
http://www.computerproblems.com/answer.cfm?Answ
"Dude, your datacenter got Delled!"
I don't doubt it. That's a Class IV construction; I.e. mostly concrete and steel. It's really hard for fire to spread in buildings like that; You'd have to have notably flammable materials in any direction the spreads.
An excellent example of Class IV construction would be any recently build NFL stadium. I haven't been in one often, but I was struck by how far apart any flammable material (food carts, etc.) is. Even the hallway ceiling I saw was actually the bottom of the concrete steps above.
What's this Submit thingy do?
Our ISP bought an old legal office building for their HQ and colo facility. The place was built with file rooms to safeguard tons of irreplaceable paper documents - imagine thick concrete walls & ceilings, with heavy steel fire doors, rated to preserve the contents through an EVERYTHING-else-burned-to-the-ground fire.
Critical stuff is spread between the file rooms, with metal conduit, etc. protecting the few small holes they added for wiring.
Steel & reinforced concrete aren't quite obsolete.
It's easy to make up & spread cool- and credible-sounding stuff. Finding & checking hard facts is hard work.
I live about 5km away and at 11:00 CET I could still see a lot of brown/grey smoke in the air.
:(
frontpage.fok.nl (a dutch news site) reports the following, well at least not the article itself but in a reaction to it: "The D-wing was recently renovated to make it more 'fireproof', so there are no harmful gasses and such.
Every morning a backup is made from all the data. Unfortunetely, before this backup could be taken, it was already destroyed, which means data from yesterday morning is lost.
Tonight (CET of course) there will probably be an emergency network running at 10kb/s and the server will probably be online in 3 days. Until then Teletop (some kind of information system for communication between tutors and students) and the utwente email will be down. Something about the building: The TWRC building some kind of monument which included that the outside of the building cannot be changed. This means the renovation plans have to be the same as the orignal building."
At least I hope they got rid of the air-problem, because it really stinked in that building anyways. Too bad everything to lost. They were just about to move all the servers to another location.
I was just printing my report which I had to hand in at 12:00 CET when I heard it. I worked the last 24 hours to complete the damn thing and then this.
Lucky for me I don't have internet from the university, but it still sucks bigtime.
So much about a firewall...
sig(h)
Your reply is indeed off-topic (just like this one) and may even be a troll. The text is inconsistent and even flamebait - why would schools not teach knowledge? But I find this one of the most beautiful -1-rated comments I have seen in time.
Thanks.
(yeah, I know physics department != NOC, but this guy isn't very bright)
Next time don't be so fucking cheap and buy a fucking case ok you bums.
Back the end of Sept 2001 we had a lightning strike on campus where I work. It twisted around a tree, then went into the ground.
The UPS's worked great, and none of the power was affected at all. Howerver, the problem was when the lightning hit the ground, it traveled in all directions... eventually hitting the buildings themselves, and found the bundles of CAT-5 running below the floors, in the walls.
Being a small campus, we only lost 14 workstation network cards, 4 printer network cards, and 1 workstation. However, one of those buildings was where our main fiber / copper switch was for the campus. We lost two blades on that, as well as a few lesser switches.
The moral being: Insurance company only gave us about 40% of what everything was worth. In something like the fire we're all talking about, they may give some more, but nowhere near enough to bring the campus back up to where it was. There is going to be some significant cost to this university.
It soon became one of the major hubs for peer-to-peer exchange programs like KaZaA
DMCA enforcement in full effect
To read makes our speaking English good. - X. Harris
Interesting that almost all the pics there are in time-sequence...You could make an animation out of it.
I don't know how, but I encourage other people to try.
What's this Submit thingy do?
He, you might be right about that! :-)
(I'm one of the students who has an internet connection at the University of Utrecht.)
Instead of putting all the computers in one building, put half of them in two buildings. The main cost difference is some extra real-estate preparation. And if you've got a multi-gigabit network, it's going to multiple buildings, so spread out your routers. Huge centralized computers were really useful back when mainframes were the size of dozens of refrigerators, but if you're using modern machines, they're either rack-mounted or pizza-boxes, and or else they're PC-shaped. But you've got multiples of them and can spread them around.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
I guess the their boss fired the bofh.
----------
I sig, therefore I was.
Enschede ?? Remember: about 4 years ago, a fireworks factory ended up in flames. throwing out *huge blocks of concrete* in the sky. Many houses in the neightborhood were gone in smoke.
:-)
Enschede is a really hot place.
Halon (or at least most of the Halons used for fire suppression; not sure about all of them) is non-toxic, though it'll get you a bit high, like nitrous oxide or most solvents, so being stuck in the stuff won't injure you quickly (except from flying objects that were blown around by the gas pressure.) However, it's no substitute for oxygen, and you'll probably be wanting some oxygen real soon now. If you can remember not to breathe in the stuff, try not to breathe deeply, because there's more oxygen left in your lungs than the stuff you'll be breathing in, and unfortunately, while your body can generally figure out not to breathe in water or hot smoke, it's not as good at realizing that near-room-temperature inert gases aren't very useful. Mostly, don't worry about it - find a safe door to run for and run for it, and do some deep breathing once you're outside, and try to close the door behind you.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
Favourite prank I tend to play on foreigners:
Foreigner: (trying really hard) "Hoe gaat het?"
Me: "What did you just say about my mother?"
F: "Uh, uh, sorry... I didn't mean to.."
M: "Gotcha! Just kidding!"
Also, teaching foreigners lude words in dutch is lots of fun.
As for the "grokking" "understanding" and "enlightenment", well I tend to use all of those those loosely. It's just my whacky sense of humor I guess...
Thanks to Progress and Essent we have an uplink again.
Hi, this is a message from an Utwente student living on the university campus. We're back online.
A couple of guys set up a connection from one of the student buildings to the BB building which has a new uplink, using transmitter dishes.
It will take quite a while before things get back to normal. But at least we can check email and surf the web now.
Lots of people are helping to restore the lost network and computing facilities. People from XS4ALL drove from one side of the country to bring spare junipers and other equipment. The campus is already back online thanks to Virtu. Mail for student is being stored at a new backup MX server courtesy of Terena and zedz.net
Debian is restoring the lost services on klecker. At this moment qa.debian.org is up and running and the non-US and security archives are available as well, although their backend systems have not been restored yet.
Valuable lessons have been learned though: it is very useful to have machines on standby where you can switches services to when needed. Having backups of important data is also really useful (and we could have done a bit better at that. UTwente apparently has good off-site backups of its own data though). And having good insurance is also definitely useful.
Now take it like the bitch that you are!
yeah... thats it...
The big value of many of the disaster recover vendors, beside consulting skills, was traditionally that they owned mainframes, and assuming not too many people had disasters at the same time, they could mount your data on their mainframe without you having to spend a few million dollars to buy a spare mainframe - so they were basically selling part-time use of the mainframes. Transaction-based online services companies could sometimes live with this kind of environment, but not usually - if it takes a day to rebuild your database from backup tapes and journalling, that's probably ok for a manufacturing company, and maybe ok for a traditional bank, but it's a total disaster for an airline ticket sales system or an online stockbroker; even a couple of hours may be too expensive. So those companies often have to run their own backup sites, or at the very least will have a dedicated backup mainframe at the backup vendor.
One of the interesting technologies that's starting to affect this business is metropolitan-distance fiber optics for Storage Area Networks. Somebody else mentioned iSCSI, but for the mainframe world, Fibre Channel lets you connect processors and disk farms at distances up to about 30km, and for real computers (:-) Gigabit Ethernet on fiber also has a long range (and eventually 10gigE will be mature.) This is especially useful in some niche markets - Wall Street trading and banking firms can put disk farms in New Jersey, partly for physical diversity and partly for real estate cost reasons. They're also good for other downtown/suburban connections. Sometimes these are managed by the customer, but the internet data center business and local fiber providers are going hog-wild trying to sell this. (I work for AT&T, which is selling this.)
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
I hope they remembered to 'duck and cover'.
And in unrelated news, a huge hole was uncovered in Debian systems today, allowing anyone, from anywhere, to gain root access simply by connecting to port 80 on the machine.
LP1 on fire
stty: not a typewriter
process forked, no more processes
are all old Sys V UNIX error messages.
Hyperlinks are hard.
If I hear another bad joke about "flame wars" or "firewalls" in reference to this, I think I might puke. :-)
After that, I wish them luck getting back online.
Someone explain how the FUCK that can be considered insightful?
Yet again we see the need for moderators to pass an IQ test.
Well, you can say whatever you want, but they fixet connectivity quite fast: 21:57 -!- Wh|teDude [~whiter@utwente-gw.virtu.nl] has joined #clue (14 hours after the fire). SurfNET is already building a new pop and they expect it to be productionready.
I'm not a complete idiot... Some parts are missing.
Knowledge, in the sense intended, means "wisdom", not facts.
There is difference.
The substance of realization is immeasureable-compassion, and the means of realization is wisdom. Facts are just objects that attach one's mind to matter and ignosises.
karma and /. "karma" aren't identical: karma is cause-and-effect law, in mind rather than Newtonian mindless matter.
Eastern understanding is, to our culture's prejudice, beneath dirt, but is oft eleganter than everything we've come up with, and oft enough declares quantum stuff ( see Alexandra David-Neel and Lama Yongden's "Secret Oral Teachings in Tibetan Buddhist Sects" CityLights.com where the discreteness of "quantum" reality is outright declared, but ignored by us... ).
Messages to/for me ( in me journal )
What stunned me at that time was that they had sprinkler in a fairly modern building. I understood better when I got a hang of that companies general attitude towards its environment and its employees at that time.
ich bin der musikant
mit taschenrechner in der hand
kraftwerk
patch-2.4.20.log:
The above comment is right on, which idiot modded this down as flamebait?!?!? METAMODERATORS!
No man is an Iland, intire of it selfe; every man is a peece of the
Continent, a part of the maine; if a Clod bee washed away by the Sea,
Europe is the lesse, as well as if a Promontorie were, as well as if
a Mannor of thy friends or of thine owne were; any mans death diminishes
me, because I am involved in Mankinde; And therefore never send to know
for whom the bell tolls; It tolls for thee.
-- John Donne, "No Man is an Iland"
- this post brought to you by the Automated Last Post Generator...