The Root of All E-Mail
wiredog writes "A Washington Post story about the DNS, the VeriSign NOC, and some of the security therein." Especially interesting in light of the recent security lockdowns throughout much of the Western world. The havoc of losing the A root server would be bad, like Staypuft Marshmallow Man bad.
Obscurity is the first line of defense. The building is unmarked, its address unspecified in company literature and its managers tight-lipped about disclosing driving directions or identifying markings to strangers.
They are apparently okay with featuring the place in an article in the Washington Post, though. Sheesh.
I watched C-beams glitter in the dark near the Tannhauser gate.
Verisign offer Tours of their Virginia NOC. Do they take you there blindfolded?
0xB
Reading about the physical security is interesting. I'm wondering why they wouldn't just contract out with the Government and move the operation to a secure military installation somewhere in the DC area. There are plenty of them around there. Granted, it seems that they have taken care of their current security needs, but it might be cheaper/easier to locate it in a protected area that is already guarded. I get the feeling that "Security through Obfuscation" (the actual building) might not be the best policy.
Still fascinating though.
Jason
He's totally creeping out the Great One, eh...
Security through obscurity will never solve anything when used as the first line of defense.
If you're going to build a place like this, someone unauthorized will eventually find out about it. Hell, just look at the security of the government's nuclear research labs and the whole Wen Ho Lee fiasco a few years back. And nuclear secrets are far more dangerous than a temporary internet slowdown.
If I was them, I'd quit worrying about how plain looking and unmarked the building is and start worrying about how hardended it was made. Ideally, they would place it inside a mountain so it would be immune to various airliners falling out of the sky. Also, it would have a myriad of redundant network links.
Secrets have never worked in security before, and they won't work now. If they want to protect the root servers, they'll have to base it on sound engineering, not the assumption that no one will ever find which building it's located in (any network engineer with a sense of adventure and a flashlight can prowl the sewers tracing data lines, anyway.).
is Dogbert the CIO at Verisign or something?
"He who controls the information controls you. I CONTROL THE INFORMATION!!"
read the article, massive redundancy in that you have to take 8 of 13 down before you really cause havoc. looks like the single A can be mirrored from any of the subs if it was toasted. since they're distributed geographically, it's not all doom and gloom
"Obscurity is the first line of defense. The building is unmarked, its address unspecified in company literature and its managers tight-lipped about disclosing driving directions or identifying markings to strangers."
Hmmm....
VeriSign Network Operations Center
21345 Ridgetop Circle
Sterling, VA 20166
I don't think security is *quite* as tight as they say. Course, if A root where to go down, I wouldn't know the difference betweent that and the crappy windows DNS servers here....
Venkman - "I'm a little fuzzy on the whole good/bad thing. What do you mean, bad?"
Egon - "Try to imagine all life as you know it stopping instantaneously and every molecule in your body exploding at the speed of light."
Ray - "Total protonic reversal..."
Venkman - "Alright, important safety tip. Thanks, Egon."
Ah, one of the great comedies of the 80's...
---
"how can the same street intersect with itself? i must be at the nexus of the universe!" - cosmo kramer
Hemos said...
Especially interesting in light of the recent security lockdowns throughout much of the Western world. The havoc of losing the A root server would be bad, like Staypuft Marshmallow Man bad.
Absolute proof that the Slashdot editors don't even bother to read the articles, and just depend on their wrong understanding of things.
From the article...
"The DNS is built so that eight or more of the world's 13 master root servers would have to fail before ordinary Internet users started to see slowdowns, according to John Crain, manager of technical operations for the Internet Corporation for Assigned Names and Numbers (ICANN).
ICANN manages the DNS and sets policies for registry operators and domain name retailers.
"Theoretically, if 'A' were to disappear, we could pick it up from one of the other servers," Crain said. "Moving the place where the zone is picked up is very simple."
In other words, don't panic. The A server is just the highest profile target.
Sometimes it's best to just let stupid people be stupid.
The article seemed to be a little scare-mongery, considering how they go on to describe that the other root servers can easily take over.
A bigger question is: how well protected are the public peering points, like MAE East and MAE West? Since even international traffic is often routed through them, we would see an instant slowdown if one of those two nerve centers were destroyed. Big businesses might have private peering arrangements that would survive, but you can bet that a ton of smaller sites would be affected by a loss of a MAE.
Your right to not believe: Americans United for Separation of Church and
The slashdot post is misleadingly sensationalist (I know, shocking!)
The article states that 8 of the 13 root servers (which are located throughout the US) would have to fail simultaneously before internet users would even notice something was wrong. I think that qualifies as "a little redundancy"...
Liberal (adj.): Free from bigotry; open to progress; tolerant of others.
Actually, the article states that the redundancy does exist, and that the A root server is not really a target; 8 or more of the 13 master servers located around the world would have to be taken out before internet users would even begin to notice.
Out of curiosity, I've seen pictures of lots of NOCs that have similar setups as what's described in the article. What kind of software is usually used for putting real-time "war room" statistics up on NOC displays? Is it usually custom-written for each setup?
Hmmm, the article seems to make a BIG point out of the fact that losing the A root would be non-catastrophic. Indeed, they mention that 8 of 13 roots would have to be down before the average user would notice the slowdown. It's nice to know the users here aren't the only ones who like to post without reading the article.
But the article further goes to mention how important the Internet is to our economy. Is this true?? I don't really think of the internet as critical infrastructure.
If the Net went down tomorrow, and was down for a week, would this really affect the economy in a signifigant way?? (Well, aside from the panic of investors...)
I understand that more and more comapnies are using the Net in a part of their workflows, but I don't think the internet provides and unique service that couldn't be done without.
E-mail: Use the phones.
Web: Read a book
Any data that is transferred could just as easily go by modem.
The internet serves as a convenience in many ways, but I dont think this almost 10 year old (less in the corporate mind) bit of infrastructure has become crucial to us yet. It has really been just the last few years that anybody started doing anything with the net at all, and mostly that has been VPN and changing communication methods. (i.e. Use the net instead of UUCP and a modem.)
So, my question is, what kind of critical services would be missing if the net suddenly went away. Sorry, I do not consider e-mail a critical service.
~Hammy
nothing4sale.org
anyways, just food for thought.
Lawyers, MBA's, RIAA? A jedi fears not these things!
I was surprised that the equipment is on the top floor.
It would seem that you would be better off going w/the basement. In fact the deeper the better, I would think.
Airplane strikes come to mind as one reason.
Or the fact that if someone took out the ground floor- the floors above it go too, but if you are deep enough that could be avoided.
Apparently physical security isn't of the utmost importance, as they say.
The raised floor is always good- or the night guy's beer wouldn't stay cold.
.
It's hard to believe that's how Micronians are made. Why don't we see it right now by having you both kiss one another?
IN AD 2002 WAR WAS BEGINNING
(Scene: Verisign Data Center inside Washington DC. Huge explosion on top floor of red brick office building, sending flaming servers flying through the night sky)
(Cut to home of Verisign CEO, he is in bed with his fat wife, snoring loudly. The phone rings, and he wakes up, wiping the slobber from his chin while answering)
Verisign CEO: "What you want!"
Voice on the phone: "Somebody set us up the bomb!"
CEO: "What you say!"
Phone voice: "We get signal!"
(static on phone, all of a sudden a voice breaks in)
Arabian voice: "How are you gentlemen? By the Grace of Allah, All your A Root Servers are belonging to us! You have no chance to survive, make your time!"
CEO: "It's YOU! Restore backup! Implement Emergency Response Plan A! Move every server! For great justice!"
Arabian voice: "HA HA HA HA HA HA HA!"
mje0w!!!1!
You need to read RFC 2870.
--
Mod up a post Rob doesn't like and you'll never mod again
The DNS system is probably one of the least problematic systems. The zone files that are spread out to the root servers are also "publicly" availiable. No, you can't get them (would be a problem because of spam, etc.) but ie. large ISPs can get them to run their own root level hiearchy. This is good for large ISPs as it will cut down on bandwidth usage. This might also be a great solution for the future. If ISPs hosted the root level zones themselves, the DNS system would be virtually unbreakable and the bandwidth usage due to DNS requests would dissapear.
The last thing I'd want someone to think is that they could put a bomb around their waist and hug the A root and think they're going to significantly impact the Internet," Rippe said.
Rippe said that while such an attack could kill many employees, the Internet's addressing system is designed to withstand the destruction of much of the physical infrastructure that houses it.
So the threat of someone cracking the DNS server and screwing it up in such a way that it wouldn't get noticed immediately could be worse. Let's say you start altering the records. Once that starts to replicate from the root server on down, you can cause a lot of trouble. Do that to just eBay's or Amazon's domain (or gasp! Slashdot's), and you could cause quite a stir.
Robotiq.com is heavily tested on animals
"Obscurity is the first line of defense. The building is unmarked, its address unspecified in company literature and its managers tight-lipped about disclosing driving directions or identifying markings to strangers.
While the location of the building is not a true secret -- dozens if not hundreds of Internet addressing insiders know where it is -- it would be difficult for a casual vandal or criminal to stumble across it, Rippe said.
And the casual vandal or criminal would be interested in it because?
For crying out loud, a 1 second Google search on "Verisign NOC" reveals the COMPLETE ADDRESS in a PARTY INVITATION!?!? in the very first result!
Yeah, I feel safe.
According to the article though, it would take 8 of the root servers being knocked out to cause this to happen. Those servers are spread throughout the world. One is in Japan, one at UMD, one by ISC, one was at NASA, etc..
Here is the current list:
formerly NS.INTERNIC.NET - A.ROOT-SERVERS.NET.
formerly NS1.ISI.EDU - B.ROOT-SERVERS.NET.
formerly C.PSI.NET - C.ROOT-SERVERS.NET.
formerly TERP.UMD.EDU - D.ROOT-SERVERS.NET.
formerly NS.NASA.GOV - E.ROOT-SERVERS.NET.
formerly NS.ISC.ORG - F.ROOT-SERVERS.NET
formerly NS.NIC.DDN.MIL - G.ROOT-SERVERS.NET.
formerly AOS.ARL.ARMY.MIL - H.ROOT-SERVERS.NET.
formerly NIC.NORDU.NET - I.ROOT-SERVERS.NET.
temporarily housed at NSI (InterNIC) - J.ROOT-SERVERS.NET.
housed in LINX, operated by RIPE NCC - K.ROOT-SERVERS.NET.
temporarily housed at ISI (IANA) - L.ROOT-SERVERS.NET.
housed in Japan, operated by WIDE - M.ROOT-SERVERS.NET.
bbh
I have a world map with root-servers pointed on it, looks like the area in which the A server is (Virginia, Maryland) hosts not one but six (A, C, D, G, H and J) servers, some of which (like H, run by US Army) are probably veeery well defended...
I found a link to the same pic on the net:
cs.ucla.edu
...or maybe just nuke the whole area and you take down 6 of them
Vacuum cleaners suck. Kings rule.
From the article:
Liberal (adj.): Free from bigotry; open to progress; tolerant of others.
DNS is already distributed. You're friendly neighborhood ISP caches the most often used DNS info, and 80% of internet traffic is resolved there. Only a small portion of traffic has to be escalated to a root server. That's why, as the article said, 8 of the 13 root servers would have to be taken out simultaneously for users to notice any slowdown. An attack on the A root server would be more symbolic than actually damaging. Even if it was done by the Stay-Puffed Marshmellow Man.
Don't forget that Friday is Hawaiian shirt day.
Just snipping the connection between these machines and the rest of the world would suffice. I hope its more complicated than it sounds, but each of those machines has to plug into something, right? Just find where that something (all 10 zillion fiber cables or what not) exits the building in which it is housed and SNIP! All done!
In case of fire, do not use elevator. Use water!
"The DNS is built so that eight or more of the world's 13 master root servers would have to fail before ordinary Internet users started to see slowdowns, according to John Crain, manager of technical operations for the Internet Corporation for Assigned Names and Numbers (ICANN)."
Where did this magic number 8 out of 13 come from?
-- everyones not everybody and neither is everybody like everyone.
As briefly noted in the Post article, the DNS infrastructure, like most essential net technology, pretty much doesn't have any single points of failure. It's immune to local physical attacks or natural disasters. The article is just a sensationalist trip into a modern high security datacenter full of Ooh-ing and Aah-ing, and doesn't have much relevance at all to the security or stability of the 'net.
11*43+456^2
I was thinking at least round-robin DNS cluster but it seems like A root server is just one box. I'd worry about hardware failure more than terrorism if it was just ONE machine running the zone. What kind of hardware does the A server run on anyways?
There's 10 types of people in this world, those who understand binary and those who don't.
It was stated that if 8 of the 13 root servers were destroyed, the internet would slow down?
Ummm... no. It wouldn't slow down. DNS resolution would stop. Thats it. Most users might think the entire internet came to a complete halt, but thats not the case.
Skiers and Riders -- http://www.snowjournal.com
Comment removed based on user account deletion
No one mentioned that this building is one of the approach paths of Dulles Airport, where the plane that hit the Pentagon on Sept. 11th took off from.
Hows THAT for security?
-db
Throughout the world, I would imagine.
One line blog. I hear that they're called Twitters now.
So.. let me get this straight. Verisgn realizes that they basically "run" the internet and as a result they don't care if they blow customers off. I'm sure I'm not the only one who has had major issues with Verisgn. Even writing to them for a simple answer to a simple question about how often domain names are flushed from their database results in them coming back to me with a request for more information. I ask them
"> How often do you guys "flush" your database so
that expired domain names
> become public again? There are some domain names (even ones I've owned
> but not renewed that after a year are still in the database)."
and they say:
"Please know we genuinely want to help you in this matter.
In order for us to assist you please send the following to:
customerservice@networksolutions.com
a) A detailed description of your concern or question
b) The domain name
c) account number (if applicable)
d) Any NIC tracking numbers you may have received. These
appear in the subject line of the header of all messages
sent from VeriSign (example: NIC-010409.3ee1)"
What Ever! I included more then enough information in my e-mail. Perhaps the fact that Verisng is "god" of internet domains and NSI is the reason they haven't expired domains that have expired since 1 - 1 1/2 years ago!!!?!?
If someone should be able to knock out all these root servers, zone-files and the major DNS's in the world the net would still excist. In the days to follow such a thing hackers would start running DNS-servers, searching logs and reconstruct the domains. Following weeks governments world wide would have reconstructed the net on more solid bandwidth.
Look a monkey!
Just FYI:
:-)
The root-servers know where to find everything which is below the root (like com, edu, net, nl, au, cn, tw, us).
The gtld-servers (global top level domain, i.e. the non-country codes) know where to find everything which is like philips.com, freebsd.org and berkely.edu.
The country-code-servers know where to find xs4all.nl, org.au and co.uk.
In the past I've made a small tool called dnstracer (shameless plug) which shows you what queries your DNS server is doing to get the answer for a hostname.
If you play a little bit around with it you'll see how easy it is to live without connectivity to the root-servers.net machines, thanks to caching etc. Well, for the first two days that is
bash$
This fellow frankly doesn't know his head from his /dev/null.
Anyone following the Wen Ho Lee scandal would know that the whole thing was enormously overblown. In the end, he was let go with a misdimeanor dealing with improper storage of data, and the judge sincerely apologized for the government.
Bob
Science, like Nature, must also be tamed, with a view turned towards its preservation.
The internet serves as a convenience in many ways, but I dont think this almost 10 year old (less in the corporate mind) bit of infrastructure has become crucial to us yet.
Think about any business that uses a PBX phone system. You may have 2,000 internal phone numbers, but only 500 outside lines. Suddenly the PBX goes down. Most likely your entire company loses communications. Within a couple of days you could have those 500 lines distributed to your workers, giving 1/4 of them direct lines. Then you have to worry about getting those hundreds of phone numbers out to every client and potential client.
Business use this scheme because it is much cheaper than having as many outside lines as employees. And it's more convenient to administer. Could businesses go on without it? Sure. But the short-term dislocation would be horrendous. It's the same with the internet. Those businesses that rely on it use it for cost and convenience. They could do without it, but the transition would be painful.
Nope, no sig
In any security situation all you would need to find is the weakest link. It doesn't matter how well that building is protected it needs to comunicate with the world and therfore this issue is more complex than it sounds.
DRM? No thanks, I'll just get it somewhere else...
Since keeping a low profile and getting a relatively calm surrounding for this 'A' box is evidentially vital, I propose that the server is moved outside of the U.S.A..
;-)
Since terrorist attacks (hackers == terrorists, right?) are the largest threat to this system, it is obvious that such vital machines should not be put inside the backyard of Uncle Sam.
This might also be helpfull if the system actually turns out to be helping in circumventing any US patents, and thus violating the DMCA or whatever strange stuff you do over there.
Once upon a time, the MAE NAPs were certainly a big choke point. A few years ago, you could have blown up two nondescript buildings across the street from each other in Tyson's Corner, VA (MAE-East 1 and 2) and a tall building on Market Street in San Jose (MAE West) and pretty much taken down the Internet.
However, that's not so much the case today. The fact is that most traffic (in the US at least) goes between the Big Three (UUNET/WorldCom, Sprint and Cable & Wireless), or at least it could go because most networks have an upstream multihomed connection to one or more of the big three. And those guys have plenty of private interconnections, some of which are outside of the NAPs.
Networks have also shifted away from the old MAE model (FDDI connections into these huge mother-f***er DEC gigaswitches housed in the MAE buildings) and towards ATM-based NAPs, where you just get a virtual circuit in a "cloud" in the area. The weakness of the FDDI-gigaswitches model that caused people to move away from them was not the security aspect, but rather that they were a huge pain to upgrade and became a huge sinkhole for packet loss when they were overburdened (e.g., MAE-East in late 1997).
Of course, the MAEs still are important - there's a hell of a lot of fiber running through there, and taking it out would require everyone to route around it, causing a HUGE temporary disruption - but they're not the tremendous choke point/security risk that they once were.
"95% of all Slashdot
Hey... this Staypuft guy isn't so bad... He's a sailor... he's in New York.... We get this guy laid, we got nothing to worry about...
Winston: This job is definitely not worth $11,500 a year.
Fire and Meat. Yummy.
I thought the root of all e-vil^H^H^H mail was outlook?
"The last thing I'd want someone to think is that they could put a bomb around their waist and hug the A root and think they're going to significantly impact the Internet,"
Forget the bomb. What techie wouldn't get a boner for the chance to "hug the A root"?!?
I'm against picketing, but I don't know how to show it.
"The reason why you're seeing such a focus on VeriSign is that the safety and the integrity of these systems needs to be analyzed and needs to be improved upon regardless of how safe they currently are." -- Commerce Department spokesman Trevor Francis
No matter how good it is, we need to improve it. That makes a whole lot of sense. 'Hey people, we're doing something to make you safer!'. What a bunch of loons.
The whole "Wen Ho Lee fiasco" was a lot of FUD by the FBI to coverup the fact that they knew nothing about how nuclear secrets were stolen.
Yes, he broke a lot of regulations by allowing his daughter to login, copying data onto floppies to keep safe, etc. I know his daughter and we used to play the same MUD and she used to login to his account in order to get a better network connection yet they made it out as if he was letting Chinese secret agents into his account instead.
Mmmm.. Donuts
I remember stories of the SUN-boxes being replaced last year by IBM AIX monsters:
:-)
here
Oh well, maybe it's only a.root-servers.net but still
bash$
The havoc of losing the A root server would be bad, like Staypuft Marshmallow Man bad.
Psh! I don't care if all DNS servers collapsed! I've got 64.28.67.150 tattoed on the back of my hand.
Pinky: "What are we going to do tomorrow night Brain?"
Brain: "I would tell you Pinky but this 120 char limi
[Your] friendly neighborhood ISP caches the most often used DNS info, and 80% of internet traffic is resolved there...That's why, as the article said, 8 of the 13...
Actually, the reason you'd have to take out 8 of the 13 has nothing to do with caching. It's because the root DNS servers MUST be able to handle three times the peak traffic of any one server at any time; that is, normal traffic, with all servers operating, MUST never exceed 1/3 capacity of the server in question. This is part of RFC 2870, the RFC that specifies operational details for the root servers. The RFC specifies this level of capacity to provide for redundancy; that capacity means that we can lose 2/3 of the servers without overloading the remaining boxen. 8 is just a shade less than 2/3 of 13, so that's where we get the number.
(Grammar correction mine.)
"Make it ten--I am only a poor corrupt official."
--Captain Louis Renault (Claude Rains), Casablanca
Why would terrorists want to attempt to destroy or cripple the Internet? It would be naive to think that they do not use it for communication and information. I could be wrong, but to me it would not make sense for them to try and destroy or harm the Internet as a whole.
Attacking portions of the Internet might make more sense, but I still do not think that terrorists would try to destroy or criple extremely vital portions of the Internet that affect it as a whole.
From now on, I'm viewing slashdot with images turned off. Fuck this shit.
"that's not encryption - it's a new perl script that I'm working on..." - from some Matrix parody
scp /etc/hosts root@new-a-root:/etc/hosts
and perhaps more importantly, what sort of software???
The RFC is clear, but is there a metric going with it measuring how much compliance to it is kept? Having 48 hours of backup power to the internet is great in theory, but are the 13 or so root servers that robust?