Slashdot Mirror


The Status of Routing Reform — How Fragile is the Internet?

crimeandpunishment points out the Associated Press's look (as carried by SkunkPost) "at an issue the government has been aware of for more than 20 years, but still isn't fixed and continues to cause Internet outages: a flaw in the routing system that sends data from carrier to carrier. Most outages are innocent and fixed quickly, but there's growing concern the next one could be devastating. A general manager at Renesys Corporation, which tracks the performance of Internet data routes, says, 'It amazes me every day when I get into work and find it's working.'"

32 of 139 comments (clear)

  1. between this and that dnssec thing... by gandhi_2 · · Score: 4, Funny

    ...i'm glad I decided to wait for internets2 before i get online.

    [posted via FIDOnet]

    1. Re:between this and that dnssec thing... by Anonymous Coward · · Score: 3, Funny

      No, it's on dogs. See, he posted from Fidonet! Dogs carry around TCPIP packets.

    2. Re:between this and that dnssec thing... by mrrudge · · Score: 2, Informative

      That's possibly not a great argument to bring up amidst an internet community likely to contain a large amount of people who's hard work stopped the millennium bug being a massive problem.

    3. Re:between this and that dnssec thing... by Abstrackt · · Score: 2, Funny

      Dogs carrying TCP/IP packets... is that more reliable than RFC1149?

      It's certainly more reliable than when they tried using cats. Not only was it very high latency but sometimes packets would get dropped or lost under the fridge. In most cases, the data wouldn't get delivered at all. Add to that the inability of RFC1149 to operate in the same spectrum as cats (too many mangled packets) and you can see that dogs were clearly the better choice.

      --
      They say a little knowledge is a dangerous thing, but it's not one half so bad as a lot of ignorance. - Terry Pratchett
  2. It is fragile by mysidia · · Score: 5, Insightful

    Kind of. However, it has also always been this way, and it has survived so far. All that has really changed is the number of players has increased, and the size of the routing tables are increasing.

    It has to work, so a lot of people should notice very quickly if something large goes wrong.

    It also cannot very easily be fixed, as many players would have to spend a lot of money for it to change, and there is little financial incentive to chase that ghost.

    And you thought IPv6 or DNSSEC adoption was taking a long time... imagine how many decades it would take for SBGP adoption?

  3. Not a problem by Anonymous Coward · · Score: 5, Insightful

    First of all, the US federal government shouldn't have the power to do this even in America, and it definitely doesn't have the power to enforce this in the rest of the world.

    Secondly, no sane ISP will forward BGP data.

    This limits the problem to people with access to core internet routers. Companies that own these routers should only give access to extremely trustworthy people, and even then, they should still only need to access the server when there's a legitimate change. The issue then lies with accidents, which will always happen, no matter what you do, and corruptness. Corrupt ISPs should be removed from the network as soon as they are found to be corrupt.

    1. Re:Not a problem by freeworldtech · · Score: 2, Insightful

      I agree completely. Why does it have to be the governments job to fix everything. Personally I think we are all a lot better off if they have nothing to do with it.

    2. Re:Not a problem by KahabutDieDrake · · Score: 5, Insightful

      Yeah, I wish the government would have never even gotten involved. The internet was so much better before those bastards stuck their dirty fingers in there. :stare:

  4. Two words.. by Anonymous Coward · · Score: 3, Informative

    BGP Filtering. There, fixed that for you.

  5. Use phone to manually change routes? by schwit1 · · Score: 5, Insightful
    Better make sure your phone system is not on the same network or any affected.

    "In the meantime, network administrators deal with hijacking an old-fashioned way: calling their counterparts close to where the hijacking is happening to get them to manually change data routes. Because e-mails may not arrive if a route has been hijacked, the phone is a more reliable option, says Tom Daly, chief technical officer of Dynamic Network Services Inc., which provides Web hosting and other Internet services."

    1. Re:Use phone to manually change routes? by Charliemopps · · Score: 3, Informative

      Not when every ISP out there is voiping everything out of soft switches. There is no "Old school phone system" any more. It all VOIPS eventually. Any major data outage WILL affect voice as long as it's on a lower layer... i.e. DNS problems shouldn't cause a problem but routing issues certainly will.

    2. Re:Use phone to manually change routes? by MichaelSmith · · Score: 5, Funny

      How about carrying an iridium phone?

    3. Re:Use phone to manually change routes? by scdeimos · · Score: 3, Informative

      Unfortunately you can't make that assumption any more.

      Even national telcos, such as Telstra in Australia, are routing all of their landline and mobile voice and data telecommunications over IP networks (and have done so since 2007).

    4. Re:Use phone to manually change routes? by MichaelSmith · · Score: 2, Insightful

      No solutions look heavy when you have been using Eclipse.

  6. Route filtering by Anonymous Coward · · Score: 5, Informative

    Route filtering, USE IT!
    Especially when peering with Pakistani/Chinese/etc ISPs.
    This is why RIRs such as RIPE/ARIN/APNIC have their information publicly available.
    So you know which addresses belong to who.
    Only accept routes from your BGP peers that you know belong to them.
    This also (in addition to hijack prevention) prevents a clueless NOC monkey from another autonomous system from messing up your whole network by announcing a default route.

    1. Re:Route filtering by sych · · Score: 2, Interesting

      What about ISPs whose customers bring their own portable IP address space along with them, and then multi-home? (i.e. have two or more ISPs, and request BGP peering with both?)

      The directly-connected ISPs can do their checks to make sure that their customer owns that IP address and adjust their filters accordingly... but anybody else with BGP peering to these ISPs (i.e. other ISPs) can only hope and pray that their peers are doing the right thing. Blind faith might not be good enough.

      As I understand it, SBGP would implement PKI and digital signatures to ensure that only someone who actually *owns* a particular netblock/ASN can advertise a route for it.

      Currently, anyone can advertise pretty much anything and it's only individual ISPs filtering settings that would prevent it getting propagated.

  7. Re:The Internet is not going to end by Aeternitas827 · · Score: 2, Informative

    But there are only 13 internet root servers . . . .

    13 root DNS servers...this is a different protocol altogether. I don't pretend to understand real well--VLSM/CIDR confuse the hell out of me, and that's where I gave up trying to understand the nuts and bolts--but there's a very large number of systems whose routes would need to be compromised, and quickly, to make this have an effect that is visible to end users--and even that would be short lived. As the parent put it:

    This "hijacking" happens all the time, people immediately see it and fix it and nobody notices.

    --
    I don't post AC. I like my -1, Flamebaits. Trump/Sheen 2012 on the Batshit Insane ticket!
  8. Next article... "How Fragile is Wikipedia?" by mysidia · · Score: 4, Insightful

    What?! Anyone can edit it?! Really???

    'It amazes me every day when I get into work and find the Wikipedia front page has not been blanked or filled with goatse porn.'

  9. Re:The Internet is not going to end by timmarhy · · Score: 2, Funny

    it's hard to work out if your joking, ignorant or stupid

    --
    If you mod me down, I will become more powerful than you can imagine....
  10. We know what kind of "solution" DHS has in mind by Daniel+Dvorkin · · Score: 3, Insightful

    From TFA:

    "It's kind of everybody's problem, because it impacts the stability of the Internet, but at the same time it's nobody's problem because nobody owns it," says Doug Maughan, who deals with the issue at the Department of Homeland Security.

    So clearly we need one centrally owned routing system under the watchful and benevolent eye of DHS, right? With help from advisors provided by Microsoft and Disney.

    Decentralized routing is a feature, not a bug. And although the problems identified in the article are real enough, the implications of this kind of discussion always scare the hell out of me.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    1. Re:We know what kind of "solution" DHS has in mind by dalagra · · Score: 5, Insightful

      Decentralized routing is a feature, not a bug. And although the problems identified in the article are real enough, the implications of this kind of discussion always scare the hell out of me.

      While agreeing with you, I would go a step further and suggest that the bugs of decentralized systems are often more palatable than the the features of centralized systems. (this is of course considering the context of this article -- the internet)

  11. it is fragile, but it works by dalagra · · Score: 4, Insightful

    From the article: "My fear is that innovation on the Internet would slow down if there's a need to go through a central authority," Poll says. "I see little appetite for that in the industry." --- Is there an argument against this (quote above)?

  12. Re:Strength is weakness by Concerned+Onlooker · · Score: 3, Interesting

    No single point of failure? Correct. Instead it seems to be many points of failure. I am not a networking wiz and I don't even like networking issues, but I have taken a few networking classes and after trying to set up even basic RIP stuff I'm amazed that the internet works at all. It's been a while ago but I recall that even one team in our lab screwing up brought down the whole network.

    --
    http://www.rootstrikers.org/
  13. Feature not a bug by Anonymous Coward · · Score: 4, Insightful

    This is ridiculous, I suspect this is FUD created to take control of the Internet. Routing tables are a feature of the Internet that are designed to ensure the Internet doesn't have a single point of failure. Hacked router?, connection hit by bomb?, satellite suffering from solar flares?... change a few routes and it's fixed. Security?... TLS. The moron even suggests that creating a central authority would make the Internet more secure!!! Imagine if you wanted to take out the Internet and it relied on a central authority, hmm, what would you attack, billions of Internet clients, millions of routers, or the one authority?

  14. Clarke's Third Law by ChipMonk · · Score: 2, Funny

    'It amazes me every day when I get into work and find it's working.'

    Or, as Arthur C. Clarke put it, "Any sufficiently advanced technology is indistinguishable from magic."

  15. Re:Strength is weakness by mysidia · · Score: 5, Informative

    And that is a big reason why the Internet exterior gateway protocol is not RIP or any other IGP.

    A premise of the RIP and other IGP protocols is routers talking to each other trust each other.

    With BGP, the premise is the opposite... routers speaking the protocol implement policies against each other: policies regarding what routes they propagate or originate outbound, policies regarding what routes they accept, and policies regarding what incoming routes they propagate.

    So networks that don't trust each other only accept appropriate routes from their peer based on AS-path and Prefix-list filters.

    Basically almost all networks should treat their peers as untrusted, and list out prefixes of end users.

    It doesn't start to get hairy, until you need to peer with a provider (instead of an end-user) and accept all prefixes from them, because you want their customer prefixes, or you want to buy transit from them.

    As for ISPs and providers though... failing to filter downstream announces is the exception to the rule.

  16. Re:Strength is weakness by Comen · · Score: 5, Insightful

    "I am not a networking wiz and I don't even like networking issues" So you tried to setup basic RIP and you are amazed the internet works at all huh.
    Well this artical is pure BS, sure you packets go between multiple backbone ISP's and a couple smaller isps on the edge maybe, but the guys that run the bigger ISP's do have rules that govern how they BGP peer with other backbones and peers. They enforce strict BGP filtering, to keep the smaller compaines from causing major issues.
    Sure every once in a awhile someone might fat finger some shit and mess something up that will effect 1 of the main backbones, but with more automated tools this happens way less than it used to. Most big backbone ISP's use router hierarchy and pure core routers are protected from anyone configuring them much at all once setup.
    I think the system runs well, I am sure it could be made better in many ways, but the issues made here are non issues, the backbones one security would be the main factor here, and that should get only better over time.
    Its better there is no central routing authority on the internet. Each company has it in thier best interest that it has the best routes to get to a centain network, and if that company messes its routes up, others should be protected by proper BGP filering. BGP filtering can get pretty complex, on ciscos this can be with prefix based ACL's and also with BGP AS number based ACL's, you can also use BGP communities to keep things nice and neat. If done correctly it can be pretty rock solid, if a rookie does the filtering you can have holes and issues, but a big company like LEVEL3 for instance, should have standards and all this stuff pretty hardened and worked out.
    This internet sky is not falling.

  17. Oh crap, this can get worse than net neutrality by Captain+Linger · · Score: 2, Informative

    Route filtering. Trust me, if the 12 occasionally scattered folk I work with every day can manage block leaks of inappropriate routes within 15-60 minutes, so can everyone else, and they typically do...generally they're properly filtered to begin with. The open nature of the internet and diversity amongst transit carriers is precisely what contains these leaks to segmented populations rather than causing a massive nationwide failure. The fact that largely Internet standards have been left to technocratic, Balkanized organizations rather than via Congress is what keeps everyone playing nice. The "next one" may be "a big one", but anyone running a truly important network should and will have diverse carriers...anyone critical to the US infrastructure should and does generally run over dark fiber that would not be affected. Not seeing the call to action here, but I have very little faith in the media to actually competently understand and relate this one. HangingChad, exactly: "I got a bad feeling about this"

  18. Beware: plans to fix this are misguided by presidenteloco · · Score: 4, Interesting

    I've seen alternate routing protocols proposed wherein your traffic has to barter/haggle its way through the network at every hop, as some new troll demands a passage fee for a certain QOS.

    These new methods look to me like they would create two issues:
    1. Unpredictable permutations of complex, balkanized, and non-local routing strategies. Performance of the system as a whole would be unpredictable and possibly unstable.

    2. It really is back to the old circuit-switching network of ma bell, on top of IP. A few nice low-latency end-to-end Concorde-like connections for those willing to fork over the dough, clogging up the routers so all the proletariat traffic suffers in a poverty of routes and bandwidth.

    Deep Simplicity at the core of routing protocol is the only thing that will work at the scale of the Internet. Maybe a "voluntary-QOS-downgrade" flag on email packets etc, and a "pretty please low latency" flag on video packets, might work, but these should not have monetary contracts associated with them. They should just indirectly affect the end-consumer's bandwidth bill if anything.

    --

    Where are we going and why are we in a handbasket?
  19. Re:The Internet is not going to end by Lennie · · Score: 2, Insightful

    Euh... their are more then 13 routes, their are 13 addresses (prefixes) but their are many, many more routes, most of those 13 prefixes are announced in many places it's called anycast and their aren't just 13 servers either. Every one of them is a cluster of machines and as many use anycast their are multiple clusters per 'root nameserver'.

    --
    New things are always on the horizon
  20. Filtering works, for those that configure it by gavving · · Score: 2, Informative

    As someone who's accidentally announced the entire Internet routing table to an ISP when setting up a dual-homed configuration, I can confirm that good upstream ISPs do BGP filtering. I was trying to troubleshoot what was going on, and the Tech on the other end was helpful enough to tell me that I was sending him the full route table. Fortunately they had filters in place to stop them from going out any further and impacting anything. But I had it clearly demonstrated to me how important filters are on both ends of the connections.

  21. How it keeps working is actually straightforward. by jonadab · · Score: 2, Interesting

    xkcd explained this a while ago. Basically, if the internet ever *stops* working, even for a few seconds, alarms go off and people panic and do anything necessary to get it working again immediately. It turns out this is actually a fairly reliable system.

    --
    Cut that out, or I will ship you to Norilsk in a box.