Slashdot Mirror
Communicating Even When the Network Is Down
coondoggie writes to mention a NetworkWorld article covering efforts to maintain network connectivity even when the network has holes. Building off of the needs of the military, the end goal is to create a service which will route around network trouble spots and maintain connectivity for users. From the article: "Researchers at BBN Technologies, of Cambridge, Mass., have begun the second phase of a DTN project, funded by $8.7 million from the Department of Defense's Defense Advanced Research Projects Agency (DARPA). Earlier this year, the researchers simulated a 20-node DTN. With each link available just 20% of the time, the network was able to deliver 100% of the packets transmitted." The article is on five small pages, with no option to see a linkable, printable version.
This looks like it has already been invented.
I regret that I only have one mod point to give per post.
Wasn't that the point of the original ARPANET? To route around broken parts of the network? BBN was involved in that, too. What, have they been double-billing the DoD this whole time?
gigantino.tv - Heavy but weighs nothing.
Baby, darling. I appreciate the warning, but you do realize, as a janitor at Slashdot you have a decent amount of power, clout in the nerd world. Even though you're condemning their actions with your comment, you're promoting their site, giving them extra ad revenue with their annoying practices.
If you want to make a difference, make a stand, stop linking to sites like these. Send them a quick letter saying you'd be happy to send X thousand happy clickers their way if they'd give a single page, printable version. With their "Slashdot it" link at the bottom of the page, they obviously care.
The article is on five small pages, with no option to see a linkable, printable version.
Yea, except for maybe the link at the bottom of the article that says "Print".
The US taxpayer already fund edthis project back in the 70's and 80's. This was the goal of the original arpanet.
Or maybe BBN is admitting failure, which, in the world of military research contracting is code for "so you should give us another 8-10 million dollars to do the project again."
and again. and again.
sheesh!
Anyone else feel like they're time travelling when they're reading this?
you had me at #!
From about 20 years ago... I think they were going to call it the "interweb." Or something.
I'm glad DARPA funds stuff like this. They should perhaps call it DARPA-net or something like that. Also, perhaps this research will result in really cool new inter-networking technology that the public can make use of. Perhaps universities might be the first big users.
n et)
Of course, if that happens, I hope this new inter-networking thing doesn't get privatized... 'cause then all kinds of crazy things might happen.
(For the uninitiated or those who like things spelled out, see: http://en.wikipedia.org/wiki/History_of_the_Inter
This is different in that the final destination address might not be known.
... In a DTN, messages can be launched from a source node even though the final destination IP address can't be known due to disruptions of name servers or routers.
From the article
Anyone got a mirror? ;)
liqbase
Doesn't this just tell us what wireless broadband mesh's have been doing for a few years
Just on a slightly grander scale??
BBN has developed a network protocol and code that moves information from node to node as connections become available, and can hold information in persistent storage until a connection is available.
Wow... what can I say ? - over 8 million bucks to re-discover or re-invent SMTP... (otherwise called email for those who don't remember TLA's)
Welcome back to August 1982 !
Read the press release here : http://www.faqs.org/rfcs/rfc821.html
As I was reading the summary, I thought for sure it was going to say that to avoid problems with network connectivity that $8.5B in research had found that you can walk over and talk to your cube neighbors directly...
phirst
Phirst phailure.
Will you please hurry up already, we're soaking in 4 billion gals of red tech-ink!
Maybe some day they'll be able to transmitt packets over fast wireless connections!!!
"There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed H
The spec provides for "intermediate" servers receiving the message and passing it on.
Years ago this was duplicated with the old BBS's and phone lines. I'm talking about the single user at a time boards. One phone line. Lots of waiting.
The boards had the numbers of different boards that they would call as the lines were free (their's and the recipient's). Messages would be passed along whatever route was available until they were received at the destination.
This model is heavily dependent upon storage, though. If one of the nodes loses its hard drive, the messages stored there were lost. You can have unreliable connections, but you cannot have unreliable storage.
Also, think "routing loops". The tail of the messages gets really long in some of these schemes. You don't want the message routing back over connections it has already traversed, do you?
Which leaves the possibility of the "route to nowhere". Where messages go to die.
You must be just as blink as Zonk. The link to the print version is right next to the "Slashdot it" link!
"[E]fforts to maintain network connectivity even when the network has holes."
Whoa, this is a pretty sweet idea! Maybe they could get someone wealthy and influential to help with its creation, like, I don't know, maybe Al Gore! They could call it... metaverse... naah... or.. yeah; Internet sounds pretty flashy, doesn't it?
Yes, SMTP is an amazingly strong example of redundancy. However, we installed redundant fiber at a school I work for within a few days, and just for fun we'd pull plugs randomly and monitor the response time while a alternate link was used. I think 10ms was about average... Then it stopped being fun after a while. We even tested load balancing.
/.
So my question is.. why are we treating this like its a new thing? This seems like another one of the frequent quasi-ads which seem to be more common lately here on
Remember, this is Slashdot. We would gladly pay $8.5M in research to allow the computers to do the talking for us.
--------------
From: John Smith
To: Jane Doe
Subject: Thnx
thnx 4 ppt. wnt g00d lol.
JS
University in NZ
--------------
Come to think of it, forget the network. I think our communication is down.
Proof by very large bribes. QED.
In related news, the DoD has awarded RoundCo Inc. a 100 million dollar contract to develop a circular structure to facilitate the movement of objects with maximum efficiency. RoundCo is currently investigating deploying rubber-based, air-filled rings to fit this need. "This new technology could revolutionize logistics.", says RoundCo CEO David Goodyear-Wheeler.
Fill in your four or five-letter word of wisdom here _ _ _ _ _.
The goal of the Arpanet was to provide resilient packet forwarding in the presence of multiple node failures. However, the Arpanet model does assume that at any given moment there is end-to-end connectivity between the two communicating endpoints. DTNs do not assume that there is necessarily *ever* a direct, end-to-end connection between communicating endpoints. DTNs are store-and-forward networks, much like email or UUCP, they don't look anything like Arpanet or the Internet.
Although this research is nice, it does not address the worst vulnerabilities of the current internet. Botnets, ARP poisoning, DNS poisoning, pwned routers seem to be a more dangerous risk than mere unreliable components. Cyberterrorism and criminal exploitation of the internet means subverting the system rather than just breaking pieces of it.
The original internet design carried the naive assumption that all the devices on the net could be trusted -- all the devices assumed the validity of all control data, responses to protocols, etc. In the original model, devices had two primary states -- "unavailable" and "available" where "unavailable" might cover both damaged or overloaded components (a slightly more sophisticated version assesses capacity or latency as gradations between the binary unavailable/available dichotomy). In this one dimensional two-state model, disruption tolerance means routing around "Unavailable" or overloaded components.
Yet the rising threat is from malicious entities that want to subvert the network's functioning, not just disable it. Spam, phishing, click fraud, and extortion depend on twisting a functioning network, not just poking holes in the network -- all the parts remain "available" but their data and responses become deceptive. Thus future fault-tolerant networks will need to distinguish between trustworthy and untrustworthy components. This suggests employing techniques such as cryptographic signatures, polling systems, blacklisting, FOAF, firmware integrity checks, and device-to-device secret questions.
Designing a more robust internet is a laudable task but we need to spend more effort on securing against the true threat of untrustworthy components rather than unavailable components.
Two wrongs don't make a right, but three lefts do.
It is clear from the article that they are aiming for something more than OSPF or other link state routing protocols. If a link is cut inside a network, OSPF adjusts so that traffic is routed through alternative paths. But, until there is convergence (which is quite fast in most cases), packets may be lost. Packet drops do tend to occur if a router cannot find a suitable route to a destination, if it is able to find a route but the link to that route is down, or even if the queue on that link is congested (full). That's the very nature of our present best effort internet.
It appears to me that these guys try to address some of these "shortcomings" by making certain privisions that can guarantee packet delivery, even in a overly late fashion. A routing instability, lost routes or links should not be able to cause packet drops if they have it right.
However, I used the quotes in "shortcomings" because I am not entirely certain that this has not been tried before. If, instead of a best effort packet routing service, you try to invent a "smart" network layer that can guarantee stuff like ordered delivery (packets are delivered in the order they departed), assured delivery (even with great delays) etc, you are basically trying to invent a (gasp!) connection oriented service. Not that connection oriented technologies are inherently bad, but, well, they are certainly an order of magnitude harder to implement. Anyone remembers OSI? It might as well be easier to leave IP simple as it is and try to move some smartness to the upper layers.
Additionally, it would be better to try to build on top of unreliable services like IP and construct stuff like SMTP (as a previous poster very cleverly pointed out), that can function even if parts of the network are mulfunctioning.
Well, anyway, you might want also to take a look at the efforts on the interplanetary internet, this article reminded me of it.
In the new "non" net-neutral(ity) world, routing around trouble spots was not a service you paid for. If you need that service it will be an extra $10.00 a month. We love all our customers and hope your experience with our product is to your satisfaction. Now, if you would please take just a few moments and fill out our survey...
Routing around holes in a network... Sounds like the basic functionality of routing protocol to me. So they're getting paid big bucks to re-invent IGPs like IS-IS, OSPF, RIP (though this POS creates more holes than it routes around), IGRP, EIGRP or an EGP like BGP? Hell when it comes right down to it good ole IEEE 802.1D is a layer-2 routing protocol (when you think about how it actually works and not the generic description you read about in references). Hello, wheel.
Umm, if I'm not mistaken, the whole point of TCP is to provide guaranteed delivery (at least, as long as delivery is possible). If some packets are lost, no acknowledgment is sent from the destination to the source, and the source re-sends the packets.
Are we talking outages of 20ms or 5 minutes or 3 days or what?
See, the problem is that first thing, the "Internet" thing, got away from the powers that be. They let the peasants behind the castle walls, and now it's all spoilt for the really "important" people and their really "important" business.
So now, see, they've got to start from scratch, and this time, boyo, there's gonna be none of this "Net Neutrality" stuff mucking up the works. And you best believe there won't be any dirty-necked hacker types or dot.com money-for-nothing strivers in the picture. This time, it's gonna be a nice, nailed down, pay as you go situation, just like nature intended.
I mean, it's not really worth having something if you can't have control, now is it?
You are welcome on my lawn.
Welcome to networking 101. The trouble with a fully meshed, multi-vendor layout is the cost, and few companies are willing to pony up the required loot to maintain a completely redundant network.
Shaw's Principle: Build a system even a fool could use, and only a fool would want to use it.
Traffic spontaneously rerouting itself!? The NSA will never allow such a thing! How would they ever monitor the traffic?
No, this has not been done before in this manner. The internet does not communicate when disconnected. Try to send a file to a machine that is turned off or not connected to the net and see what you get?
This type of network, DTN (Disruption tolerant network - which btw, is similar to DTN - delay tolerant network - (see IETF working group)) is oriented towards disconnected operation, mobile nodes and ad-hoc environments.
BBN is not the only participant (though it is a big one). The project includes various universities and research institutes.
The problem is, discarding extraneous packets is actually a VERY GOOD THING when it comes to the internet. Several store and forward systems pre-dated the current TCP/IP stack, but guess what. They weren't as efficient in terms of required hardware resources or latency. This is because in a store and forward network, certain problems (like network cards going nuts and spewing tons of garbage) can cause lots and lots of data to accumulate in the network, and then you have to wait for every single packet to move on before you get to the new and relevant data.
The OSI model and network researchers in general recognize that reliable transport facilities can easily be built on top of unreliable "best-effort" communication networks, whereas it's nigh impossible to create light-weight best-effort services on top of a store and forward network. Since both kinds of applications exist, those that need reliable transport, and those that need speed. It only makes sense to provide an underlying fast and light weight network which doesn't provide, and isn't expected to provide, 100% reliability.
Finally, in practice, it actually turns out to be rediculous to expect 100% reliability from anything, particularly a low-level networking scheme since in the real world, no network is 100% reliable. Life can get very interesting indeed when you're supposed to rely on 100% packet delivery and one of your packets never arrives.
The real problem IMO when dealing with wireless networks is that so many developers try to shoehorn existing land-line applications and methodologies into the wireless world. There's a big difference between a network with an avg latency of 80ms, standard deviation of 2ms and 0.3% packet loss compared to a network with an avg latency of 500ms, a non-standard deviation pattern ranging between 200ms and 6 seconds and 20% packet loss. And that's completely ignoring issues related to moving between coverage zones and maintaining proper routing.
Basically, TCP, FTP, and many of their friends can wind up being very bad deals in such an environment. And things get even *more* interesting when someone tries to "fix" the network to work well with them... (by, for instance, blocking up groups of packets and waiting for a certain data-size to accumulate before sending.)
Cannot link, but can see :-)
Full article print view in one page: On the bottom of the page click on the Print button to get the full article in a single page.
Just yell really loud. Jesus, do I have to think of everything?
... some kind of DARPAnet birthday celebration ?
The Wise adapts himself to the world. The Fool adapts the world to himself. Therefore, all progress depends on the Fool.
Look for DTN to be used in upcoming NASA missions (see interplanetary internet) as well as next-generation military networks. DARPA and NASA are serious about this, and have Vint Cerf's backing as well. I expect that there will be quite a few commercial-off-the-shelf solutions that spin off once the dust settles around the standard.
It won't replace the current internet protocol suite - just augment it.
Secondly, dynamic rerouting to overcome partial failure or congestion is as old as digital backbone telephony and predates the internet by many years.
Engineering is the art of compromise.
Actually, a planned convergence layer for the DTN project is sneakernet.
DTNs work by storing packets (well, "bundles," really) at the router, until an opportunistic connection is available. Bundles move from hop to hop, until they arrive at their destination.
This is accomplished over a variety of "convergence layers," such as TCP and UDP, with UDP being the most commonly used for transmitting bundles currently in research. However, other convergence layers for other uses are being planned. One of these is sneakernet, where data is copied to physical media, the media is physically taken over to another node, and the other node reads the data and forwards the bundles to the next hop as available.
The main research page is at http://dtnrg.org/.
Press the "Print" button on the page and it opens up the article in a printable version window. The layout wasnt that bad to begin with though. i dont understand why you all complain so much
Of course, alot of people/ISPs do this already (not at the internet level but within their network), trouble is when one of the links go down, the 'failover' route gets it's own traffic and the traffic from the broken route. AND there's not enough bandwidth over this route to handle both sets of traffic.
Happened to me many many times...as a customer of lots of different ISPs.
I don't think we should be encouraging printing.
As well as the environmental issue, which we should all keep chipping away at but is not a large issue here, there is the problem of finding things.
If information is in large pieces then it is hard to find exactly what you search for. If it is in small pieces, but linked to others, then search engines can help us to search very specifically.
So slice articles finely, a page on a screen is about right.
AllOfMP3 has been censored at the DNS level by the Danish ISP, Tele2/Get2net, following a court ruling. They've appealed the ruling and expect the censorship to be canceled, but who knows...
See more at Google News.
Direct links to first few hits: 1, 2, 3.
Coincidentally, one of my colleagues worked for the Danish police making the pedo-filter working out which IP addresses to block, delivering those to all danish ISPs who have to block these by law. I asked her about pirates, and her comment was "why should the police care?".
that gives you a one-page format of the article. Counter-intuitive? yeah, that's right.
Not as bad as the macromedia paged website the other week. Sheesh!!!!!
Patriotism is a virtue of the vicious
DTN is used for cases where there are no end-to-end links. It is used in the military, but also has applications on deep-space links (ARPANet wasn't for this, clearly...) as well as sensor networks outside of the military. The original ARPANet was designed for redundancy, not this type of store-and-forward architecture.
/. is wrong about other topics due to immediate dismissal.
It's worthwhile to not dismiss ideas with partial thought like this; makes me wonder how often
There's also ACP (Avian Carrier Protocol), described in RFC 1149 back in 1990.
Those who do study history are doomed to stand helplessly by while everyone else repeats it.
doesn't also netsukuku does something like this?
As with any news article, it is trying to explain the concepts to a general audience. This always leads to misconceptions about what the technical solutions and problems are. Primarily, DTNs are not designed to "fix" the internet, it is designed to deal with disruptions at the edges, and to deal with challenged networking environments (primarily mobile ones). If you are interested in some technical information (some shameless self-promotion as the DieselNet project mentioned in the article belongs to myself and my colleague).
http://prisms.cs.umass.edu/dome
http://www.dtnrg.org/
If you want to know more, there are a ton of good papers being published in networking conferences on DTNs
...to provide internet for my home cluster...