Slashdot Mirror


P2P - From Internet Scourge to Savior

microbrewer writes "The MIT Technology Review has up a feature discussing the future of p2p networks. Specifically, they look at their role in content distribution, in the age of ubiquitous video services. Soon, the article asserts, the very same p2p-style networks that 'threatened' legitimate business may be the basis for most video-on-demand services." From the article: "So how could additional P2P traffic actually be a good thing for the Internet? Carnegie Mellon's Zhang points out that because peer-to-peer networks exploit both the downlink and uplink capacities of users' Internet connections, they distribute content more efficiently than centralized 'unicast' technologies. Zhang also says it should be possible to label P2P traffic so that service providers can track it and decide how much of it to allow through their networks. He and colleagues from the University of California at Berkeley have founded a startup, Rinera, to develop software that will give service providers such control."

36 of 131 comments (clear)

  1. Legal Use of technology by ZahnRosen · · Score: 3, Insightful

    Powerful technologies can be used for powerful things. Blizzard hired the bittorrent developer to help it distribute patches for World of Warcraft. P2P isn't illegal, using it for stealing is... P2P doesn't steal files, users do.

    1. Re:Legal Use of technology by Dance_Dance_Karnov · · Score: 2, Interesting

      This is an idea whose implementation I've been waiting on for a long time. I would love to have a closet in my house with a computer 'core'. Something that can be large enough to have enough cpus and hard drives to serve a family with thin clients. I think in the future this will be a standard instillation on new house builds.

    2. Re:Legal Use of technology by arivanov · · Score: 2, Informative

      That is all true especially once you see what P2P is good at.

      Once you have discounted the illegal uses it becomes bloody obvious that most P2P uses are nothing but halfbaked emulation of multicast done by people with poor understanding of networking. Node discovery, node promotion to hypernode, sending single request to multiple interested parties are all trivial in a multicast environment. On top of the in a multicast environment the provider can easily enforce and control QoS, administrative boundaries, seed the network with nodes, limit propagation of requests to a network region, etc.

      By the way - this is especially valid as far as Generic P2P Vide On Demand and P2P voice like Skype. These are solutions looking for a problem. The problem is currently solely in the fact that idiots in big incumbent telcos in the chase of "build it big" residential access have largely ignored issues like multicast, QoS and the like. The moment they themselves start distributing content they will reconfigure their network to support that and throttle down generic P2P so it does not stand in the way. That will be the moment when the problem will disappear and this will be the moment when P2P multimedia distribution companies will begin to die.

      --
      Baker's Law: Misery no longer loves company. Nowadays it insists on it
      http://www.sigsegv.cx/
    3. Re:Legal Use of technology by ifrag · · Score: 2, Funny
      Is it like a crowbar you can use to smash windows or something?
      Windows smashes itself plenty on it's own. I doubt anyone would need to help it along.
      --
      Fear is the mind killer.
  2. ISP Bandwidth by b0s0z0ku · · Score: 4, Insightful
    Zhang also says it should be possible to label P2P traffic so that service providers can track it and decide how much of it to allow through their networks.

    Cap bandwidth or GB of transfer per day. Don't tell me what I have the "right" to use this data capacity for. I know Zhang is only suggesting that it's possible, not necessarily a good idea, but don't give the ISPs any stupid ideas.

    -b.

    1. Re:ISP Bandwidth by rudeboy1 · · Score: 4, Insightful

      I agree, this will only make it easier to let ISPs continue this rediculous crusade of charging more to make more bandwidth available, but limiting our ability to use it. This is the sort of thing that the telecomm companys on the wrong end of Net Neutrality would jump at as a chance to further their cause. I'm sure this is entirely possible; in theory, the idea is quite simple. I'm sad to see someone going out of their way to essentially further limit what we can do with thwe internet connection we pay good money for.
          It is my firm belief that if you pay for 3M down, 512K up, you should be able to use that for whatever the hell you want. No caveats, no addendums. That whole "BT and HD are choking the internet" thing is a load of bull.

      --
      Raging in an online forum won't do anything for the world around you. To see change, you must take action.
    2. Re:ISP Bandwidth by b0s0z0ku · · Score: 2, Insightful
      It is my firm belief that if you pay for 3M down, 512K up, you should be able to use that for whatever the hell you want.

      BTW, I have no problem with capping total daily transfer at something less than (Mbit/s)*(8bit/byte)*(3600sec/hr)*(24hr/day) if that's what the ISP needs to do. Just state that limit explicitly in the contract and don't fuck with me unless I actually go over it.

      -b.

    3. Re:ISP Bandwidth by h2g2bob · · Score: 2, Funny

      Follows a familiar pattern.
      1. X is brilliant! In the future everyone will X!
      2. Of course, to do X, you need Y.
      3. Oh, did I mention, we're starting a company for producing Y? ...... Profit!

      I don't know how many venture capitalists they'll find on slashdot, but we finally know step 2.

    4. Re:ISP Bandwidth by msobkow · · Score: 2, Interesting

      Caps are the wrong approach. Dynamic traffic management is the only viable option, with priorities set by the time-critical nature of the data.

      If BitTorrent protocols carried a data type specifier, perhaps a simple MIME type identifier, then the traffic management facilities might be enhanced to consider that information. It would also be reasonable to implement local BitTorrent cache servers so that when you do a transfer, you're effectively getting most of your data from within the ISP.

      If the data file contents are encrypted with public or private keys, you can effectively get a VPN/mesh network of digitial content. Application installers, directory overlays (ala NIS+), etc. Your subscription to the originator provides you the public keys for decrypting the content, either to do an install, local media burn, or direct content access.

      DRM is just hardware acceleration.

      --
      I do not fail; I succeed at finding out what does not work.
    5. Re:ISP Bandwidth by msobkow · · Score: 2, Interesting

      Thinking about it, the one hole to the approach is that you're relying on content providers/publishers (including individuals) to be honest about the content of crypto containers. But as the key infrastructure provides identification of the signing encryption authority, that can be used to monitor abuses and automatically choke off those who claim they're sending a media stream or application library, but actually distributing illegal or infectious content.

      --
      I do not fail; I succeed at finding out what does not work.
    6. Re:ISP Bandwidth by msobkow · · Score: 2, Insightful

      The legal issues of personal privacy, copyright duration, consumer rights, etc. are not so clear cut, and have to be set by individual governments. American businesses need to remember they are but one player on the global market, and their law is not universal.

      The *AA are particularly blind to this issue. The US restrictions are not even constitutional in other nations.

      --
      I do not fail; I succeed at finding out what does not work.
    7. Re:ISP Bandwidth by Wesley+Felter · · Score: 2, Interesting

      The telcos/ISPs write the laws, so "common carrier" means whatever they want it to mean.

  3. Yeah but by rsilvergun · · Score: 4, Insightful

    how are ISP's going to take to users maxing out their upload bandwidth 24/7 running commercial p2p clients? Somebody's got to pay for the infrastructure. I can't imagine the current networks aren't optimized for web browsing and light uploading in short bursts (i.e. pictures, word docs and the occasional wmv).

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Yeah but by Capt+James+McCarthy · · Score: 5, Informative

      It depends upon your ISP. Speakeasy's agreement states that I can use all of my bandwidth 24/7 without any problems. A SysAdmin's ISP.

      --
      There are no loopholes. It's either legal or it's not.
    2. Re:Yeah but by microbrewer · · Score: 3, Informative

      Intra Network bandwith is not that expensive for ISPs it when they start to share data with other networks it gets expansive .

      The LX Systems techology in Peer Impact that is mentioned in the MIT article uses peer clustering techniques to keep as mach data in a ISPs domain as possible and they also use geo-location techniqies so the trafic doesnt travel long distances if it doesnt have to .

    3. Re:Yeah but by ronanbear · · Score: 2, Insightful

      Sounds like combining bittorrent and usenet to get the best of both worlds. It's the natural progression.

      --
      the more they over-think the plumbing the easier it is to stop up the pipe
  4. But are the existing channels ready for this by ztransform · · Score: 5, Interesting

    It is a good theory that moving distribution to many decentralised locations will improve content distribution. But present-day distribution networks and large-bandwidth sites have already bought and installed the infrastructure to send large volumes of bandwidth to Tier-1 ISP distribution points, and so forth to smaller ISPs etc. This works today.

    I am agreed that P2P isn't necessarily bad - in fact if P2P algorithms could favour traffic within the same subnet, or indeed allow an ISP to somehow inform the P2P client which nodes are on the same ISP, then an ISP could actually benefit as traffic fills up the internal pipes and less traffic has to be purchased from other ISPs.

    To expand on this point, perhaps a multicast protocol like DHCP on the local subject could be implemented; call it the "ISP IP Directory" protocol, or IID, and basically a P2P client would send a multicast query to the IID address with a query ("is x.x.x.x within your network? Or within your preferred peers?") and the IID server would respond with a yes/no. Then P2Ps could optimally download from preferred addresses..!

    A shift in thinking in the design of P2P protocols is required if we really want to optimise bandwidth and content distribution.

  5. Ooh, goodie, p2p day on /. by multipartmixed · · Score: 2

    Please, for the love God, somebody post a recipe to limit gnutella and bit-torrent traffic through a masquerading linux firewall. My home firewall just dies even though ip connection tracking seems to have WAY MORE than enough free connections.... every time two of my kids fire up a p2p client simultaneously. Bouncing the iptables kernel module DOES bring everything back to life.

    This is with a 2.4 kernel and iptables 2.7.

    So. Back on topic. Internet scourge? Dunno. Intranet Scourge? Yup.

    --

    Do daemons dream of electric sleep()?
  6. Re:Wait.. by Reality+Master+101 · · Score: 2, Informative

    Wait. I pay for these networkes, Is ME who decide anithing. And I decide with my money to have P2P in full use, and not as 2th or 3th level.

    No, you aren't paying for "these networkes", you are paying for exactly what the service agreement tells you, which is probably not unlimited usage. If you want to make the decisions, then pay the big $$$ for commercial, unrestricted internet access.

    --
    Sometimes it's best to just let stupid people be stupid.
  7. Label P2P data? Is he effing kidding me? by PopeRatzo · · Score: 5, Insightful

    "Zhang also says it should be possible to label P2P traffic so that service providers can track it and decide how much of it to allow through their networks."

    We have lived in such a rare time. We had access to a communication tool like no other in history. And for a brief moment, it was free - totally free. Unencumbered by the dictates of rich and powerful, it was without parallel in history. Anybody who connected to this great web of systems had just as much chance to make his message heard as anyone else. My email of undying love to my wife-to-be received the same access and dispatch as the advertising messages of multi-national corporations. Anybody with a good idea could put it out there for the world to see and if it had merit, it would gain in popularity. Google sprang from this freedom. So did Slashdot. And goatse. And it was the unusual confluence of public money and free enterprise, along with some very smart and generous folks, putting energy into something new and unprecedented that made this happen. Take one bit out of the equation - say the taxpayer-financed Department of Defense, or a Linus Torvald, or a Netscape or the many other pioneers who contributed to this vast project - and it doesn't happen, or it happens in a way that prevents the kid in the basement in Des Moines the opportunity to play.

    But people who have acquired wealth and power don't like it when any old slob can do what they do. I mean, what good is being rich and powerful if it doesn't let you move to the head of the line? Now, a race is on to crush the experiment in liberty that has been the Internet. I guess it was too radical, too much of a danger to tyranny and concentrated wealth, to last very long.

    We should all feel privileged for having seen the rise of this rarest of creatures - the fully open agora of information and ideas - and we should all feel sad that it couldn't be defended from the greedy and power hungry.

    --
    You are welcome on my lawn.
  8. "scourge"? try "broadband sales driver"... by plasmacutter · · Score: 5, Interesting

    Seriously.. everyone i knew from close family to the furthest acquaintance didn't think broadband was necessary or worth it until p2p traffic caught on.

    yeah... all those people are using that 4-10 megabits a second so cnn.com will load faster.. riiight.

    --
    VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
  9. Practicality and reality by br00tus · · Score: 4, Informative
    As far as broadcasts over the Internet done in a technically sensible way, old-timers may remember the MBONE initiative. This would have distributed broadcast video via IP Multicast. All of the "Tier One" ISPs I knew of, as well as many Tier Two ISPs had the capability to do this, the equipment in place - all they had to do was turn IP multicasting on on their Cisco routers. But management did not want to do this, because they thought it would fill their bandwidth up with video, which they didn't want. At the time, traffic shaping and billing technology was not really up to speed, people were still used to how NSFnet did things to some extent. So instead of multicasting, people did p2p, which is less efficient. After Napster began coming under legal assault, Gnutella was released with technology to specifically evade attempts to block it.


    Aside from technical issues, I think decentralization, peer-to-peer and so forth is the way to go. I don't want to be the little receiver of content from the Giant Corporation with DRM, monopoly price increases and whatnot. To me it makes sense (like Mbone did) and gives me more freedom. It allows me to publish content, which Youtube and whatnot can not censor if they wish. Which is precisely why it won't happen - we don't live in some federated decentralized anarchist council structure, we live in an imperialist, capitalist society where capital is centralized in a few hands, along with the media, political power for the most part, and so on. Which is why peer to peer decentralization has been under attack since day one.

    1. Re:Practicality and reality by Red+Flayer · · Score: 4, Interesting
      But management did not want to do this, because they thought it would fill their bandwidth up with video, which they didn't want.
      Yup. Heaven forbid that their customers actually use all the bandwidth they pay for -- if that happened, how could they oversell their capacity?
      At the time, traffic shaping and billing technology was not really up to speed, people were still used to how NSFnet did things to some extent. So instead of multicasting, people did p2p, which is less efficient.
      The summary (and TFA) mentions that p2p can actually be more efficient than multicast, since it utilizes both the up- and downstream capacities of clients.

      Which is precisely why it won't happen - we don't live in some federated decentralized anarchist council structure, we live in an imperialist, capitalist society where capital is centralized in a few hands, along with the media, political power for the most part, and so on.
      You're right, of course. But that's tangential, it simply provides the mechanism by which monied interests can make sure they get their way.

      The issue I see is that the content distributors and the bandwidth providers can work together to get a lock on high profits for both. We're all familiar with the DMCA. But with the right tools (like what the author has created a company to do) the bandwidth providers can lock out the last competing method of distribution.

      The best solution I see is to designate bandwidth providers as common carriers, so that it will be illegal for them to discriminate between packets. Then again, that's government interference, so I'm sure a lot of the libertarians and anarchists here will disagree...
      --
      "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
    2. Re:Practicality and reality by mypalmike · · Score: 2, Funny

      we don't live in some federated decentralized anarchist council structure, we live in an imperialist, capitalist society where capital is centralized in a few hands, along with the media, political power for the most part, and so on.

      I told you, we're an anarco-syndicalist commune. We take it in turns to be a sort of executive officer for the week, but all the decisions of that officer have to be ratified at a special bi-weekly meeting; by a simple majority in the case of purely internal affairs, but by a two thirds majority in the case of more serious...

      --
      There are 0x40000000 types of people: those who understand 32-bit IEEE 754 floating point, and those who don't.
  10. Re:P2P not 'Long Tail' friendly by plasmacutter · · Score: 2, Informative

    On the contrary.. it's been the most reliable and comprehensive way for me to access out of print and obscure international titles.

    --
    VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
  11. I'll believe it when I see it by ben+there... · · Score: 4, Insightful
    "Soon, the article asserts, the very same p2p-style networks that 'threatened' legitimate business may be the basis for most video-on-demand services."

    This has been said many times in the past few years, but it's still not feasible. One big reason YouTube is popular is because it is "Instant-On." No waiting for it to download. Generally no waiting for "buffering."

    BitTorrent and the like are incompatible with that feature. BitTorrent does not download videos (or any other file) in order, and it's actually somewhat harmful to the torrent to distribute the same chunks to everybody. BitTorrent works so well because it gives everybody on the torrent unique chunks to pass along. Not good for streaming.

    Secondly, ISPs drastically limit upload. This means that to get even close to realtime streaming downloads, the seeders (the content provider in this case) need to have massive bandwidth available. Otherwise, it will take to long for the torrent to really get going with other seeders, and the first ~50 people will have to wait to watch. So you're back to having powerful centralized servers again.

    Plus, what benefit do I have for letting them use my upload? With most broadband connections, saturating the upload makes browsing at the same time slow with high latency. It might make sense for community sharing, where the content provider can't afford the bandwidth, and therefore I would want to contribute, but it doesn't make sense for companies to demand that of me.
  12. Asymmetry by mollymoo · · Score: 3, Interesting

    P2P has one major problem - most broadband connections are asymmetric. Very, very asymmetric - ratios of 10:1 download:upload are common. Thus, in order for P2P to be able to saturate downstream bandwidth everyone would need to keep their P2P apps open for 10 times as long as it takes to download what they want. I don't think you're ever going to get a useful proportion of people to do this without a definite incentive. The cost of the bandwidth per movie is pretty small - I'd guess a few tens of cents. So econmically that's the value of the incentive you can offer. Are people really going to leave their PC on or an application open for hours and hours when they're not using it for the few tens of cents worth of incentive it would be economic to provide? I just don't see you average consumer doing this. It's cheaper to buy bandwidth from a major ISP than it is to 'buy' a hundred million tiny chunks of bandwidth from ten million customers. P2P works if people know they're helping the 'community' or getting something for free. Linux ISOs? P2P. Warez? P2P. Official Disney movies? Not so much.

    If you want to reduce bandwidth usage then reduce the number of packets you have to send. Multicast is the right answer. MBone and IPV6 have been around for a long time now. They just aren't very profitable for ISPs, so the push will have to come from the content providers.

    --
    Chernobyl 'not a wildlife haven' - BBC News
  13. Realm of the Peers by Doc+Ruby · · Score: 2, Insightful

    The Internet is inherently a P2P network. Client/server architectures, though popular now, are a recent overlay on the TCP/IP architecture. Multicast, the Internet version of the broadcast popular in analog comms for decades, is still enough at odds with Internet architecture that it's barely used.

    The Internet is a network of peer networks of peer hosts. P2P[2P[2P..]] is how everything works already. It's refreshing to see the decentralized, inherently "democratic" and primarily egalitarian Internet model starting to force centralized "old guard" media organizations to admit defeat. If they get on the bandwagon, they can be Ps in the P2P network. If not, they can keep their old network, and we'll barely notice they're gone.

    --

    --
    make install -not war

  14. Multicast, multicast, by Ponga · · Score: 2, Insightful

    MULTICAST.

    Why is this technology being, by-and-large, ignored??

    1. Re:Multicast, multicast, by Raideen · · Score: 3, Interesting

      Why is this technology being, by-and-large, ignored?? Because we're still on a mostly IPv4 Internet and IPv4 has a very limited number of multicast addresses so content providers would have to fight for them and availability would depend on their schedules. Also, providers seem to be worried that it would saturate their networks. (Less bandwidth usage at the provider means that there will be more multicast services, meaning more clients, meaning more traffic across the upper tier provider's networks.) I'm waiting for what China has to show the rest of the world in the 2008 Olympics when they show off their fully IPv6 network.
  15. What upload bandwidth? by PingSpike · · Score: 2, Informative

    Around here at least, the best a consumer can get for upload bandwidth is 384kbps...without going to a T line from the phone company. If they can't handle supporting those paltry offerings, which their customers paid a non-platry sum to get...I'm going to have a hard time mustering much sympathy up for them.

  16. Re:P2P is the scourge of the internet? by Captain+Splendid · · Score: 2, Funny

    myspace is the public bathroom of the internet.

    Fixed that for ya.

    --
    Linux, you magnificent bastard, I read the fucking manual!
  17. P2P topology is all wrong by Animats · · Score: 2, Informative

    The trouble with "P2P" in its present form is that the topology is designed to evade copyright, not minimize bandwidth. Peering nodes aren't necessarily near each other. You can, and do, get situations where the same content traverses the same backbone paths multiple times. There's no end user penalty for having faraway peers, but it generates unnecessary load.

    Reminds me of, many years ago, watching two coal trains passing each other in opposite directions. You don't see that kind of stupidity any more. Somewhere a trader will do a swap, rather than physically shipping the commodity around.

    Netnews does this right, assuming you want a broadcast system. Netnews was designed for slow links and bandwidth minimization. As I point out occasionally, Netnews could easily handle the entire audio output of the RIAA, which is only a few gigabytes per day, using far less bandwidth than the present "P2P" systems.

    What will work is ISP-level caching. AOL does this, although in a somewhat annoying fashion. In a different way, so does Akamai. We'll probably see more of that.

  18. DD-WRT can help. by Kadin2048 · · Score: 2, Informative

    The DD-WRT firmware for WRT-54GL routers will do this. It can de-prioritize various kinds of packets, I suspect based on header inspection. I don't know whether it's smart enough to pick up on the obfuscated Bittorrent packets used by newer versions of Azureus (which was designed to be resistant to this sort of inspection), but it will get some of it.

    I'm the "unofficial sysadmin" for my house, which is shared with several other single guys, by virtue of having the router in my room, and DD-WRT makes QoS fairly simple. Things that require real-time performance like SSH, Citrix, and online games get high priority, HTTP text transfers get medium, HTTP and FTP file transfers (don't ask me how it can tell the difference between HTTP text and HTTP file transfer) get low, and P2P apps get "bulk." This doesn't prevent P2P use, in fact at night it pretty much saturates the connection, but it does fairly well at keeping them from making other services impossible to use.

    The other thing to do is just go to each of the client computers and kindly insist that they turn the maximum up and down speeds on their P2P apps down to something reasonable; that can improve the situation dramatically.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  19. The answer is obvious by silentounce · · Score: 2, Funny

    "Powerful technologies can be used for powerful things."
     
    Every technology developed by man, from animal husbandry to television, has eventually resulted in its use to improve porn. Scientists refer to this as the "Porn Point". Once that is reached then a new technology to even further the use/distribution of porn will be developed until we reach the "Porn Singularity". The "Singularity" is a point in the future when porn progress will improve at an incredible rate unprecedented in human history. While scientists debate whether or not this event is a good thing, it is inevitable.
     
    I'm sure, that whatever this p2p technology is, the future of it has something to do with porn.

    --
    There are many tongues to talk, and but few heads to think. -Victor Hugo
  20. Terrible idea to give ISPs traffic control by presidenteloco · · Score: 2, Insightful

    As the Internet evolves, more and more of everyday data storage for a variety of needs from storing family albums
    to medical histories to corporate databases will be done in (highly encrypted and massively distributed)
    data clouds, including P2P-hosted data clouds.
    And more and more computing will be done in on-the-fly compute farms in grids, and some of this computing will no
    doubt be hosted on legions of small P2P edge-of-net computing resources.

    With such a scenario, how is it a good thing to allow ISPs to peer inside this cloud of encrypted and fragmented
    and dynamically coalescing data to somehow exercise traffic cop (or border patrol) authority over it.

    That sounds to me like the worst possible idea.

    This idea is effectively the same as saying the ISPs should be staring over my shoulder as I surf or work over the net and
    vetoing which websites or webapps I look at or use. No way. The net must be neutral to what it's carrying, or it just
    won't work. And the P2P-based net of the future must have the same properties of neutrality to traffic that the
    current general internet does (or should have.)

    --

    Where are we going and why are we in a handbasket?