Slashdot Mirror


Microsoft Wants P2P Avalanche to Crush BitTorrent

pacopico writes "Microsoft seems to think it can be the better Bittorrent. You know faster and more well-behaved. The Register has a story on the P2P work being done by Microsoft's researchers in the UK. Redmond reckons its "Avalanche" technology will be 20 to 30 percent faster than BitTorrent. It's meant for legal downloads only, of course."

36 of 545 comments (clear)

  1. Microsoft Wants Your First Born by Anonymous Coward · · Score: 5, Insightful
    It's meant for legal downloads only, of course.
    Well BitTorrent is meant for legal downloads too, but that doesn't mean a whole lot.
    Naturally, Microsoft is very keen to stress that this technology should be used for distributing legitimate content. It even put that in italics in the press material.
    Oh, never mind, I didn't realize they put it in ITALICS, that is sure to stop piracy dead in it's tracks.

    Besides BitTorrent might not be the most efficient P2P system any more, but it is one of the most widely used. I guess this is what Microsoft does best, copy other technology, add a little to it, then destroy it.
    1. Re:Microsoft Wants Your First Born by Rei · · Score: 4, Insightful

      On the contrary, I think it will not destroy it but legitimize it. Now people can say "Even Microsoft is developing P2P!". Plus, with a big backer like MS behind it, we might start to see pressure for more incorporation of P2P into other arenas - for example, a smoother mix between P2P content serving and conventional web serving, with seamless browser support. Microsoft loves tie-ins, after all, even if the products that they tie together are inferior to other products on the market.

      --
      Did he just go crazy and fall asleep?
    2. Re:Microsoft Wants Your First Born by ImaLamer · · Score: 3, Interesting

      "Even Microsoft is developing P2P!"

      Really, their server products already use a P2P or S2S (Server To Server, servers being each other's peers...) technology for domain replication. Windows 2000 is pretty darn good at replicating its content even when the original copy isn't available.

      Of course, YMMV, and the right setup is key.

    3. Re:Microsoft Wants Your First Born by shadowmatter · · Score: 5, Interesting

      Microsoft Research has been working on efficient, decentralized, and fault-tolerant P2P systems since 2001. See the paper about their DHT (Distributed Hash Table) called Pastry, which was co-authored with Rice and is still under active development there. Note that the Kademlia DHT, which followed roughly a year later and is now used in a variety of P2P networks (eMule, the new decentralized BitTorrent network, etc.) employs a variant of Pastry's routing algorithm of longest prefix matching.

      They still have quite a presence if you look through recent NSDI or IPTPS conferences. Note that this paper is for IEEE INFOCOM, which is big.

      - shadowmatter

    4. Re:Microsoft Wants Your First Born by bman08 · · Score: 4, Insightful

      I'm more concerned about the embrace and extend issue. Maybe they see piracy as the next killer app for windows and want to lock us all in with their super kewl proprietary p2p app. It's not going to work. Piracy and Porn drive P2P communities to critical mass. If nobody's using this thing, it's not going to be that fast, is it?

    5. Re:Microsoft Wants Your First Born by shadowmatter · · Score: 4, Interesting

      Why do you need to guess what it's about when it's all there in the paper linked to by the article? I've skimmed it, gotten the gist of it, and I think their technique is quite clever. And the paper seems to give full details, so anyone can implement it.

      Basically, similar coding schemes make scheduling of data in a swarm easier (so there's no choking/unchoking a la BitTorrent, data just flows) and minimize the risk of a file piece being owned by only one peer (if he leaves, downloading is over). These encoding schemes, through linear combinations of pieces using XOR, combat this (I'm generalizing here). The most attractive, I think, are Rateless and Raptor codes, which have similar performance. (Incidentally, the former was developed by Petar Maymounkov, who was actually one of the inventors of Kademlia.)

      Anyway, a few months ago I read the Rateless paper, and thought "Gee, I should code this and release it under the GPL... It would be great for P2P apps!" But soon after I finished its implementation, I discovered that all the ideas authored in the Rateless paper were actually covered by patents of Digital Fountain, meaning that Petar's company, Rateless, had to develop a different, proprietary coding mechanism that is outside the patents of DF, and I can't release my code!

      So, getting back to my original point, the paper says, "Network coding can be seen as an extension or generalization of the Digital Fountain approach since both the server and the end-system nodes perform information encoding." Meaning that it might not be covered by DF's patents, and thus should be welcomed by the P2P community, and not immediately disregarded blindly by prejudice. I mean, if it's a 20% improvement, why not give it a chance, huh?

      - shadowmatter

  2. Alright! by qw(name) · · Score: 3, Informative

    The ultimate in spyware!!!

  3. point? by Anonymous Coward · · Score: 4, Funny

    It's meant for legal downloads only, of course.

    Then what's the point?

    1. Re:point? by ray-auch · · Score: 3, Insightful

      How about the fact the current MS windows update is real slow because it is client-server and there are always going to be hundreds of millions of clients all wanting the same damn thing at the same damn time.

      The patches ain't getting smaller either.

      This is exactly the sort of problem BT was built to solve.

      Even if they restrict it to only MS authorised updates it might still be a big win for them and, arguably, Joe windows user.

      On the other hand, if they screw up on whatever verification they put in (and they haven't exactly got a good track record on crypto implementations) then you've got virus heaven...

  4. Now with 20-30% more DRM! by Phoenixhunter · · Score: 3, Funny

    Palladium anyone?

  5. Question is.. by wfberg · · Score: 4, Interesting

    Will it block access to MP3 files and a big list of other file-types/filename-extensions? Like MSN Messenger 7 does? But, like MSN Messenger, allow .WMA files? And do this under the guise of "security", alleging that MP3 is an "unsafe" format (though unlike WMAs, MP3s can't launch websites or "acquire licenses" and stuff like that)..

    --
    SCO employee? Check out the bounty
  6. Microsoft returning to its roots? by the_skywise · · Score: 3, Funny

    It's illegal "wink wink nudge nudge" to copy Windows 3.1/98 but it helps spread windows users so that's a good thing.

    It's illegal "wink wink nudge nudge" to use our faster service, but it helps support Microsoft so that's a good thing.

    (It's not a bad idea, if it gets popular enough they can just roll it into Office and charge huge $$$ for it like their MSN Messenger 8...er... Microsoft Virtual Meeting...)

  7. Legal Downloads only. by soupdevil · · Score: 4, Funny

    Sounds familiar. My car is meant for legal speeds only. Which is why the "55" is highlighted in a special color. On my 140mph speedometer.

  8. Linux distros by Ochu · · Score: 4, Funny

    So you will find your way to debian_iso.avalanche, download it, and find that it has transformed into a handy little PDF explaining why linux bites...

    1. Re:Linux distros by mbbac · · Score: 5, Funny

      You trolls really get under my skin. You know this is Microsoft we're talking about, yet you still deliberately misinform people about obvious facts.

      Microsoft Avalanche will use a file name like debian_iso.ava.

      --

      mbbac

  9. Interesting... by TedTschopp · · Score: 3, Funny

    Spyware is found in Bit Torrent.

    Microsoft Releases competitor to Bit Torrent.

    Wow, I'm so glad they were so responsive to that problem. It only took them a couple of hours! That's amazing!

    --
    Fantasy remains a human right; we make in our measure and in our derivative mode... -- JRR Tolkien
  10. For those who ask why by NardofDoom · · Score: 4, Insightful
    Microsoft is developing P2P technology because their bandwidth bill from people downloading patches is threatening their profitability!

    Ha!

    --
    You have two hands and one brain, so always code twice as much as you think!
  11. Can we stop... by Anonymous Coward · · Score: 5, Insightful

    ...the knee-jerk reactions that this story will elicit? The original post really doesn't do TFA justice.

    This is basically an improvement to the BitTorrent protocol that will overcome scheduling difficulties that really do exist today (I need piece X, but the person who has it is busy uploading piece Y).

    What it is NOT:
    1.) A Microsoft-proprietary application (at least nor yet).
    2.) A production application that only runs on Windows.
    3.) In any way (in theory, at least) tied to DRM'ing anything.
    4.) A way for Microsoft to track your downloading.

    Basically, Microsoft has suggested a way to make BitTorrent-like downloads better. Microsoft! Making P2P downloads of large files easier! Really!

    This isn't MS search trying to overtake google, or some such. MS isn't trying to own the P2P market (at least not yet). They're suggesting improvements, and if you read TFA, the improvements make sense.

    This is a Good Thing. Yeah, I'm suprised it came from M$ too.

    1. Re:Can we stop... by ajs · · Score: 3, Informative

      Not shocking. The folks as MS Research are actually extremely bright, and often given a rather long leash. It's Micrsoft the software company that usually permutes the fruits of MS Research into the crash-freindly pablum that we've become all to familiar with.

  12. Distributed PAR2 by Ececheira · · Score: 4, Informative

    The way the Register describes it, it appears that rather than sending out chunks of the actual file, it's sending out something similar to PAR chunks where once you have enough data, you can reconstruct the original file.

    Futher, with a few chunks, you can calculate new chunks to send over to others, that way more people have access to more of pieces of the file.

    Sounds interesting, I wonder if it'll be incorporated into the next version of BT.

    1. Re:Distributed PAR2 by 1000StonedMonkeys · · Score: 4, Insightful

      Here's the thing. If you have a number of par files and all of the original segments, then there are many more pieces you could potentially download. If you need to download 500 of 500 segments, the number of sources you can download from begins to dwindle as you get on towards 400 or 450 pieces (I'm just making up these numbers, but you get the point). If instead, you need to download 500 of 1500 segments, chances are there won't be a scarcity of segments even at 499.

      IMHO, this is actually a really good idea, since I for one would take the added CPU overhead of processing parity files in return for more sources to download from. I've got spare CPU cycles anyway.

    2. Re:Distributed PAR2 by MikeBabcock · · Score: 3, Informative

      Its mathematically impossible to do this with less data than an original already-compressed stream.

      PAR data is additional redundant data to allow reconstruction of files for which not all the original blocks are any longer available.

      This is a *real* problem in some cases, mind you, but it requires sending *more* data, not less.

      The additional data is either padded onto each block (as they describe it) or as additional blocks (the way RAID5 or PAR works). Either way, you're talking about having *more* data on average.

      If no seeds become available *and* all the available peers do not combined have all of the blocks you each need *and* the blocks that are present are sufficient to reconstruct (from their redundant bits) the missing blocks, this becomes useful.

      --
      - Michael T. Babcock (Yes, I blog)
    3. Re:Distributed PAR2 by Wesley+Felter · · Score: 3, Informative

      Bram won't add FEC to BitTorrent because he's not convinced of the benefits in real-world situations. (Like most papers on this subject, Avalanche omits a lot of real-world details.)

    4. Re:Distributed PAR2 by ChadN · · Score: 4, Informative

      A simple example for those reading who don't understand, then some follow up comments:

      Say I have bits 'a' and 'b', that other people want.

      I could sent bit 'a', then bit 'b' to receiver FOO, who can pass them on to others. However, if I send bit 'a' first, and others want 'b', they have to wait.

      Now, instead of transmitting to FOO bit 'a' then bit 'b', I send to FOO ('a' XOR 'b') first, then either bit 'a' or bit 'b'. I'll end up sending FOO the same amount of information (assuming the order is specified in the protocol itself).

      BUT, and here's the cool part. If someone already has 'a', they can get ('a' XOR 'b') from you, and complete their set of data (bits 'a' and 'b'). Furthermore, if someone already has 'b', they also get ('a' XOR 'b') from you, and complete their set. So, by only downloading 1 bit, instead of 2, you can complete the set for others who already have one or the other bits.

      Now, in practice it'll get a lot more complicated, and the method presented in the paper is not exactly like I describe, but the idea is that you can send data to help people complete their data sets, even though you yourself do not yet have the actual uncomputed data. Instead, you have a computed function of the data, which others can use immediately, and from which you can reconstruct the actual data later when you have more information.

      The practical upshot is that the computed data is more valuable to other peers than the uncomputed data, as they may be able to use it to complete their data set, rather than wait for the remainder of the uncomputed data.

      So, in reference to your comments, it may not be so much more practical to any one receiver; they still need to wait for all the data, in either computed or uncomputed form. But, for the network as a whole, it means that each receiver has many more options from which to download and compute each chunk, and thus make available to others. It is not hard to imagine that this can benefit the overall throughput of the network (which the authors of the paper claim).

      --
      "It's overkill, of course. But you can never have too much overkill." - Anonymous Slashdot Coward
  13. Hmmmm by technomancer68 · · Score: 3, Insightful

    The scary thing is that if you are a windows user, what's the stop M$ from requiring any updates and patches to come through this new P2P system, thus making it almost mandatory to install it on your system if you ever want to update your OS. Microsoft doesn't want to compete, they want to force.

    --

    The Technomancer
    "Men of lofty genius when they are doing the least work are most active."-
  14. Comment removed by account_deleted · · Score: 4, Insightful

    Comment removed based on user account deletion

  15. Re:DRM gratis! by apoc.famine · · Score: 3, Interesting

    I'm going to laugh my ass off when someone finds a trivial way to defeat whatever DRM MS puts into this to make sure the content is legal, and they get sued for helping distribute copywrited material.

    Not laugh because they get sued, but laugh because I can almost guarentee that MS has the money and the lawyers to get off on the "we didn't host it" argument. And in doing so, they are big enough to set precident, and will thus free every other p2p software maker as well.

    Of course, how damn amusing would it be if their P2P was used to share...illegal copies of MS products?

    --
    Velociraptor = Distiraptor / Timeraptor
  16. Bram Cohen! by sinserve · · Score: 3, Funny

    You made it man, you fucking lucky sunnofabitch. Microsoft wants to compete with your work, that's a badge of honor man, you're made now.

  17. I want Windows by robertjw · · Score: 5, Funny

    Plus, how cool is it going to be to download Windows Server 2006 (or whatever it is) off a P2P network they created.

  18. Re:Better? No. by QuantumRiff · · Score: 4, Funny

    No, .mp3 is dying, not dead, its right there with apple, BSD, and our civil rights.. (only 1 seems to be true..)

    --

    What are we going to do tonight Brain?
  19. The Singapore solution by Simonetta · · Score: 3, Interesting

    I read that in Singapore, the world capital for techo-fascist innovation, trucks would have flashing lights attached to poles on the side of the cab. When a sensor on the engine detected that the truck's speed ever went above 35MPH, the light would start blinking. Then the first police car to see it would issue them a speeding ticket.
    If only half the things that I've heard about Singapore are remotely true, then this is one seriously weird place that reasonable people would be wise to avoid.

  20. Why.teh. Fuck?!!!! by Thud457 · · Score: 5, Insightful

    Would I want to use the bandwith I paid for so other Windoze lusers can leech off the copy of Longhorn Service Pack 3 that I downloaded? Microsoft wants me to take part in some damn hippy-dippy bandwith commune? While they're world renowned for not playing nice with others?!!! Get the fuck out!!!! You can't have it both ways Microsoft!!!!

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

    1. Re:Why.teh. Fuck?!!!! by empaler · · Score: 5, Insightful

      I think you misread this part:

      While they're (Microsoft) world renowned for not playing nice with others?!!! Get the fuck out!!!! You can't have it both ways Microsoft!!!!

      He meant that since MS are egomaniac bastards who do not share, they should not expect anyone else to behave differently. (Thud457, correct me if I misinterpreted, and if so, I apologize for putting words into your mouth)

    2. Re:Why.teh. Fuck?!!!! by Surt · · Score: 3, Insightful

      You could download the service pack direct from microsoft using the bandwidth that you paid for on both sides.

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
  21. Re:Better? No. by man_of_mr_e · · Score: 3, Interesting

    Actually, if you read the actual research paper, you can see WHY it's faster. Basically, it combines two technologies. A bittorrent like protocol, and file parity generation (such as PAR). This allows you to generate additional pieces you didn't download and reduce the amount of code you need to download by about 20-30%.

    This also solves "the last block" problem where everyone is waiting for the last block, since if you have 99% of the blocks you can generate what's left.

    It's an interesting approach.

  22. Yes, Microsoft wants to destroy competition by VernonNemitz · · Score: 4, Interesting

    And in this case, by creating a BitTorrent work-alike, they can draw up patent specs that INCLUDE BitTorrent's features, and then use that patent to shut down the servers. Time to start informing the Patent Offices!

    Also, folks, make a note of the DATE of that paper describing Avalanche. One PTO rule that seems to me gets violated often is that there is supposed to be (or used to be) a one-year limit between the public release of an invention's description and the patent application. After more than a year, it's too late to apply. How many existing dubious patents were applied-for too late and could be overturned on those grounds?