Slashdot Mirror


Researchers Decentralize BitTorrent

A Cow writes "The Tribler BitTorrent client, a project run by researchers from several European universities and Harvard, is the first to incorporate decentralized search capabilities. With Tribler, users can now find .torrent files that are hosted among other peers, instead of on a centralized site such as The Pirate Bay or Mininova. The Tribler developers have found a way to make their client work without having to rely on BitTorrent sites. Although others have tried to come up with similar solutions, such as the Cubit plugin for Vuze, Tribler is the first to understand that with decentralized BitTorrent search, there also has to be a way to moderate these decentralized torrents in order to avoid a flood of spam."

49 of 262 comments (clear)

  1. It's a good start... by Smidge207 · · Score: 5, Interesting

    ...and hopefully with this companies will start to use BT as an alternative to http/ftp. The downside is that you have to have a client, but I bet that browsers will have integrated BT support soon (the new Opera does, FF has a plugin). And the savings for the server range from a LOT to none, and even none can't hurt, since if nothing else you at least have a great download client able to resume downloads, download huge files, etc.

    =Smidge=

    --
    Is it just my observation, or is eldavojohn an idiot?
    1. Re:It's a good start... by larry+bagina · · Score: 4, Informative

      Opera has had bt support for a while. If you know what a torrent is, you're probably better off with a dedicated client, but for joe average clicking on a link to download, it's usable.

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    2. Re:It's a good start... by Anonymous Coward · · Score: 5, Insightful

      And exactly how many joe averages run Opera?

    3. Re:It's a good start... by philspear · · Score: 3, Funny

      Me, for one.

    4. Re:It's a good start... by bistromath007 · · Score: 5, Funny

      You're replying to a slashdot comment saying that you run Opera. What makes you think you qualify as Joe Average?

    5. Re:It's a good start... by BlowHole666 · · Score: 5, Funny

      Opera and myself have been browsing the web for porn since 2000 :) I never leave my pants on the floor without it :)

      --
      I smoked pot once. But I DID NOT inhale. Will you hire me?
    6. Re:It's a good start... by KovaaK · · Score: 2, Interesting

      My mom recently told me that I should switch to Opera, and she just turned 60 a few days ago. But, she also plays WoW and is more active in web development than I am... so I guess my family isn't exactly "average".

    7. Re:It's a good start... by TubeSteak · · Score: 4, Funny

      You're replying to a slashdot comment saying that you run Opera. What makes you think you qualify as Joe Average?

      He said "Me, for one" instead of "I, for one"?
      No /. elitist would munge their grammar in such a fashion

      --
      [Fuck Beta]
      o0t!
    8. Re:It's a good start... by Amouth · · Score: 4, Funny

      funny you mention that.. people whos computers i have had to clean viruses and crap off of because it was obvious they where browseing porn with IE.. install opera and inform them to use it instead... they have a odd face but hey i havn't had to touch any of their comps again (thankfuly)

      --
      '...if only "Jumping to a Conclusion" was an event in the Olympics.'
    9. Re:It's a good start... by Qzukk · · Score: 4, Funny

      No /. elitist would munge their grammar in such a fashion

      I propose that the poster is so elite that he is completely out of touch with Joe Average. Alas, due to this, his attempt at pretending to be average failed.

      The correct response should have been

      ME TOO

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    10. Re:It's a good start... by Jugalator · · Score: 5, Funny

      Opera and myself have been browsing the web for porn since 2000 :) I never leave my pants on the floor without it :)

      Uhh, too much inf... No wait

      -1, Informative ;)

      --
      Beware: In C++, your friends can see your privates!
    11. Re:It's a good start... by kv9 · · Score: 4, Funny

      He said "Me, for one" instead of "I, for one"?

      I, for one welcome our new Joe Average Opera-using overlords.

    12. Re:It's a good start... by Anonymous Coward · · Score: 2, Funny

      Don't you mean "Joe the Computer Guy?"

    13. Re:It's a good start... by Goaway · · Score: 4, Interesting

      Yeah, this is pretty much exactly the opposite of what companies looking to replace http/ftp want.

      See, here's the thing:

      Bittorrent only does file transfer. All other p2p clients do file transfer and search.

      Bittorrent is massively popular. All other p2p clients are struggling to get anyone to use them.

      And what lesson do people learn from this? Apparently that Bittorrent needs search. These are hardly the first people to have tried this, and found that nobody wants it.

    14. Re:It's a good start... by Darth+Cider · · Score: 3, Funny

      "No /. elitist would munge their grammar in such a fashion" That should be, "No /. elitist would munge HIS grammar in such a fashion." Not knowing this will cost you 50 points on the SAT test.

    15. Re:It's a good start... by MightyYar · · Score: 2, Funny

      Well, yes, unless the voices in my head contradict her.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    16. Re:It's a good start... by Killer+Orca · · Score: 2, Funny

      Shouldn't that be: "No /. elitist would munge his or her grammar in such a fashion."

      Their are no girls on slashdot, therefore the 'or her' is unnecessary.

    17. Re:It's a good start... by Darth+Cider · · Score: 3, Informative

      No. The "his or her" construct is grammatically incorrect.

    18. Re:It's a good start... by halcyon1234 · · Score: 2, Funny

      Bittorrent only does file transfer. All other p2p clients do file transfer and search.

      Bittorrent is massively popular. All other p2p clients are struggling to get anyone to use them.

      And what lesson do people learn from this?

      That having search functionality will make people not want to use a protocol?

  2. Centralisation is why BT is so popular by AmiMoJo · · Score: 4, Insightful

    BT is popular because you can go to a reputable listing site, find a well seeded and good quality torrent with comments by others to back it up and download it quickly. Compared to the chances you take searching traditional P2P systems, full of dodgy encodes, fake file names and incompletes it's obvious why people turn to BT first.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    1. Re:Centralisation is why BT is so popular by MasterOfMagic · · Score: 4, Informative

      Yes, and you can still do this even with Tribler. They're not mutually exclusive.

    2. Re:Centralisation is why BT is so popular by thepotoo · · Score: 2, Interesting
      Yeah, but the interface is clumsy (pretty, but still clumsy) and there doesn't seem to be any way to read comments on the torrents. The ability to sort by seeders is nice.

      But, what I really want is a way to sort by seeders AND 4 or 5 star ratings AND filter by category AND quickly view tags (dupe, spam, nuked, wrong category, etc) on a torrent. No site lets me do this, but Demonoid comes pretty close with filters.

      Decentralization is a pretty good idea, but it's certainly a long way from being ready for prime time - things may change, and there do seem to be sort boxes for heart (which I assume is rating) and magnifying glass looking at a person's neck (which might be comments, but doesn't seem to do anything anyway).

      I was hoping this could become a great way to find legal inde mp3s (people rate and comment, I filter by good rating and read comments then download, but it doesn't look like it's going to replace Demonoid without a pretty large critical mass of people.

      --
      Obligatory Soundbite Catchphrase
  3. Let me see if I have this straight... by bconway · · Score: 2, Interesting

    Full decentralized, search capabilities, with many people able to share pieces of the same file... I think we already have something like that.

    News flash: Centralisation is a strength of BitTorrent.

    --
    Interested in open source engine management for your Subaru?
    1. Re:Let me see if I have this straight... by TubeSteak · · Score: 2, Insightful

      News flash: Centralisation is a strength of BitTorrent.

      Ever since the demise of Napster and Grokster, followed by the public death of eDonkey, several large ED2K servers and various gnutella clients centralization has not been a strength and everyone has been running as fast as possible in the other direction.

      The problem with centralization is that it gives the **AA a big fat target to aim their lawsuits at. And they've quite successfully sued P2P companies into oblivion and hassled websites out of existence.

      --
      [Fuck Beta]
      o0t!
    2. Re:Let me see if I have this straight... by electrictroy · · Score: 2, Insightful

      I do. Having non-tracker searching might resurrect some of my current dead torrents. I hate being stuck at 80% forever, and there might be a seed somewhere out there just waiting to be discovered.

      --
      The government is not your daddy. Its purpose is not to raid middle-class neighbors' wallets and give it to you.
  4. Everyone should be aware... by Anonymous Coward · · Score: 5, Informative

    According to the website, Tribler will exchange torrent downloading history by default.

    1. Re:Everyone should be aware... by EncryptedSoldier · · Score: 3, Informative

      Yeah, and it also states it can be easily turned off by "disabling the recommender in the Preference menu".

    2. Re:Everyone should be aware... by TubeSteak · · Score: 2, Interesting

      Yeah, and it also states it can be easily turned off by "disabling the recommender in the Preference menu".

      I think you're missing the point.

      It's a stupid and arguably dangerous default setting to have enabled. The only way the company could make the **AA's lawsuit campaign any easier is to e-mail them the name of every torrent you download.

      --
      [Fuck Beta]
      o0t!
    3. Re:Everyone should be aware... by EncryptedSoldier · · Score: 2, Insightful

      Actually it is a somewhat useful setting for those of us who respect copyrights. Programs shouldn't revolve around making it easier for you to steal somebody's property and not get caught.

  5. Re:Ivy League by BlowHole666 · · Score: 3, Informative

    Good to see the best minds of this generation have chosen to benefit humankind with... ...a better way to steal stuff!

    Bit Torrent is not always used to steal stuff. Its how some game updates are downloaded, and most versions of Linux offer a Bit Torrent download.

    --
    I smoked pot once. But I DID NOT inhale. Will you hire me?
  6. eDonkey/eMule anyone? by imroy · · Score: 4, Insightful

    Is it just me, or is the BitTorrent world slowly converging on features and an architecture that the eDonkey network has had for years?.

    I mean, BitTorrent started out as a way to download big files, like Linux ISO's. Then people started making big torrent search web sites, similar to eDonkey servers. Then people made BitTorrent clients that had a queue of downloads (e.g utorrent), quite similar to eDonkey clients. Now these people have made Torrent searching distributed, just like eDonkey and Kademlia.

    I've never been much impressed by BitTorrent (gee, can you tell?). Just what is it that makes it more popular than eDonkey/eMule? Is it just the reputation and hype that has built up around "Torrents"?

    1. Re:eDonkey/eMule anyone? by fmoliveira · · Score: 5, Insightful

      with ed2k I enter in the 2000th position in 2000 different queues. with torrent my download starts almost immediatly at the top speed my connection supports. I don't like the work of emule developers at the protocol, and they aren't very receptive of suggestions. I think the users voted with their downloads.

    2. Re:eDonkey/eMule anyone? by Timmmm · · Score: 5, Informative

      It's the fact that

      a) The torrent sites are easy to search, have good files and few fakes.
      b) The tit-for-tat algorithm does a pretty good job of ensuring people upload stuff to you. Every other P2P software I used before bittorrent was slow and unreliable.

    3. Re:eDonkey/eMule anyone? by imroy · · Score: 2, Interesting

      with ed2k I enter in the 2000th position in 2000 different queues.

      Ok, I'll give you that. It often takes a while to start a download, especially if it's not widely available. eDonkey seems to be setup for college students - run it 24/7 and everything is queued. I wonder how BitTorrent does it differently. Surely not every BT download starts immediately - there can't always be enough idle peers (with the content you want) to make that possible. Is your experience mainly with new or old content, or both?

    4. Re:eDonkey/eMule anyone? by Carnildo · · Score: 4, Informative

      You seem to have some misconceptions on how BitTorrent works. Basically, when you start a torrent download, your client asks the tracker (a central server that's keeping track of things) which computers have the download in question. Your client then asks those computers for pieces of the whole download. The pieces come in random order, and it might take a while for you to get the whole file, but the strength of BitTorrent is that, by asking many computers for small pieces of the file, you're getting a share of the collective upload bandwidth of every computer that's got part of the file, rather than getting the complete upload bandwidth of a single computer. This lets the download start immediately, and means that even peers that don't have the complete download yet can help speed things up for you.

      --
      "They redundantly repeated themselves over and over again incessantly without end ad infinitum" -- ibid.
    5. Re:eDonkey/eMule anyone? by Goaway · · Score: 2, Interesting

      Is it just me, or is the BitTorrent world slowly converging on features and an architecture that the eDonkey network has had for years?.

      No, it's not.

      What is happening is that there are people who think that what BitTorrent really needs is to become eDonkey. And then they make a big deal about how they are going to turn BitTorrent into eDonkey.

      And then they find out that pretty much nobody wants eDonkey, and that's why they are not using it, but using BitTorrent instead. And their wonderful project slowly dies and is forgotten.

      And then we wait half a year, and the next person steps up to the plate to turn BitTorrent into eDonkey.

    6. Re:eDonkey/eMule anyone? by funfail · · Score: 3, Insightful

      And that's different from eMule/eDonkey protocol how?

    7. Re:eDonkey/eMule anyone? by Hatta · · Score: 2, Interesting

      You're exaggerating ridiculously, a file with 2000 sources you should start getting within a couple minutes with emule. A file with only a few sources may have large queues that take a while.

      Having queues at all is the problem. Don't make people wait to participate in the swarm. Give them data immediately, so they can upload it to others.

      --
      Give me Classic Slashdot or give me death!
    8. Re:eDonkey/eMule anyone? by Mr2001 · · Score: 4, Informative

      I've only used eMule, so I don't know how much these problems affect other eDonkey clients, but in my experience these are the big issues:

      1. You can only start sharing once you've downloaded an entire piece of the file. The same is true of BT, but eMule pieces are big and have a fixed size (around 9 MB). Torrent piece sizes are variable, and they're often less than 1 MB. This means you can start sharing sooner, especially since...

      2. ...eMule severely limits the upload speed per connection. If you set your upload rate to 30 KB/sec, you'll end up with 10 connections, each uploading at 3 KB/sec. At that rate, it takes nearly an hour to transfer an entire piece of the file, and until that's finished, the peer can't share any of the data you've been sending him.

      3. eMule's credit system is mostly only useful when you're downloading a group of files that are shared by the same users who are also interested in some similar files you have (i.e. you share S1E1 and gain credits that you redeem when downloading S1E2). BT provides immediate gratification: your uploads are almost always reciprocated right then and there.

      --
      Visual IRC: Fast. Powerful. Free.
    9. Re:eDonkey/eMule anyone? by Danny+Rathjens · · Score: 2, Interesting

      I think the difference is simply in the number of files and the time period.

      torrent: open for only a few hours and for a single download. Usually for recent tv shows.

      amule: on 24/7 and am sharing out all of my anime fansubs(2000-ish individual files). Some of them over a decade old.

      My overall upload bandwidth is throttled to about the same level for each, but the upload bandwidth for ed2k is distributed amongst my entire collection of files. Therefore people have to wait a lot longer to get a particular chunk of a particular file from me via ed2k.

      So, they both have their place. torrent is appropriately named and is great for newly popular content. ed2k is great for getting the fansubs of a 95 episode anime that aired on japanese tv 10 years ago. :)

    10. Re:eDonkey/eMule anyone? by Wildclaw · · Score: 2, Interesting

      How can BitTorrent, as it's been suggested, start downloading almost immediately when eDonkey supposedly takes longer?

      Noone said that it would go fast. You'll download at about the speed of your upload (and sometimes slower when it is a badly seeded torrent) which still is far better than emule. Of course, on well seeded torrents you get higher speeds as seeders contribute bandwidth without taking any.

      However, the real difference between bittorrent and emule is trust in the system. Bittorrent users have a far higher trust that peers on the other side will share as sharing is rewarded by higher upload speeds. That trust leads to people in turn sharing more which reinforces that trust. A simple positive feedback effect of a good trading system.

      Note, that this happens even though some people can leech. As long as most ordinary good people concieve the other side as sharing, they will go to more effort to share themselves. If that trust changes, maybe by an influx of people who just leech, then sharing will start to go down.

      Contrast that with emule that claims to be a sharing network instead of trading network. What this basically means is that they pretty much don't reward sharing, and direct trading is discouraged or punished. This decreases trust in the system. Why should you share when you can't trust that the other side does. Therefore people share less and leech more.

      The idea of trust is one of the basics in economics, which unfortunally is not so well understood by most, especially politicians. The goverment should stay away from things that reduce trust in the market and instead do neutral stuff (simple taxing without a myriad of exceptions) or even positive stuff that increase market trust (jailing scammer and liers as well as generally enforce laws or creating laws that make it more difficult to lie and scam)

  7. Re:Researchers plans by Anonymous Coward · · Score: 2, Insightful

    I always feel the need to correct this joke. Get rid of the ??? step as part of the joke is that it doesn't exist and ruins the entire thing. By adding the ??? step it's as if you are looking for the step when the idea is that you deny it is even needed.

    If you're always "correcting" a joke did you ever stop to think maybe you just don't get it?

  8. Re:Researchers plans by Anonymous Coward · · Score: 5, Informative

    The joke comes from South Park. In the South Park Episode, "Gnomes", the following sign explains the gnomes' plan to steal underpants: http://upload.wikimedia.org/wikipedia/en/d/dd/Gnomes_plan.png .

  9. Stupid Question by bendodge · · Score: 4, Interesting

    I know this is a naive question, but how does a client find any peers to query without a centralized server to get a list from?

    --
    The government can't save you.
  10. Re:Ivy League by MBGMorden · · Score: 4, Informative

    Actually far more rounds are expended in target practice than in killing people, meaning that target practice is a much more common use for a gun than murder.

    --
    "People who think they know everything are very annoying to those of us who do."-Mark Twain
  11. Re:Solving the wrong problems by JesseMcDonald · · Score: 4, Interesting

    If you want data from the internet, somebody is going to need your IP address.

    Yes, but the computer that has your IP address doesn't need to know the data, and visa-versa. That's the whole point behind onion routing; you route through one or more neutral intermediaries, and use end-to-end encryption. Neither endpoint needs to know the other's IP address, and the intermediaries don't have any idea what data is being exchanged. With two or more intermediate nodes you don't even have to disclose who you're talking to.

    --
    "The state is that great fiction by which everyone tries to live at the expense of everyone else." - Bastiat
  12. Re:Ivy League by xaxa · · Score: 2, Informative

    He said something, not someone. Hunting animals for food is generally accepted, killing animals in life-threatening situations too.

  13. Tribler and Cubit by BernardWong · · Score: 5, Informative

    Disclaimer: I'm one of the authors of Cubit

    Tribler takes an interesting approach to the distributed search problem -- collect Torrents in the background and perform on-demand searches locally. To improve recall, skew the Torrent collection to collect mostly from those that have similar interests.

    It does raise a few questions. Search quality for less popular Torrents will likely be affected. Searching for Torrents outside your typical interests may also be problematic. And given a Torrent may in theory be replicated to every Tribler client, there is some bandwidth concerns.

    I guess only time will tell if limiting search to only the files that have been previously downloaded by one of your peers is sufficient for most users.

    Cubit takes a different approach -- perform efficient, distributed search over all the available Torrents in a manner that is resilient to typos and spelling mistakes (from both the search string and the content). Rely on a separate mechanism (such as user comments or a reputation system like Credence) to determine good Torrents from SPAM in the search results.

    The approaches seem complimentary, and I'm looking forward to testing out the new Tribler once the website recovers from the Slashdot-ing.

  14. First?!?! eXeem was first by Carlosos · · Score: 2, Informative

    I still remember when suprnova closed down and they started development on eXeem which sounds to be exactly what they are trying to do here. That project didn't even last for a year.

    I believe that those researchers will fail the same way as eXeem failed.