Slashdot Mirror


The Centralization of BitTorrent Networks

Writes writes writes writes "A group of graduate students from the University of Washington have posted a a new independent report about the extent of centralization in regards to BitTorrent communities. The report indicates that irrespective of the recent damage dealt to global torrent sites, the communities are still very active, even despite their large degree of centralization (and perhaps exposure/liability). Furthermore, the report attempts to determine if the torrent communities follow the 80/20 rule, by measuring the Long Tail of torrent distribution."

39 of 162 comments (clear)

  1. Umm, no, it won't ever die. by garcia · · Score: 5, Insightful

    So seriously, is BitTorrent dead?

    No. Well, we don't think so, at least.


    That should have read, "is BitTorrent for Warez dead?" And no, it's not, but it probably won't appear like suprnova.org did again...

    Is BitTorrent dead? No, it will never die. Just as FTP for Warez dwindled and other transfer services took over (IRC, Napster, Kazaa, BitTorrent, foo) it didn't kill it. FTP, IRC, BT, foo, all have valid reasons for existing other than warez.

    BT though, above all the others, is actually really useful for trasferring large files quickly. Yeah, it's not good for the long term but I'm sure someone will come up with something that will make the protocol attractive for use outside of the Warez arena.

    It's just that the warezkids are all about picking up new tech and using it. It's their nature as they are generally tech oriented.

    I wish I could be a grad student and publish a bunch of bullshit with graphs and get my degree!

    1. Re:Umm, no, it won't ever die. by Kaptain_Korolev · · Score: 2, Funny

      Bit Torrents are now... Bit Trickles

    2. Re:Umm, no, it won't ever die. by araemo · · Score: 2, Interesting

      Yeah, I wanted the latest knoppix iso, so I of course used the torrent. Within 5 seconds I had hit 250KB/sec, not exactly my physical maximum, but pretty good for my connection(From very rare sites, I can get 400-500KB/sec, but 90% of internet sites cap out at 250 for me.)

      When it's something legal(And hence there is no reason to fear keeping your seed running) Bittorrent is still pretty fast.

      Especially since a lot of traditional mirror sites for *nix distros have added torrent seeds to their ftp mirrors. This seems to me like a good way of sharing the bandwidth load while also keeping download speeds fast.

    3. Re:Umm, no, it won't ever die. by nadadogg · · Score: 3, Insightful

      I personally hope that the public sites die, since they don't use registration, people shamelessly leech files and don't even come close to the 1:1 ratio that's needed for the network to thrive. I'll just stick with places that require registration, track stats, ban leechers, and thank me for contributing. There's probably 4 or 5 sites that I use for that sort of thing(thing being TV or movies). Besides, on smaller sites, there's more of a community, and the speeds stay good, much like yours did :)

      --
      i use linux and windows oh god how can i have an opinion
    4. Re:Umm, no, it won't ever die. by Morosoph · · Score: 2, Interesting
      There might be a texhnical fix to this: modifying the protocol to do better than tit-for-tat, perhaps as with this feature request of mine (see also follow-up).

      If clients bias towards good propagators themselves, then they will be themselves rewarded by those who do likewise. Leechers that do not upload anywhere near proportionally are, by definition bad propogators.

    5. Re:Umm, no, it won't ever die. by Morosoph · · Score: 2, Interesting
      Which works fine for a single file. All of your stats are reset as soon as you switch to a new torrent/tracker. The only way around this is keeping all torrents on the same tracker (see: empornium), but that has its own failings.
      This is true, but if your are sniffed out within a few minutes by your fellow clients, it'll be a slow business getting any file. This makes leeching pretty pointless.

      Ratio will do it, of course, but if a techinical fix could be found, that would help to keep things open.

    6. Re:Umm, no, it won't ever die. by kitty+tape · · Score: 2, Interesting

      I wish I could be a grad student and publish a bunch of bullshit with graphs and get my degree!

      This is not an academic paper. It is just an informal paper that happens to be done by graduate students. You really should make sure you have something to be an anti-intellectual snob about before you start spouting nonsense.

      --
      ----- "Type theory is like pretzels on crack." -- random friend
    7. Re:Umm, no, it won't ever die. by Morosoph · · Score: 2, Interesting

      You don't look at what people are telling you; you infer rates from the distribution of files in the wild, and how they change. It's a problem involving stats and matrix manipulation.

    8. Re:Umm, no, it won't ever die. by HeghmoH · · Score: 5, Insightful

      A 1:1 ratio for everybody is mathematically impossible. For every byte uploaded, you have a byte downloaded. You also have at least one person who doesn't download anything at all, the original seeder. The average ratio of the entire network is always 1:1, and the average of the entire network minus original seeders will always be less than that. You will always have people who don't have a 1:1 ratio even if everybody is super-nice and lets their torrents run forever after they finish.

      --
      Mod down posts with a "Free Mac Mini/iPod" sig, they're spam!
  2. A matter of access and exposure by teiresias · · Score: 4, Insightful

    This isn't really suprising.

    Whether it's FTP ip's, P2P network names, or in this case centralized BitTorrent servers, it all matters on who has access to these sites and how much exposure that site has.

    If say SuperNova was a registration only site it might have stayed open for another couple months. If say SuperNova was a registration site which only registered friends and known people, there's even less of a chance of being taken down.

    Any large publicly available distrobution method for illegal digital products will attract the attention of the authorities and be brought down. Small, regulated, private networks will continue to run despite a crack down. This has always been true.

    But than, for the authorities, it really is more important to take down the larger sites not eliminating the problem.

    --
    -Teiresias
    1. Re:A matter of access and exposure by garcia · · Score: 4, Insightful

      Any large publicly available distrobution method for illegal digital products will attract the attention of the authorities and be brought down. Small, regulated, private networks will continue to run despite a crack down. This has always been true.

      But than, for the authorities, it really is more important to take down the larger sites not eliminating the problem.


      It's like anything "illegal". There's always a thriving underground arena to trade your stuff. The authorities can easily bring down the large and open ones cutting off the general unknowing public to it. That will eliminate 95% of the "problem".

      The other 5% would find out how to get it regardless of whether it was public or not.

      I guess they just hoped they could scare most people into stopping.

    2. Re:A matter of access and exposure by killmenow · · Score: 2, Funny
      I guess they just hoped they could scare most people into stopping.
      When I first read that, I thought you wrote:

      I guess they just hoped they could scare most people into shopping.

      Which, come to think of it, is probably their ultimate goal.
    3. Re:A matter of access and exposure by p0rnking · · Score: 2, Interesting

      Suprnova is now registration only .... and it looks like they are using exeem now too

      "Download Torrents, Movies, Shows, Music, Full Albums and more!
      Exeem Suprnova - register now and get all of these benefits and more"

  3. Reason for success by krudler · · Score: 4, Insightful

    Sure people are easily tracked who use bit torrent. I doubt they really care. Bit Torrent allows easy ways to find files. It may not be mainstream easy, but it is very easy to use. You can get tons of movies/music/tv shows/warez with little effort, much easier than tracking down ftps and getting access from someone/ using kazaa and hoping what you download is really what you think it is, etc. People want easy access to filez! THey don't care about getting caught

  4. Ironic twist by Anonymous Coward · · Score: 3, Insightful

    Would it not be an ironic twist if the media companies adopted BitTorrent to distribute shows. Maybe the next supernode will be a Sony site.

  5. 80/20 Rule? by Horkdoom · · Score: 2, Informative

    I had thought that the more recent statistics showed something more like a 5/90 rule...

  6. The search engine by Underholdning · · Score: 3, Informative

    Their search engine was actually pretty good (it's down right now due to excessive traffic). It shows details about the torrent like what files are inside, the speed of the tracker etc. Quite useful.

  7. Re:While we're on the subject by JaffaKREE · · Score: 3, Informative

    as has been stated on previous threads, google is one of the best torrent search tools available. Use filetype:torrent.

  8. Re:Don't be surprised... by Slayback · · Score: 2, Informative

    File Rush is always good for movie trailers, demos, patches, etc...

  9. BT links on FreeNET by nurb432 · · Score: 4, Interesting

    This would help reduce the liability of centralized 'link sites'.

    Sure, you can still be tracked once you hit a tracker, but at least the source of the links is safe.

    And before you shout ' freenet is slow', getting a simple BT link from FN would work well. Thats what FN is designed for.. Small bits of data..

    --
    ---- Booth was a patriot ----
  10. I belong... by ImaLamer · · Score: 4, Informative

    ...to a few a Torrent "communities" and feel pretty safe.

    First thing is that the communities don't share warez and big mpaa releases, just stuff you can't find elsewhere. Sure we are centralized but no one is going after people who share documentaries and obscure stand-up.

    Are they?

    Beware however... some torrent sites are selling out to scam artists. Take this site for example - they hosted DVD's to "Appz" and sold out. I assume it's now a MPAA dragnet.

  11. BitTorrent's usefulness? by FreeLinux · · Score: 2, Informative

    I very recently used BitTorrent to retrieve a couple of popular Linux ISOs. The performance was horrendous. Yes, my client was properly configured and the firewall was configured correctly. While over 200 peers and 60 seeds existed in the swarm, my download rate was an abysmal 20-30KBps. My upload speed, on the other hand, was a nifty 110KBps. (You're welcome.)

    This may seem like an isolated situation, but, I find it to be the case more often than not. Occasionally, I will experience a fast download but, only rarely. I realize that BitTorrent may be a good/only source for illegal downloads but, it was supposedly designed to distribute load and increase performance. For me, BitTorrent rarely meets its design purpose. In most cases a reliable FTP server offers better performance.

    So, I question BitTorrent's usefulness and whether it will last for its originally intended purpose.

    1. Re:BitTorrent's usefulness? by Qzukk · · Score: 4, Informative

      I find it to be the case more often than not

      Yes, thanks to the TCP/IP protocol, this is the case more often than not.

      Because the TCP/IP protocol requires you to ACK everything you download, if you cram your upstream pipe full of junk, your ACK packets are going to be delayed a nice long time, causing your download to stop while the other end wonders what happened to you.

      Fixing this is as simple as limiting your upload rate. Or if you want to discover the internet as it was really meant to be on broadband, implement a Quality of Service setup that prioritizes ACK packets and watch in amazement as everything seems to go faster when under load.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    2. Re:BitTorrent's usefulness? by 787style · · Score: 5, Informative

      That's your problem - your upload was choking your download. Use a client like Shadow's Bittornado http://www.bittornado.com/ and throttle your upload speed.

    3. Re:BitTorrent's usefulness? by Morosoph · · Score: 2, Insightful
      The thing about bittorrent is that it is a trading protocol. Your upload is your 'bid', and you can receive a corresponding download. The trouble is that if your upload 'bid' is high, there won't be download 'bids' of equal magnitude, so you have to accept what you can get.

      It might also be, as others have suggested, that your upload is choking your download.

  12. 80/20 rule by Xugumad · · Score: 4, Informative

    We (Distributed Systems group at the University of St. Andrews) presented a paper at PGNet 2004, available at:

    http://distsyst.dcs.st-andrews.ac.uk/btpaper.pdf

    which shows (Figure 10) that 75% of BitTorrent users don't upload as much as they download, or put another way, the majority of the uploaded data comes from 25% of the users. I don't have time to work out just how much of the data each section is responsible for, but the numbers are interestingly close to the 80/20 rule.

    I don't have time to run the numbers right now, but I wouldn't be too suprised to find that 20% of users uploaded 80% of the data...

  13. Re:Don't be surprised... by cuzality · · Score: 3, Informative

    Legaltorrents.com (RSS) has a few things -- it's small but growing...
    LegalTorrents is a collection of legally downloadable, freely distributable creator-approved files, from electronic/indie music to movies and books, which we have made available via BitTorrent - we (concept/updates - simon c., code - reed, bandwidth - joe/tommy, logo - tony kinglux) are also hosting a 'guaranteed' high speed seed for them. Everyone that grabs the BitTorrent client and downloads helps contribute more bandwidth, because BitTorrent utilizes your unused upload bandwidth. Please note that all of the current torrents are made available under a Creative Commons license with the full permission of the rights holder.

    ---
    Free, quality mixing software for MP3 DJs
  14. domain tracking by drunken+dash · · Score: 2, Informative

    it seemed to me like those guys had placed emphasis on domains, but is it not possible that multiple domains may point to a single site?
    for example, with suprnova.org's multitude of mirrors, it's really a single site that uses many domains, so it doesnt seem fair to me to say that 10% of the domains having over 90% of the files is a big deal, and is very skewed towards centralized locations.

    --
    Enjoy an e-piphany
  15. Support It by Zone-MR · · Score: 2, Interesting

    If you are like me and believe that sites which simply trade hashes of illegal files should not themselves be illegal, you might want to consider heading over to www.lokitorrent.com and making a small donation to their legal defense fund.

    Who knows - if one site acheives the budget to stand up for themselves in a legal battle, it might set a very welcome precedent.

  16. Indicates Nothing by CrazyWingman · · Score: 2, Informative

    From TFA:

    First of all, it should be noted that the dataset was from early December, and thus preserves the distribution of torrents before the recent site shutdowns.

    So, you may want to try reading a little more closely next time. In no way does this article indicate "that irrespective of the recent damage dealt to global torrent sites, the communities are still very active".

    Slashdot moderators, mind RTFAing before publishing submissions?

  17. double-tailed by TheSHAD0W · · Score: 4, Interesting

    The reason why the "extra long tail" is so amazingly long is because the authors are merging two different types of BitTorrent usage. BitTorrent was designed for legitimate content, and for content distributors to run their own trackers. For example, my tracker is used just to distribute my own projects. Distribution is off the main website, with only one torrent shown. This is an example of BT's legitimate use, and even the largest legitimate BitTorrent sites pale in comparison to the piracy sites. There, you'll see much higher numbers of torrents, and few servers that only distribute small numbers of torrents.

  18. Thank you all. by FreeLinux · · Score: 2, Interesting

    But, I am familiar with how to use BitTorrent and where problems can occur. I sit on a multi-megabit high-speed pipe (bidirectional). The BitTorrent client was set to limit upload speed at 110KBps, the client's default. I did try lower upload limits as well as limiting the number of connections but, it didn't change anything with the download performance. After the download completed (12 hours) I opened up the number of connections and removed the upload limit. Leachers enjoyed upload speeds of 600KBps until the up/down ratio hit 3 and I then removed the seed.

    I remain unconvinced about BitTorrents abillity to meet its design goals. Whether that is due to BitTorrent itself or selfish users, I don't know, but performance isn't what it should be and it seems to be getting worse with time.

  19. MOD PARENT UP! by Spy+der+Mann · · Score: 2, Funny

    Informative.

  20. Re:Don't be surprised... by cpt+kangarooski · · Score: 2, Informative

    The problems are that

    1) If it's a C&D and not a 512 Takedown Notice, then there's nothing that guarantees you'll get one. A plaintiff sends C&D's in the hope that it'll cost less for them than immediately preparing a lawsuit. But these days, it's hardly unusual to get sued right out of the gate. That you can't ignore.

    2) You have to do what the C&D says to avoid the risk of a lawsuit by the sender (though there is also the chance that you can ignore it and still not get sued). Likewise with 512 Takedown Notices. This costs you effort at least, and may significantly impair what you were doing.

    3) 512 Takedown Notices are probably the best, since you can't be sued if you're eligible to receive them, until you have received it and have not complied with it in accordance with the statute. But you have to do some advance work to be eligible to receive them, and virtually no one outside of businesses bothers, even though it's pretty easy and protects against some, but not all, liability.

    --
    -- This and all my posts are in the public domain. I am a lawyer. I am not your lawyer, and this is not legal advice.
  21. This changes nothing by Jahz · · Score: 4, Insightful

    It is true that the closing of Suprnova.org was a mighty blow to the availibility of torrents, but it changes nothing in the long run. In a few weeks there will be a new uber-big torrent directory. Actually, there already are a few.

    In my opinion, BitTorrent is still a new and wandering technology. It is being employed in many different way and still has plenty of undiscovered potential. It is already an excellent way to cheaply distribute free software (i.e. linux distros). It is also a great way to distribute 0-day files with minimal liability and cost.

    BitTorrent is still the best way to get less-than-legal new (...brand new) tv show episodes, movies and multi-platform games. There are many reasons for this. Namely, it spreads liability across hundreds or thousands of individuals, not a single server. Secondly, .torrent files are very small and easy to spread. Finally, even if every peer has a slow dialup connection, a broadband downloader can still reach some very respectable speeds. Not to mention that most of the clients preform superb error checking on each peice of data.

    As a protocal, BT is perhaps the most promising for large file distribution. There are some faster, and some even less centralized protocals, but in the end BT beats them all.

    If you are concerned about BT's future as a method of underground file distribution: worry not. The torrent underground has its roots firmly planted in IRC. In fact, some of the best sites for well seeded torrents are just web-front ends to IRC channels (i.e. tvtorrents). BT will exist until something better comes along. That is the way of things.

    note: this is not directly in response to the articles, rather it is in response to some of the other /. posts.

    --
    There are 10 types of people in the world. Those who understand binary and those who do not.
  22. That's nice, but ... by magicianuk · · Score: 3, Insightful

    ... it's really hard to meet the 1:1 etc. requirements unless you get there early.

    The number of torrents I start downloading and then find that there's no more seeds etc. so I get 90% of a large file and then I'm stuck ... I can stay up and be prepared to feed that 90% downstream but that just means more people with an incomplete RAR/ZIP/AVI whatever.

    And if I get to a download late, I can sit there and download, say 100Mb fairly quickly from all those nice seeders (say 10 seeders and just two new downloaders), but then anyone new that comes along has 12 sites feeding and since 10 have 100% and then there's me with whatever I've downloaded so far, I hardly ever get a chance to feed downstream, so I sit there for days and never get anywhere near 1:1)

    There needs to be a better way of rating people who want to be good torrent users ... for example, keeping a torrent open should count for 4% an hour, so that if you keep the torrent open for a day after you've finished downloading, even if no-one feeds from you, you still get credit for making the torrent available.

  23. Re:There are better ways to spend your money. by maxpublic · · Score: 2, Informative

    Watching a poor-quality .avi of a movie is a completely different experience than seeing a much better version - even a rented VHS. The same is true with music uploaded at 128 kbs as compared to straight off the CD.

    Torrents allow you to say "this movie sucked, I'm damn glad I didn't pay for this shlock" just as you can sample a CD and say "no way I'm paying $16 for 2 good songs and 10 shitty ones". So yeah, I'm bloody well glad I didn't pay for flops like "Alien vs. Predator" or "The Aviator", but "Van Helsing" was *much* better in the theater and well worth the money.

    And do you honestly think, having eagerly watched all the BG episodes via torrent, that I'm not going to watch them *again* when they start airing here in the U.S. in a few days? Really now, anyone who did that should have their geek license revoked.

    Max

    --
    My god carries a hammer. Your god died nailed to a tree. Any questions?
  24. easy-to-use BT wrapper available by sacrilicious · · Score: 2, Informative

    There's an easy-to-use wrapper for bit torrent available here. It allows grandma to simply click once on a link and download the torrent... even if she didn't have bit torrent installed.

    --
    - First they ignore you, then they laugh at you, then ???, then profit.
  25. Re:There are better ways to spend your money. by Cereal+Box · · Score: 4, Insightful

    Watching a poor-quality .avi of a movie is a completely different experience than seeing a much better version - even a rented VHS.

    You must not have gotten the memo. Movies on DVD are ripped to MPEG4, and generally look indistinguishable from the DVD itself (and many times include the actual Dolby Digital 5.1 audio track). In essence, you're downloading a copy of the movie that many are hard pressed to differentiate from a DVD.

    In the case of movies running in the theater, ones shot from camcorders are watchable but not in excellent quality, whereas those ripped from a screener DVD (this practice may have been discontinued recently, I'm not sure) are quite excellent.

    The same is true with music uploaded at 128 kbs as compared to straight off the CD.

    Of course, no one releases albums in 128Kbps anymore, it's all 192Kbps or VBR. Throw those tracks on a CD and most people would be hard pressed to tell the difference.

    The "downloaded copies have poor quality, so that's why people will still buy the product" argument doesn't hold that much water in a lot of cases. Most people would gladly take 99% quality at 0% price rather than 100% quality and 100% price. THAT'S what the movie studios and record companies have to compete with. There are far fewer altruistic downloaders than you may think.