Slashdot Mirror


Bittorrent To Replace Standard Downloads?

Max Sayre writes "Have you ever tried to download an operating system update only to have it fail and have to start all over? What about patches for your favorite games? World of Warcraft already uses Bittorrent technology as a way to distribute large amounts of content at a lower cost to the company and faster speeds to all of their clients. So why haven't they replaced the standard downloading options built into any major OS? Companies like Opera are including the downloading of torrents in their products already and extensions have been written for Firefox to download torrents in-browser. Every day Bittorrent traffic is growing. Sites like OpenBittorrent already exist and DHT doesn't even require a tracker. So why isn't everyone doing it? Is it finally time to see all downloads replaced with Bittorrent?"

49 of 591 comments (clear)

  1. You explained it. by binarylarry · · Score: 4, Insightful

    When torrent support comes equipped on all the major browsers, it can take off.

    Until then it's a tool for nerds to get their porn faster.

    --
    Mod me down, my New Earth Global Warmingist friends!
    1. Re:You explained it. by smartr · · Score: 4, Insightful

      I can see this really taking off in the office I work at... Oh wait... Is that a giant truck of bandwidth clogging the private network? You're using the VPN to host torrent files? Ring Ring, the customer wants to know why is the internet so slow.

    2. Re:You explained it. by haruchai · · Score: 3, Insightful

      Why the hell would it have to be in all the major browsers, when the ability to open files with external apps has been around for a decade, if not longer.
      Just so you know, there have been Firefox addons for torrents for several years and Opera baked in right into the browser over 5 years ago.

      --
      Pain is merely failure leaving the body
    3. Re:You explained it. by davester666 · · Score: 4, Interesting

      Hell, I'm on Shaw Cable in Canada, and if I don't limit my upload bandwidth to 5 kb/s, my download bandwidth drops to sub-50 kb/s. But if I do limit it to 5 kb/s, then download speeds go way up to over 200 kb/s.

      And yes, they advertise that I should be getting an order of magnitude greater speed than this...

      --
      Sleep your way to a whiter smile...date a dentist!
    4. Re:You explained it. by Nirvelli · · Score: 3, Insightful

      Because your everyday normal "series of tubes" people can't go to the effort of using your "external apps."
      And the only Firefox addon they have is VideoDownloadHelper, because they went on Yahoo Answers asking how they could download YouTube videos.

    5. Re:You explained it. by Sancho · · Score: 5, Informative

      Your acknowledgement packets probably aren't getting through.

      http://www.benzedrine.cx/ackpri.html

    6. Re:You explained it. by Sir_Lewk · · Score: 5, Insightful

      This. People don't seem to realize that PDF, word documents, and flash will never take off as accepted formats for the layman unless they are baked into every major web-browser.

      Wait, what?

      --
      "linux is just DOS with a UNIX like syntax" -- Galactic Dominator (944134)
    7. Re:You explained it. by Runaway1956 · · Score: 3, Informative

      That's why you use a traffic shaper on your own network. With Wondershaper, I find my real available bandwidth, subtract a small percentage from the available bandwidth, and throttle everything to that speed. With short queues, everything just moves along nicely, and high priority packets are moved to the front of queues. If you allow the queues to get long, with no prioritization, bandwidth comes to a crawl. Now, don't get me wrong here - I am not advocating that ISP's do traffic shaping. They will do it all wrong, for all the wrong reasons. If most people did the traffic shaping on their own networks, it would relieve the load on the ISP, and the ISP would have less justification for traffic shaping THEIR WAY. So - what does traffic shaping mean, in real life, on my own network? Without traffic shaping, any person can start a download from his desktop (or laptop), or watch a Youtube video, and bring everyone in the house to a crawl. Pages may not load at all for other people. With traffic shaping, I can start huge downloads from all five machines on the network, but all five machines can still browse. Those downloads run somewhat slower than they would have - but no one is screaming, "WHY CAN'T I LOAD MY EMAIL?? WHO IS DOWNLOADING THE ENTIRE INTERNET?" Try it. Put a traffic shaper on your gateway machine, or at least set up QOS on your router. The internet will never look the same again.

      --
      "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
    8. Re:You explained it. by Runaway1956 · · Score: 5, Informative

      Again, traffic shaping. I use Wondershaper, from the Ubuntu repositories. # wondershaper eth1 300 90 Problems solved. Of course, you have to determine your total available bandwidth so that you can determine what speeds will work best for your network. (real speeds, not advertised speeds) You'll likely spend 15 to 30 minutes getting is set up, unless you already know what you are doing. Once done, you'll never have to worry about choking your internet connection again.

      --
      "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
    9. Re:You explained it. by Idbar · · Score: 3, Insightful

      I don't see why you're modded interesting, when you should be modded +5 informative.

      Some people don't understand the fundamentals of TCP's congestion control/flow control. Bit torrent is a very greedy, selfish, egocentric, abusive (keep going with the adjectives) algorithm. It takes advantage of TCP's mechanism to provide fairness, and use it to abuse the rest of the users. While people is excited about it's performance to selfishly downloading data, the widespread of these type of algorithms may lead to unusable networks. Particularly, because there is no queue management enforced and marking mechanisms are not used by default, therefore, routers will drop packets and the end effect is a large number of retransmitted packets.

      As the the parent points out what the grand parent states, the greed of such protocols even degrades the throughput by starving the acknowledgement packets.

  2. The bigger question is: by pizzach · · Score: 3, Interesting

    Why aren't linux package managers using this instead of just leaching off of college servers and the like?

    --
    Once you start despising the jerks, you become one.
    1. Re:The bigger question is: by compro01 · · Score: 5, Informative

      There was apt-torrent, but that project appears to be abandoned.

      The thing is probably that there is no pressing need. There are many educational facilities that are are willing to provide mirrors for such things, so there's no real reason to implement a system to borrow user's upstream bandwidth.

      --
      upon the advice of my lawyer, i have no sig at this time
    2. Re:The bigger question is: by jojoba_oil · · Score: 5, Insightful

      Because for security updates, this allows users to find others who don't have the latest patches yet. Just imagine the people watching leecher IPs every time a new remote exploit is patched...

    3. Re:The bigger question is: by buchner.johannes · · Score: 5, Interesting

      I would like a solution that combines metalinks (one file that contains multiple urls for a download plus the checksum) with Bittorrent.
      A client could start a http download from one server, and a bittorrent that requests pieces for the latter chunks. You can also make multiple http request with a offset these days, on another http server or the same one.

      This could even be built in magically into http browsers: if the file size is > 50MB, ask the cloud if there are nodes for the given url. That is provided you have a checksum like with metalinks. Appearantly metalink already features this possibility: http://www.metalinker.org/

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    4. Re:The bigger question is: by antifoidulus · · Score: 5, Informative

      The file sizes of most Linux packages are simply not big enough to warrant the use of bittorrent. The 32 bit x86 kernel(usually one of the biggest packages in a distro) is only about 32 megs or so. By the time you downloaded the tracker, found your peers and actually started downloading something you could have had the whole package d/led already. Most big universities and research institutions have to host the files anyway(for internal updates), its not all that difficult to extend the download service to the general public. Not to mention the fact that in order for the torrent to be effective you would actually have to retain the packages after installation which can quickly become a huge pain in the ass.....

    5. Re:The bigger question is: by blueg3 · · Score: 4, Insightful

      Contacting the tracker and getting an initial peer list, in a proper system, takes a fraction of a second. It's iteratively contacting peers, obtaining their piece bitmap, negotiating with them for piece exchange, and finding peers that actually have high bandwidth that makes the startup time of BitTorrent so high.

    6. Re:The bigger question is: by scrib · · Score: 3, Insightful

      Not quite... The difference is that you could download from any or ALL of the trusted peers (currently known as "mirror sites") at the same time. Seems a bit better than trying to pick from a list of mirrors that might be close to you or using the "random mirror" link. If one mirror was down or slow, it would barely be noticed on the downloader's end.

      Also, once a machine downloaded and installed the patch it could then announce back to the tracker that it can be a seed as it is no longer vulnerable. So, the tracker would only show seeds, and the downloading system would only announce that it was a seed AFTER it installed the patch.

      --
      Help! Help! I'm being repressed!
    7. Re:The bigger question is: by Splab · · Score: 4, Interesting

      This is spot on.

      WoW (and other MMOs) needs torrents, because they have an very high to extremely high burst ratio. When a new patch is deployed for Linux it needs to propagate out to various distributions, people need to start packing it and then end users auto update will pick it up eventually. This means it's often distributed over time. When WoW deploys a new patch, they have 10 million people trying to get it at once in order to be first in new instances. Even the big distributors have trouble coping with this - and over a short period of time the need for bandwith will drop to very low levels as people are getting up-to-date, so there is no financial incentive for Blizzard to invest in the hardware to cope with deployment.

    8. Re:The bigger question is: by adolf · · Score: 5, Insightful

      But if the repositories were themselves seeding, then it'd work just fine: Worst case is that it's still at least as fast as HTTP or FTP from the same repository (plus or minus some BT overhead), all else being the same.

      Best case is that there's several repositories all seeding the same basic set of random apps, plus a bunch of users who have already downloaded the random app, and things turn both faster and cheaper than they otherwise would have been.

      The hash checks performed by BT will do well to prevent errors and/or poisoned apps, as well.

      Sounds like a win to me.

  3. Take it a step further... by dominion · · Score: 5, Interesting

    Combine this with social networking to allow/deny access to your files and I think you've got a game changer. Files which require no server, and which are unknown/unavailable to anyone who doesn't need to know about them. I could share my mp3 collection or movie collection with only my friends list, which would be much more along the lines of fair use (like tape trading).

    1. Re:Take it a step further... by rHBa · · Score: 3, Insightful

      Isn't this what private trackers do already?

      Yes, they require a server (tracker) to limit access to members only but that functionality would just be shifted to the social networking site.

      If you're planning to do this without a tracker then how do you prevent people outside your friends list from joining the torrent (assuming they manage to find a copy of the .torrent file)?

      If you have friends list big enough to make bittorrent worth while it's quite likely that someone will leak the torrent file to someone they trust who may share it with someone else THEY trust etc, etc...

    2. Re:Take it a step further... by jmottram08 · · Score: 4, Insightful
      Exactly how does this not require a server?

      Just a heads up, this "game changer" is called a ftp server. My friends and family already have access to download my files or upload whatever.

      Maybe what you want is a game changing facebook app that just manages passwords and opens a new window with your friends ftp server in it.

      Why are you trying to reinvent the wheel?

  4. File size by gringer · · Score: 4, Insightful

    Why? because for small files (as I expect most software updates would be), downloading directly is quicker and safer.

    --
    Ask me about repetitive DNA
    1. Re:File size by Anonymous Coward · · Score: 5, Insightful

      Why? because for small files (as I expect most software updates would be), downloading directly is quicker and safer.

      Safer? Bittorrent already has built in checksumming which most people don't do with regular downloads anyways. By that metric alone I'd say the BitTorrent is safer than a regular download.

    2. Re:File size by Anonymous Coward · · Score: 5, Insightful

      Because when you download directly instead of torrenting a file, you aren't basically shouting to the world "HEY I DON'T HAVE THE NEW SECURITY UPDATE YET! ANYONE HAVE THE NEW SECURITY UPDATE?"

    3. Re:File size by kurokame · · Score: 5, Informative

      AC knew what he was talking about. Let me spell it out since you (and the guy who modded you Insightful) clearly don't.

      IPs in a swarm are visible to anyone who can join the swarm. If you use it for security updates, you are implicitly announcing (a) the security update in question, and (b) how to join the swarm. Q.E.D., most people attached to a swarm who are not yet seeding (and possibly many of those who are seeding) do not have the update installed and are publishing this along with their IP for anyone on the internet to see.

  5. Data Caps by Anonymous Coward · · Score: 5, Informative

    Those of us stuck in New Zealand or Australia still have data caps to think about. If every download was a torrent there would be a lot more overhead eating into our precious data caps!

    Please, think of the Kiwis.

    1. Re:Data Caps by blackraven14250 · · Score: 4, Informative

      Every ISP has data caps in those areas. It's not an isolated thing.

    2. Re:Data Caps by cheekyjohnson · · Score: 5, Funny

      Competition, man. It solves all. There's probably hundreds, if not thousands, of ISPs in his area alone that offer an unlimited data plan. They're just invisible!

      --
      Filthy, filthy copyrapists!
    3. Re:Data Caps by ThatOtherGuy435 · · Score: 5, Informative

      He's making fun of people who believe without evidence in the invisible hand of the free market with regards to broadband competition in the US.

  6. Why? by DarkKnightRadick · · Score: 4, Insightful

    Because Bittorrent has a reputation issue, for one. The MPAA and RIAA attack it and call it the reason they are losing money (instead of their failing business model).

    Large companies don't want to have to deal with the previous hassle, and even though the load might not be much for individual computers, if everyone on a company network was bittorrenting, other traffic would be interrupted (even on 2MB DSL, bittorrent interferes with my connections to many popular IM services and I don't even run it full throttle during the day).

    --
    "There is a way that seems right to a man, but its end is the way of death." Proverbs 16:25 (NKJV)
    1. Re:Why? by xiando · · Score: 5, Informative

      Because Bittorrent has a reputation issue, for one. The MPAA and RIAA attack it and call it the reason they are losing money (instead of their failing business model).

      Try running a perfectly legal BitTorrent tracker. You will find that the MPAA/RIAA criminals both DDOS your server and spam your ISP with DMCA crap regarding files you are not tracking and never heard of. They really dislike BitTorrent.

    2. Re:Why? by Dayofswords · · Score: 5, Insightful

      MPAA said the same thing about the VCR.

      Can we go back to not giving a fuck what the MPAA thinks?

      --
      Someday we'll hit the human carrying capacity. And the band will just play on.
    3. Re:Why? by Anonymous Coward · · Score: 5, Insightful

      Try running a perfectly legal BitTorrent tracker. You will find that the MPAA/RIAA criminals both DDOS your server and spam your ISP with DMCA crap regarding files you are not tracking and never heard of. They really dislike BitTorrent.

      It's because it competes with them. Not as content producers, as distributors. If BitTorrent had a good reputation then indie filmmakers would use it to distribute their films to customers, perhaps as encrypted files with DRM, perhaps not, but in any event in competition with distributing them through official MPAA channels where the big companies get their big cut.

  7. No by arth1 · · Score: 3, Insightful

    No, it won't replace standard downloads, if nothing else because bittorrent is "best effort", and there's no guarantee that the client receives a file within a certain time frame. And for small and medium files, the overhead of BT severely slows down the access.
    Yes, it's useful for large files. No, it's no 100% replacement.

    And that's the beauty of internet in a nutshell -- there isn't one solution that fits all, but lots and lots of tools and standards that can be used and adjusted to the specific needs. So stop looking for The One And Only Way.

  8. Why not? Here are some reasons... by davidwr · · Score: 4, Interesting

    1) because I'm a leech.
    2) because I don't want legal liability FOR DISTRIBUTING if I download a file that unknown to me is illegal, e.g. a software package from overseas that someone inserted illegal-in-my-country pornography into the binary. Yeah, I'll take the risk for possession but not for distribution.
    3) because my employer's lawyer made me say #2 when it comes to company machines.
    4) because I prefer to get my bits from the official location. Yea, I know a checksum should be good enough but I'm old school here.

    Seriously though, I can see torrents overtaking web- and ftp- downloads as the primary method for distributing large, popular files. However, there will always be customers who refuse to share and who refuse to get data from any source that doesn't have a reputation for quality and isn't blessed by the original publisher.

    Oh, and seriously, I'll be fine using torrents to download things like well-known linux distros. I trust modern checksums. I probably won't use them for low-demand files or smaller files though.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  9. Re:Faster? by davidwr · · Score: 3, Insightful

    "...that is able to fully saturate your connection."

    Yeah, like this always happens. Not.

    Scenario: 1st day of release of a new popular file.

    Either the vendor prepares well and works with content-delivery networks so you and everyone else on the planet can download the file while saturating your network, or vendor doesn't.

    If he doesn't, everyone gets throttled and/or some people are told to try again later.

    A torrent option would help distribute the load and cut out the bottleneck.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  10. CDNs are cheap, NAT makes it hard by Chaostrophy · · Score: 3, Interesting

    A start up I know of started out using peer to peer, but it was too much grief to get people to download a plug in, and then get it to set up port forwarding through their firewall, and at the price of CDNs these days, you are just not saving enough money for it to be worth while.

    Now, when we get IPv6, and HTML5, perhaps it will be a different game (no NAT in IPv6, no need).

    In the case of a game, you already have downloaded stuff, and can convince a fair chunk of your users to set it up.

    Twitter uses it to push patches to their servers in 12 seconds instead of 10 min.

    So it is part of the future.

    --
    Plato seems wrong to me today
  11. Faster Speeds? Yeah right... by drsquare · · Score: 4, Informative

    In WoW I have to disable bittorrent if I actually want to download a patch. Otherwise it saturates my connection with upload data whilst only downloading at 1% of my max speed.

    Blizzard use bittorrent simply because they're cheap. Instead of using their millions in profits to provide bandwidth, they make the players smash their quotas sending data to each other. I had to install a bandwidth limiter to get Wrath of the Lich King to install because otherwise the outrageous upload speeds stopped me actually downloading anything. You'd think $15 a month would be enough to pay for enough bandwidth to allow me to download the game I've just paid for, but no they have to chase every penny...

  12. How about a share local option by RichMan · · Score: 3, Interesting

    Most houses have more than one PC. It is stupid that they all separately download the patches from the source.
    How about an option to share patch downloads across a local network.
    Nominate one machine as a master then all the other machines check with the master for their patches.
    The master is responsible for contacting the source.

  13. Re:Only if there's good seeds by talsemgeest · · Score: 4, Informative

    Most modern bittorrent client support web seeds, that is using an http-hosted file as a seed for the torrent. Ad the speed from that server to the other people who are downloading and you have much better speeds than if you were to simply download straight from the server. Add to this all the other bittorrent features, like resuming a broken download, and improved error checking and you have a very powerful downloading strategy. Just take a look at burnbit: http://burnbit.com/ which takes a normal hosted file on the internet and turns it into a torrent. Everyone wins!

  14. Setup and Teardown by The+Raven · · Score: 5, Insightful

    Bittorrent is great for very large files, and popular files.

    But for small files it's really, really bad. Many linux patches involve downloading hundreds of small files, not one big one. Most applications are so small that the setup and teardown time for bittorrent would dwarf the download time. Any download that takes less than 5 will likely have a smoother user experience if it is not done using bittorrent.

    Even ignoring tiny files, there is the issue of bandwidth limited users, the significantly higher routing requirements of bittorrent (many home routers flake out when you get 50+ TCP connections going through them), users with heavily asymmetrical connections (5Mbit down/256kbit up), and the more complicated configuration required to get a good bittorrent connection.

    In short, bittorrent is nice for its niche (large, popular files), but outside that niche it is often not the best solution. Wider deployment of bittorrent technology would probably help some places, but it's not a silver bullet for all Internet downloads.

    --
    "I will trust Google to 'do no evil' until the founders no longer run it." Hello Alphabet.
  15. useful functionality, for those not in the know... by Type44Q · · Score: 5, Interesting
    I've noticed a marvelous use for Bittorrent that I'm not sure everyone knows about, it's especially useful for those with limited bandwidth or download caps:

    Say you've got a CD or DVD that's scratched, or an .iso you spent forever downloading via ftp and discovered to your dismay was corrupted. Assuming a bit-identical image is available online via .torrent, you can 'repair' your data without having to download the whole thing all over again:

    Start your bittorrent app and begin downloading a new copy of the image you need. Immediately stop the download and exit your bittorrent app. An .iso file (incomplete, of course) will have been created in the destination folder.

    Now rip your [damaged] disc to hard drive, creating an [obviously corrupted] .iso. Copy/paste that .iso into bittorrent's download folder, overwriting the existing .iso.

    Fire-up bittorrent and begin your download once again. Bittorrent will analyze the corrupted .iso and immediately download the bits needed to repair (i.e. complete) it. In most cases this will only take a few seconds, even over dial-up, due to the insignificant amount of data usually needed (except, of course, in the event of a heavily scratched disc, which can also take a long time to rip in the first place; having a high-quality optical drive with good firmware and good optics certainly couldn't hurt).

  16. Swarm tracking by Ziekheid · · Score: 3, Interesting

    No thanks. They did some research recently on how easy it is to track users in swarms. As soon as you're in the swarm you can know every other IP transfering those files (depending on tracker usage ofcourse). It's easy to compile a list of IP adresses and the content they downloaded over time.

    I like my privacy and I have no intention to let people know what software I'm downloading.
    And as stated before, it's a security risk too. This doesn't only apply to software updates, it applies to any software that is downloaded.

    For example: there is an outdated version of some application still hosted on the tracker of download.com and I'm someone who knows of a vulnerability in it. I join into the swarm, collect all IP's and eventually just exploit them as I go.
    Hell, I don't even have to scan entire ranges for this application port anymore!

  17. Why would I have to start over? by m.dillon · · Score: 3, Insightful

    Both FTP and HTTP can fetch at offsets other than 0 and ftp at least has been able to do that for well over two decades. I haven't had to start a download over in a long, long time.

    -Matt

  18. Re:Multicast? by Anonymous Coward · · Score: 4, Informative

    Why has no one mentioned this?

    Because multi-cast doesn't work in practice.

    Because almost every gateway router drops multi-cast packets.

    Because multi-cast is only efficient if there is more than one recipient on the same subnet downloading the file at the same time.

    Because synchronizing the assembly of milti-cast downloads that were initiated at different times (as in, 1 second apart) would require as much work as implementing the bittorent protocol.

    Honestly, multi-cast was only really thought out for machines sharing a private network. It wasn't intended for internet-style applications.

  19. Because Firefox's download manager sucks? by Anonymous Coward · · Score: 4, Insightful

    Yeah, but the built in download manager for Firefox sucks. Yes, it *can* resume... if you paused the download first. Even when it's told the file size, if your connection dies in the middle (which my connection too often does), it thinks it's "done" (which is absurd, because wget reports an error code) and you can't resume from within Firefox any more. Oh! I got an RST packet, that must mean that the last 300 MB transferred instantly!

    I gave up on that piece of crap and used an add-on to make Firefox use wget, which at least has the decency to know when files have *actually* been fully downloaded, rather than giving up and deciding it's good enough to hand me a useless half file and no error messages at all. Seriously, have the devs never tested large downloads on a link that dies? It's not even hard to test: you can emulate the connection dying by pulling the damn ethernet cable. It just ignores the error and continues blindly. Does it really think that the other server going silent is an indicator that the file has been fully downloaded, or what?

  20. Customers don't want to give away their bandwidth by amaiman · · Score: 3, Interesting

    One issue is that customers may not want to give away their bandwidth to the companies that they are paying for a service. Game patches are a good example...The player pays a monthly fee for access to the game. That fee should be paying for the bandwidth used to download patches. Why should the customer have to give their upstream bandwidth to other players trying to download the patch? The server load and cost issues for the game company are not his problem. I've encountered several "downloaders" that load themselves into Startup and will proceed to seed the game or patch that you just downloaded indefinitely, stealing your bandwidth. The only way to stop it is to kill the task and manually remove the program that's seeding the content. At the very least, seeding the completed download needs to be opt-in, not opt-out. That would break bittorrent distribution, of course, though, unless there were dedicated seeds. But the source company should be the primary seed, anyway.

  21. Re:Have you factored in the RIAA? by anUnhandledException · · Score: 3, Interesting

    Have you enabled ecryption. MSE (Message Stream Encryption) is standard on most torrent clients however most clients have it disabled by default. In uTorrent I enable MSE and reject all non encrypted packets & requests.

    Using MSE ISP can no longer simply shape based on protocol. Bittorrent uses a random port which makes shaping based on port equally ineffective.