Slashdot Mirror


Trackerless BitTorrent Beta Posted

jgarzik writes "BitTorrent development is occuring at a furious pace. At the beginning of May, an Azureus update added distributed tracker and database features. Yesterday, Bram updated BitTorrent to include support for trackerless torrents in the new BitTorrent 4.10 beta."

29 of 432 comments (clear)

  1. So... by Anonymous Coward · · Score: 5, Insightful

    Will this eventually leave the BSA and others with no BT tracker sites to shut down, so that their only option will be to go after end users or to DOS the P2P networks themselves?

    1. Re:So... by saskboy · · Score: 5, Informative

      Essentially, the client is now also a simple tracker. You still need a torrent file, you just don't have to set up a tracker now, just open your client, like you'd normally do for Kazaa or other file sharing programs.

      Here is the bittorrent.com explanation:

      ***
      BitTorrent Goes Trackerless: Publishing with BitTorrent gets easier!

      As part of our ongoing efforts to make publishing files on the Web painless and disruptively cheap, BitTorrent has released a 'trackerless' version of BitTorrent in a new release.

      Suppose you bought a television station, you could broadcast your progamming to everyone in a 50 mile radius. Now suppose the population of your town tripled. How much more does it cost you to broadcast to 3 times as many people? Nothing. The same is not true of the Web. If you own a website and you publish your latest video on it, as popularity increases, so does your bandwidth bill! Sometimes by a lot! However, thanks to BitTorrent the website owner gets almost near-broadcast economics on the web by harnessing the unused upstream bandwidth of his/her users.

      In prior versions of BitTorrent, publishing was a 3 step process. You would:

      1. Create a ".torrent" file -- a summary of your file which you can put on your blog or website
      2. Create a "tracker" for that file on your webserver so that your downloaders can find each other
      3. Create a "seed" copy of your download so that your first downloader has a place to download from

      Many of you have blogs and websites, but dont have the resources to set up a tracker. In the new version, we've created an optional 'trackerless' method of publication. Anyone with a website and an Internet connection can host a BitTorrent download!

      While it is called trackerless, in practice it makes every client a lightweight tracker. A clever protocol, based on a Kademlia distributed hash table or "DHT", allows clients to efficiently store and retrieve contact information for peers in a torrent.

      When generating a torrent, you can choose to utilize the trackerless system or a traditional dedicated tracker. A dedicated tracker allows you to collect statistics about downloads and gives you a measure of control over the reliability of downloads. The trackerless system makes no guarantees to reliability but requires no resources of the publisher. The trackerless system is not consulted when downloading a traditionally tracked torrent.

      Although still in Beta release, the trackerless version of BitTorrent, and the latest production version are available at http://www.bittorrent.com/

      --
      Saskboy's blog is good. 9 out of 10 dentists agree.
    2. Re:So... by Cramer · · Score: 5, Interesting

      If he's doing things exactly like Azureus, then a torrent file can be retrieved from anyone known via DHT to be part of that swarm... it's called a magnet url.

      This is the reason why DHT, as the monkeys released it, is a Bad Thing(tm). They should've err'd on the side of caution and assumed torrents were "private" unless explicitly marked otherwise. Because they added the "private" flag to the info dictionary, sites cannot retroactively privatize their torrents -- it changes the info_hash, which is the exact reason why the monkeys put it there (where it technically doesn't belong.)

  2. Whatcha gonna do when they come for you? by autophile · · Score: 5, Funny

    See you in Guantanamo, "Bram".

    --
    Towards the Singularity.
  3. Damn it! by Anonymous Coward · · Score: 5, Funny

    I hate it when I squeeze harder and things start to slip through my fingers.

    1. Re:Damn it! by Anonymous Coward · · Score: 5, Funny

      Don't be too proud of this technological terror you've constructed. The ability to subpoena a teenager is insignificant next to the power of the MPAA.

  4. Hmm... by conchobar0928 · · Score: 5, Funny

    Is it just a coincidence that this enhancement has come the day before the new Star Wars movie?

    1. Re:Hmm... by ErikTheRed · · Score: 5, Funny
      Is it just a coincidence that this enhancement has come the day before the new Star Wars movie?
      I sense a great disturbance in the force... as if George Lucas' bank account cried out in terror... and then... silence.

      Either that, or I just have a headache.
      --

      Help save the critically endangered Blue Iguana
    2. Re:Hmm... by Cramer · · Score: 5, Interesting

      I wouldn't touch that with a 50ft pole. My money says that swarm is being monitored for the next round of John Doe lawsuits. (esp. with the recently inacted laws.)

      (all you have to do is join the swarm and sit back and log all the IPs reported by the tracker and from all the inbound connections.)

  5. Diluting its strengths? by Neoncow · · Score: 5, Interesting
    I thought the advantage of BT was the strength in large numbers approach? As more people join the swarm, there is more excess bandwidth. And the overall speed increases, right?

    If you lower the cost of entry to producing a BT release, won't that mean more .torrent file swimming around? With the increase of different torrents everywhere, won't that dilute the power of BT?

    Is it legal to post only in questions?

    1. Re:Diluting its strengths? by Jeremi · · Score: 5, Informative
      If you lower the cost of entry to producing a BT release, won't that mean more .torrent file swimming around?


      Hopefully... allowing more people to post more content is one of the project's goals.


      With the increase of different torrents everywhere, won't that dilute the power of BT?


      No, because the uploaders for a given file consist only of the people who have previously downloaded that file. So no matter how many files are "out there", the total bandwidth available to distribute any particular file is always proportional to the number of people interested in that file.


      File-A's popularity won't leech bandwidth from File-B's swarm, because File-B's swarm wasn't providing any bandwidth for File-A in the first place.

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
  6. If this technology takes off by KarmaOverDogma · · Score: 5, Interesting

    I think we'll see two things:

    1) **AA will squirm for a while
    2) **AA will work harder than before to moniyor and restrict user rights on the internet, via congressional purchasesing, er, I mean lobbying.

    I think #2 will ultimately be futile in that it will not slow their loss of control over media content distribution (and copyright violation) but it will make life unpleasant for many...

    --
    uR iGn0ranc3, Their Power
  7. Re:How by blixel · · Score: 5, Funny

    how can you connect to a torrent download if you don't know where to start? Isn't the starting point the same as a tracker?

    There's an A-end and a B-end seperated by some amount of time. Say 1 minute. At the A-end, you start your search for the torrent. The search continues for 60 seconds until the torrent is found at the B-end. The torrent data is then loaded at the B-end which is picked back up at the A-end 60 seconds prior. From your perspective, it happens instantly.

    The searches are also modular in design. So you can actually include a second search at the B-end. So at the A-end, you might actually get back a second result for something you didn't even know you searched for.

    Don't worry about the noise in the attic. It's just birds.

  8. Not linux but CC licensed movies by Anonymous Coward · · Score: 5, Insightful

    Plenty of geeks with big pipes to host trackers for linux releases...

    But lets say your band releases an album online, or your movie club makes a film... You've only got a geocities website and the desktops of your members.. With tracker-based BT you had to talk someone into running a tracker for you... With tracker-less that limitation has been removed.

  9. Cat and mouse at it's best by btk667 · · Score: 5, Interesting

    This is realy the cat and mouse game at it's best. BitTorrent is getting better each day. While the RIAA and MPAA is closing the hosting website, Attacking ISP from around the globe, etc.

    Is this a combat to the death ?

    I guess nothing will beat private exchange ? (DRM)

  10. Won't stop the RIAA/MPAA by Saeger · · Score: 5, Insightful
    Simply because the torrent websites no longer have to host the .torrent files, or run the tracker, doesn't mean that the RIAA/MPAA can't still sue the domain owner(s) for technically offering pointers to pointers (unless you're untouchable in, say, the netherlands). So BT is now a little more distributed, like eDonkey, but that didn't stop ShareReactor, ShareConnector, or FileNexus from being shutdown either.

    What's needed is some kind of distributed HTTP overnet that works; that can handle dynamic content semi-intelligently, and MUCH faster than freenet/frost sites.

    --
    Power to the Peaceful
    1. Re:Won't stop the RIAA/MPAA by gricholson75 · · Score: 5, Interesting

      What's needed is some kind of distributed HTTP overnet that works; that can handle dynamic content semi-intelligently, and MUCH faster than freenet/frost sites.

      Something like i2p?

  11. Since TFA is a bit short on details... by 42forty-two42 · · Score: 5, Informative
    ... here's some more info on this, assuming it's compatible with Azureus:
    • Peers are located with an overlay network based on the Kademlia algorithm, with small tweaks.
    • You can enter the overlay network either by a central seed node (which is needed only one per install) or by asking some of your peers on some other torrent for their DHT addresses.
    • Azureus has a magnet link system, where given a 'magnet link' containing the infohash of the torrent, it will use the DHT to find a peer and download the .torrent file from them. Hopefully the official client will get this as well.
    • Yes, this really does work. Grab a copy of Azureus 2.3.0.0 and enter magnet:?xt=urn:btih:MC2ZPC2TCW2TJTY5DSSOMDX533EPXV FU (no spaces!) into the open location box to try it out. Be sure to wait for the dot on the bottom to change from yellow/"Initializing..." to green, and open your UDP port (same as torrent data port by default)
    • Check out the Azureus wiki for more info.
    1. Re:Since TFA is a bit short on details... by 42forty-two42 · · Score: 5, Interesting

      Update: it seems bt mainline uses khashmir instead of the azureus protocol. This is a bad thing. If this reaches a release, we'll have a case where two bittorrent clients are truly incompatible, and the result may cause difficulties for the technology itself.

  12. Damn it! K-Why? by Anonymous Coward · · Score: 5, Funny

    "I hate it when I squeeze harder and things start to slip through my fingers."

    Let's leave your sex life out of this.

  13. Re:How by Skynyrd · · Score: 5, Insightful

    This doesn't seem to accomplish much in the way of providing anonymity if everyone in the swarm still had to go through the same starting node somewhere.

    I don't think the idea was to make an anonymous torrent; I think it was to make it easier for bloggers and websire owners to post a .torrent file without having to connect to a tracker (which you may not hae access to).

    Joe Six Pack wih webhosting can now post a .torrent without needing a tracker.

  14. Re:no bittorrent download upgrade option? by Anonymous Coward · · Score: 5, Insightful

    It's the classic question. How do you make "make"? How do you untar "tar"? How do you decompress "gzip"? How do you compile "gcc"?

    The answer in all cases is to work around the problem by not storing the code in the format it supports. eg: make comes with a shell script to build the binary. gzip is distributed in .Z and non-compressed forms, as well as a shar file. tar is distributed as a shar file. etc. etc. etc.

    BitTorrent isn't all that large, so there isn't much to be gained by distributing it that way. It's best at file packages in the multi-hundred megabyte and larger range. The largest BT download is only around 1 MB ...

  15. Re:wryy by Spy+Hunter · · Score: 5, Insightful
    Actually, it should eliminate the scaling problems that BitTorrent currently has. Popular trackers require large amounts of bandwidth and also large amounts of RAM and processing power. BitTorrent could theoretically scale infinitely, but trackers hold it back. Trackerless BitTorrent could completely eliminate this serious problem. Now hosting a BitTorrent download is just as simple as hosting an HTTP one, and it could likely scale to millions of simultaneous downloaders (far more than possible with a tracker) with *zero* consequences for the file's original host.

    OTOH, the lack of centralized control means that trackerless BT will likely be vulnerable to a new class of attacks that could make it possible to disrupt the download of a file you don't like. So, ironically, warez groups might stick to running trackers for attack resistance and Linux providers might move to trackerless for the scalability. It all depends on how scalable and attack-resistant trackerless downloads turn out to be.

    --
    main(c,r){for(r=32;r;) printf(++c>31?c=!r--,"\n":c<r?" ":~c&r?" `":" #");}
  16. Re:How by shadowmatter · · Score: 5, Informative

    This is how Kademlia works:

    Nodes randomly generate either 128 or 160 bit node identifiers. An identifier uniquely identifies a node on the network. Traditionally, they are computed as just the MD5 or SHA-1 hash of your IP address (this is to make it harder for clients to select exactly what identifier they want, which could help them target certain files for takedown... more on that later).

    In Kademlia, the idea is that messages routed through the network are identified by a message key. This is, as well, either a 128 or 160 bit value. The goal of Kademlia, and every other DHT (Google for Chord, CAN, Pastry, etc.) is to route a message to the node whose identifier is "closest" to the message key. In Kademlia, the distance between a node identifier and another node identifier, or a node identifier and a message key, is computed by simply XORing the two and treating the result as an unsigned integer.

    Each node maintains (roughly) a routing table containing nodes that match successively-longer high order bits with itself. For example, node 0100... maintains an entry to a node starting with 1..., a node starting with 00..., a node starting with 011..., and a node starting with 0101... Note that in terms of distance by XOR, the first node has a distance of 1..., the second with a distance of 01..., and so forth. Thus, nodes matching more high order bits are closer to you in the identifier space.

    So if you are node 1010... and you receive a message starting with 0111... You should have some node in your routing table that differs in the highest-order bit, that is, it starts with 0... Say its node identifier starts with 0000. You route the message to that node. If you compute the XOR between your node identifier and the key, and this node's identifier and the key, you will see that this node is approximately twice as close to the key as you are.

    Now this node differs in the second bit: 0000 vs 0111. In its routing table, it must have some node that matches in the first bit, and differs in the second: that is, starting with 01... If the message is routed to that node, we again cut our distance to the key by approximately 1/2. This process repeats until we find the node "closest" to the message key.

    Routing in this manner takes log(N) time, and each node on the network maintains log(N) connectivity. Note that there are well-established algorithms for nodes joining and leaving the network, of which the former takes log(N) time as well.

    So how does BitTorrent fit in? Here's what I'm assuming: Each .torrent file has a 160-bit info hash embedded in it, derived from SHA-1. Now substitute the message above for the .torrent file, and the message key for this info hash -- you are now routing .torrent files to their closest nodes. These nodes, in turn, can be the tracker. If a node knows the 160-bit info hash of a .torrent, it can find a tracker by placing this hash as the message key in a lookup message and finding the closest node, which must necessarily be the tracker.

    You can do other neat tricks, too, like keyword searching, load balancing, and whatnot (see eMule -- it uses the Kademlia DHT for its serverless system). Other DHTs work in a similar manner. I'm a little confused as to why everyone uses Kademlia, when there are better ones out there. (Accordian, for example, is truly state-of-the-art.)

    Plenty of resources on DHTs can be found at Project Iris.

    - shadowmatter

  17. How the new Trackerless Protocol works by Anonymous Coward · · Score: 5, Funny

    The new Bittorrent protocol was designed by the same developers who designed the original TCP/IP protocol in the 70s. But this new protocol has a decidedly "edgy" feel to it. Below is the "handshaking" procedure. There are a few similarities between it and SMTP:

    client1: gimme the warez
    client2: who's askin'?
    client1: me, mutherfucka
    client2: well, your story checks out - here's da shit.

    I know what you're thinking - how will they handle flow control? The trackerless developers also thought of that:

    client1: the shit's comin' slow - speed it up
    client2: get off my back, bitch
    client1: don't make me bust a cap in yo' ass!
    client2: all aight, all aight... sheee-it.

  18. Re:So...Idle Hands are... by Jeremi · · Score: 5, Funny
    It's like the VCR, guns, or deep fryers. They can all be used for good or for evil.


    Hmm. How does one use a deep fryer for evil? Open a KFC?

    --


    I don't care if it's 90,000 hectares. That lake was not my doing.
  19. Right. This only solves part of the problem by Anonymous Coward · · Score: 5, Insightful
    By distributing the tracking, this helps to minimize the damage should the original publisher go off-line. This does absolutely nothing for hiding your IP address.

    The *AA can still nail you for being a distributor of unauthorized Copyrighted material if you use Bittorrent. You are of course giving out copies to other users; so all the *AA needs is a list of IP addresses that are in the swarm. Granted, the *AA hasn't really done this. But if there's one thing that they have shown is that they are extremely motivated to find people who are involved, and hit them with a bill for a $2-3K settlement.

    With an economic bounty like that, the only thing the Lawyers of the *AA are lacking is a way to automate the technology. From what I hear, that technology is coming. Supposedly some of it is in beta test now.

    The only defense one might hope for in the U.S. is a scheme which added plausible deniability. That's not here yet with BT; and even if implemented, would undoubtedly result in a slowdown of downloads.

    Personally, I think your best bet if you are concerned is to use an offshore ISP.

  20. Re:So...Idle Hands are... by Maxo-Texas · · Score: 5, Interesting

    Well, I've done habitat for humanity too.

    A week in 96 degree sun building houses for the homeless.

    AND I also like BT.

    I agree the artists need some money to keep working. I disagree that they won't write or create new art unless they get millions of dollars. I really disagree that the middlemen who do nothing that can't be replaced by BT should get rich. I donate money to artists (via magnatune among others) where I know the artists are actually going to see a majority of the money and I've established that I like the art.

    I also try some stuff, don't pay for it, don't bother to delete it but never listen to it again.

    There is now more quality songs/art/tv shows/movies than I could watch/listen to if I spent every day from waking to sleeping consuming it. Only monopolies are holding up the prices- but the glut is coming and prices will drop.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  21. Re:So...Idle Hands are... by Council · · Score: 5, Insightful

    This drives me fucking nuts.

    Y is an activity that saves lives, such as buying vaccines. X is a frivolous activity such as buying a DVD. People don't live their lives choosing Y instead of X every time because you end up with no life of your own.

    And you only whine about it when X happens to be something that reminds you of the need for Y, or when Y suddenly occurs to you and you want to make a point. But every single time you buy a goddamn DVD, you're choosing X over Y. That's how life works. Every cheap novel you buy is a child who dies because you didn't spend the time to go out, find her, and help her. Come to terms with this before you start tossing it out as a random argument against a given X.

    And why does Bittorrent even remind you about the need for charities? I mean, you've got a strange set of connectiosn going. I mean, pointless artwork in Central Park, sure, but why on Earth do you jump on a random technical project like this?

    (Score:-1, Flamebait)

    Oh, right. Some people. So there's a 50/50 chance you're flamebaiting or that you've just got a weird set of things that trigger thoughts of Y for you. Either way, spend some time thinking about these issues; it'll do you good. Maybe think about the kids dying as you sit there. Think about that each time you speak with righteous indignation about what people should be spending their time on. I'm not even telling you not to say what you're saying. I'm just saying give it some thought.

    $10 can buy vaccines to absolutely save someone's life. With what rationale are you buying a DVD with that $10? I know why I do it. Do you?

    --
    xkcd.com - a webcomic of mathematics, love, and language.