Slashdot Mirror


Completing BitTorrent Decentralization

Njaal writes "With BitTorrent going trackerless, searching for and distributing .torrent files is a natural next step. The Socialized.Net (TSN) is a pure P2P search infrastructure which facilitates P2P searching and distribution of .torrent files. It comes complete with an Azureus (and Firefox) search plugin. TSN is written in Python and is made available under the GPL. Note that this is part of my PhD thesis, and is as such meant as a technology demonstrator."

47 of 236 comments (clear)

  1. Meaning of the disclaimer by LiquidCoooled · · Score: 5, Funny

    Note that this is part of my PhD thesis, and is as such ment as a technology demonstrator

    really means:

    Pleassseeeeeeeeeeeeeeeeeeeeee don't sue my ass.

    --
    liqbase :: faster than paper
    1. Re:Meaning of the disclaimer by Anonymous Coward · · Score: 2, Funny

      I thought it ment, er, meant he didn't use a spell checker.

  2. Re:viva la bittorrent by Anonymous Coward · · Score: 5, Funny

    yay for eveolution. a great product getting better is alwways good news.

    This is not an example of evolution but rather of Intelligent Design. An intelligence is required to implement the irreducibly complex decentralization.

  3. Where did that come from? by Lifewish · · Score: 5, Informative

    Since when does P2P == stealing? Some people use it for copyright infringement, yes, but I regularly use it for downloading linux isos and legal media (Art of the Saber rocks).

    All this means for me is that I can avoid doing too much damage to the hosting servers, which can only be a good thing for underfunded open source projects and the like.

    --
    For the love of God, please learn to spell "ridiculous"!!!
    1. Re:Where did that come from? by DrDribble · · Score: 2, Informative

      The Socialized.Net does not provide any privacy or encryption. What it does provide is a decentralized way to spread and search for .torrent files. This means that when you search for a resource, your computer ask it's friends for them. This is just like you might do when you want an opinon on a used car. You can call a friend who has a similar car, someone who has had cars of the same brand or someone you know that works in a garage.

      It scales wonderfully in the real world, and in theory is now also made available in the digital one. :-) Dr.

      --
      A clever person solves a problem. A wise person avoids it. -- Einstein
  4. Re:tried the search.. by fimbulvetr · · Score: 4, Informative

    Looks like it tries to connect to localhost:8002, seems you need to install the daemon too:)

  5. I tried it, and it said... by Anonymous Coward · · Score: 2, Informative

    "The file isn't a valid Azureus plugin."

    1. Re:I tried it, and it said... by J_Omega · · Score: 2, Insightful

      right... but read the same page where you clicked.

      in bold:
      Sorry about that, unzip the file into your azureus plugin directory, the wizard does not work on this file.

      so, what I did, in Linux was:
      # cd ~/.Azureus/plugins
      # cp /[path to saved]/TorrentSearch.tar.gz .
      # tar xzvf TorrentSearch.tar.gz
      and then restarted Azureus. It is now in the "plugins" menu.

  6. Re:Celebrating the freedom to steal by FidelCatsro · · Score: 4, Insightful

    Its a technoligy designed to facilitate in the distribution of media , if you choose to abuse it then thats your fault .
    Many people do use the technoligy to distribute copyrighted materials , many others use it to distribute GPL software and linux distros (which is how i get all my distros , via bittorent)
    Having a system like this decentralises the network further , which is a brilliant thing as bandwidth is expensive , this will take the load off many networks if it picks up.
    Celebrating the freedom to share is more apt , what you share is up to you (and any consiquences there of).

    --
    The only things certain in war are Propaganda and Death. You can never be sure which is which though
  7. Re:"the other" browser by mrchaotica · · Score: 4, Funny

    What, you mean Konqueror?

    --

    "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

  8. Possibility of mainline integration? by Sv-Manowar · · Score: 4, Insightful

    If this technology works as advertised (and obviously that has yet to be seen) it will only really work by the kind of mass adoption created by inclusion in the standard bittorrent clients. This is how the Azureus distributed database has worked out so well, because of the existing userbase being rolled over seamlessly to its inclusion by default.

    If Azureus or other clients decided to include functionality like this, it would effectively leave programs like eXeem dead in the water and provide BitTorrent users with a closed 'single-stop' solution for finding and downloading files.

  9. 400%Growth in nodes by jzono1 · · Score: 2, Interesting

    400%Growth in nodes known, went from 4 to 18, wonder how many there is i n a hour :) Too bad one has to reboot az/ff to use the plugins tho

  10. Re:P2P is not by mrchaotica · · Score: 4, Insightful

    No, trackerless BitTorrent is legitimate too, because it allows people without the resources to run a tracker upload torrents.

    --

    "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

  11. Has become like ed2k by tepples · · Score: 2, Insightful

    Now that BT has decentralized tracker and decentralized search, it appears that the only remaining advantages over ed2k (e.g. eMule) are the tit-for-tat algorithm and smaller complete block size before one can begin uploading (256 KB for BT vs. 9500 KB for ed2k).

    1. Re:Has become like ed2k by aldoman · · Score: 2, Insightful

      Considering the 'official' ed2k client connects to both 'classic' ed2k servers and overnet he's not badly wrong.

      The difference between BitTorrent and ed2k is quite simple: ed2k has a concept of 'shared folders', BitTorrent doesn't. This means that on ed2k you are sharing your upload between 20-2500 files, on BitTorrent you are just sharing it between how many torrents you have open.

      Also, the software is far more portable and it's open source also. This means it's got a much bigger 'brainshare' with *nix admins who often have 100mbit/sec lines that they can use for sharing from -- compared to the ed2k which has (or at least did when I used it a few years ago) mainly German T-DSL users, which used to be 128kbit. No wonder the speeds sucked so much.

  12. Re:P2P is not by FidelCatsro · · Score: 2, Interesting

    You do , honestly . Trackers and torrent files , whilst small are still a drain on bandwidth that need not exist .
    Many sites and young projects /distros just dont have the money to support a server , or they do have the money and could better use it in other areas.
    It may not seem like much cost to distribute a 50KB file but if you get popular it can add up , then you have alot of other overheads .Removing the necesity for those overheads Removes alot of burdon from the server.

    --
    The only things certain in war are Propaganda and Death. You can never be sure which is which though
  13. Re:clearly, this is positive by johansalk · · Score: 4, Interesting

    "Just a student"?... The guy is doing a PhD; many programmers have not even been in college.

  14. Re:Unstoppable? by Anonymous Coward · · Score: 5, Funny

    This is going to make the MPAA and RIAA angry.

    I bet in retaliation, they'll put out crappy music and movies.

    Oh, wait...

  15. Re:clearly, this is positive by Anonymous Coward · · Score: 3, Funny

    Just call him Doctor Warez.

  16. thats the kind of Phd thesis I like... by Stalyn · · Score: 4, Funny

    one which helps me download pr0n faster.

    --
    The best education consists in immunizing people against systematic attempts at education. - Paul Feyerabend
  17. What is BitTorrent now? by iammaxus · · Score: 4, Interesting

    Trackerless torrents and search technologies like this seems to be changing BitTorrent into a conventional p2p system. Can anyone explain the diffrence? Is it just a regular p2p system with a highly efficient segmented downloading system?

    1. Re:What is BitTorrent now? by shutdown+-p+now · · Score: 2, Informative

      The difference in this case being all that trackless stuff for BT is optional. You can still run a tracker, and provide the .torrent file on your Web server.

    2. Re:What is BitTorrent now? by Daedalon · · Score: 5, Informative

      There are quite a lot of differences in the three major P2P technologies. Here I try to cover the most important of each:

      ed2k (eMule)

      • + Easy linking. Links can be shared anywhere: in web pages, IRC, email. The single 100-200 character link contains everything that is needed to download the file.
      • + Supports usage with and without a server (in eMule, ed2k server and serverless Kademlia)
      • - If you run a server, you can't make it private
      • - If you run a server, you cannot control what is shared there
      • - Inefficient, seems to waste bandwidth

      Direct Connect (DC++, Reverse Connect)

      • + You can run servers (hubs) private
      • + You can see what everyone is sharing in your hub
      • + Using eMule-like links has recently become available, though clicking a link doesn't add the file in your queue, it only allows you to search for it
      • + Efficient, you can download directly from someone very fast, even through intranet
      • - No serverless mode
      • - You don't have total control on what is shared in your server
      • - Only in Reverse Connect you can download from multiple sources simultaneously

      BitTorrent (Azureus, BitComet)

      • + The most efficient p2p yet
      • + Server (tracker) admin can have total control of what is shared choosing a directory where he uploads allowed torrents
      • + A single .torrent file can contain instructions on how to download multiple files
      • - No serverless mode
      • - No searching
      • - To share download instructions for a file(set), you have to be able to transfer a .torrent file, a plaintext link isn't enough

      This has been the situation for a while. In ed2k nothing big has changed for a year. DC++ (incl. Reverse Connect) is evolving, but magnet (TTH) linking has been the only major change in years. When DC++ gets its support for ADC complete, the evolution of Direct Connect is predicted to get a major boost.

      What trackerless BitTorrent does is to make every client a small tracker. So it doesn't just enable searching and serverless usage, it also makes sharing illegal files easier (more than it does for legal). Previously, to share content, you had to find a tracker that allows posting .torrents. To share copyrighted content, you also had to find a tracker that didn't care about legal aspects. So sharing legal and illegal content is now equally easy, while it previously was (at least in theory) a little bit easier to share legal content.

      Overall, the changes of trackerless BitTorrent would still make it the best available p2p techonology. For certain special cases, Direct Connect could be better, and both DC and ed2k support easier linking than BT, but even that can change in the future: BT could implement a meta-p2p engine, so that you could share plaintext links that make your client download the right .torrent file and add it to your queue. This would make BT superior to eMule in every aspect.

    3. Re:What is BitTorrent now? by assassinator42 · · Score: 3, Informative

      "BT could implement a meta-p2p engine, so that you could share plaintext links that make your client download the right .torrent file and add it to your queue. This would make BT superior to eMule in every aspect." The latest Azureus already has that (magnet links). For example, try magnet:?xt=urn:btih:GCT5DYD6RADW6TY2ICW54UZDXB6OPC XD

  18. Re:Unstoppable? by nedder · · Score: 3, Insightful
    At some point they're just going to request that the internet be

    1) handed over to them

    2) shutdown completely

    3) taxed at 95% for any useage (no matter how irrelevant to music/movies)

  19. Re:P2P is not by Joe+Random · · Score: 2, Insightful
    For legitimate P2P (e.g. downloading FC) you don't need all this.
    Trackerless BitTorrent allows you to download legitimate free content even if the distributor's tracker happens to go down (for instance, when someone posts a link to the tracker on slashdot, and their server spontaneously combusts). Sure, you don't need trackerless BT, but then again, you don't need BT at all.

    The bottom line is that adding a distributed tracker both offloads even more bandwidth from the servers -- which is the whole point of using BitTorrent in the first place -- as well as eliminates the system's main weakness (e.g. removing content, legitimate or otherwise, from distribution by taking down a single computer).
  20. Re:viva la bittorrent by name773 · · Score: 2, Interesting

    as funny as that is, if you think about it, the program was intelligently designed. perhaps improve is a better word in this case than evolve

  21. Azureus install by Kahless2k · · Score: 2, Interesting

    Anyone else having trouble installing the azureus install?

    Kahless2k

  22. Defining feature of P2P by Anonymous Coward · · Score: 5, Insightful

    It is worth noting that every P2P software distributor sued by the RIAA has used built-in searching. Built-in searching is really the big thing that separates the internet from what people commonly call peer-to-peer networks (even though the internet is itself a P2P network).

    With the conventional internet, you were stuck using a centralized search engine which is easy to censor. To censor a network with built-in searching, you have to censor the whole network.

    1. Re:Defining feature of P2P by Breakfast+Pants · · Score: 4, Informative

      The only one they successfully sued in court (i.e. didn't settle with) used centralized searching (Napster), so I don't quite see what you mean by every P2P software distributor sued by the RIAA has used built-in searching.

      --

      --

      WHO ATE MY BREAKFAST PANTS?
  23. Already there! by kebes · · Score: 3, Informative

    On google, do a search like:
    "whatever filetype:torrent"

    and you'll get links to torrents. Of course, a torrent-specific search could be more optimized than that, but even this often gets you what you want.

  24. Re:Celebrating the freedom to steal by Travelsonic · · Score: 2, Informative
    Sorry, I can't call it anything else, even if it's a PhD thesis.

    So what you are saying is celebrating any form of advancement of file-sharing technologies == "encourageing theft" (or since what we are arguing over involves copying, copyright infringement? Did I read this correctly, or not, and if not, please clear things up.


    Sure, you can argue that copyright infringement is not theft...

    Argue? It has been clearly been legally established in 1985, and several times in the past decade that copyright infringement, as illegal as it is, is copyright infringement and nothing else. Philosophically it has also been argued against calling copyright infringement anything other than that as well, but that I will leave to open interpretation.


    ]
    ...but then don't call people who abuse GPL software "thieves".

    People who do lable GPL violators "theives" when also making the statement that copyright infringement is not theft in other posts, well, they are hypocrites.


    --
    If you believe in privacy, and believe you have "nothing to hide" at the same time, you're a goddammed idiot
  25. Re:Celebrating the freedom to steal by a+whoabot · · Score: 3, Informative

    "If you'd learn some synonyms..."

    Or, instead of learning, he could call it those by copying and pasting straight from reference.com like you did?

  26. This will kill Bittorrent by herve661 · · Score: 2, Interesting

    Ever wondered why is bittorrent faster than other P2P networks like eDonkey or overnet? This is because there is no built-in decentralized search engine. Users have to download one of the files that are available to them, and consequently more people download the same file at a certain time. The result is that you get the files faster.

    1. Re:This will kill Bittorrent by dizzydogg · · Score: 5, Informative

      Bittorent is designed for a massive swarm of people all downloading the same file at the same time. It won't die under these circumstances, it will thrive. The more people you have downloading the file, the more people are sharing the file. The reason bittorent is faster is because it forces you to share with others, and doesnt allow you to get away with not sharing the file like many p2p programs, where many people with "slow" connections or a cap on their monthly bandwidth turn off their uploads. Thats why so many people download off one guy with other p2p programs, because the file is never shared by so many people who dowload it, the few people who are sharing their copy's queue is swamped.

      It's all because of bittorents tit for tat system, where if the seeders are swamped, you'll usualy get your upload speed returned to you from the other peers you are downloading with. If you upload at 5k/s, you download at 5k/s,but if you can do 30k/s you usualy get 30k/s. You swap the pieces you have for pieces your missing with the other downloaders. Your client remembers the people who traded with it succesfully and tries to make further trades with these people since your client can confirm that they are uploading, and thus you will get something in return. Meanwhile the seeders are feeding the rarest pieces to the people it sees as the ones who upload the most to others, and they swap with others and so on, until everyone has a complete copy.

  27. Meta data search? by bobbuck · · Score: 2, Interesting
    Do any of these P2P systems allow a better description of the shared resource than the filename? It would be great if there was a description file or database for the shared resources. That way you could search for certain filetypes, versions, sources, licenses, etc. and be able to get a real description of the file before you download. If P2P grows beyond mp3's this will quickly become a nessecity.

    P2P could even replace things like classified ads or directories. Share a picture of your car with tags set appropriately and anybody can search for it.

  28. Re:P2P != Stealing by N1KO · · Score: 2

    Porn is (usually) copyrighted.

  29. No more webhosting! by logicnazi · · Score: 2, Insightful

    Well perhaps not quite. However, this is where web technology is headed.

    While one benefit of P2P is psuedo-anonymous file hosting. That is if I wish to spread some information I need not set up a webserver and be easily traceable (ideally once everything goes trackerless). Another one is the fact that the consumers of information can provide the bandwidth for the resources they consume.

    The benefits for open sourceesque projects cannot be underestimated. Running community sites like wikipedia is very difficult as they need to pay for lots of bandwidth and server space. A well designed P2P system would turn every user of a resource into a partial server. This means it is no more expensive to provide information a million people want than to provide information 10 people want.

    Of course some issues such as file ownership permissions need to be dealt with. However, this is exactly the sort of technology that is needed to realize the great leveling capacity of the internet and turn non-profit groups and individuals into just as important media distribution entities as major corporations.

    I fully expect this to change the world.

    --

    If you liked this thought maybe you would find my blog nice too:

  30. Re:Google? by natrius · · Score: 3, Interesting

    Given that, how long could it be before google has a specialized .torrent search?

    Like this?

  31. A Different Solution by 26199 · · Score: 2, Interesting

    Port advertising instead of service advertising.

    I haven't come across this idea elsewhere, so, please let me know if you actually do it ;)... I would if I had a server handy, it's an easy project.

    One centralised server can be used as a central tracker for P2P, or anything else, with no legal implications. The idea is simple. Your server doesn't advertise services, it advertises open ports.

    Let's say my awesome new p2p program uses port 23145. On starting up, it sends a packet to central server saying "my port 23145 is open". When someone else asks the server for someone with port 23145 open, there's a chance they get my IP address in return. When I have enough connections, I send a packet asking that I be delisted.

    Obviously there need to be controls against spoofing, etc, but the application is so simple that these are pretty easy to do.

    Because the central server stores nothing more than IP/port pairs (plus timing and security stuff), there is complete deniability. You have no way to tell which program people are running, either on the server or the client. And you never see any application data whatsoever. It's just as useful for legitimate apps as for legally difficult stuff.

    Problem solved. Any program can find other instances of the same program without nasty legal questions being raised. Admittedly they'll have to check the identity of the other program on connection, but they should be doing that anyway...

  32. Re:P2P is not by logicnazi · · Score: 2, Insightful

    While I agree that currently the only substantial use for trackerless P2P is IP theft. Sure it helps people a little because when they are getting their linux ISOs they don't need to worry if the server goes down. Realistically though for any popular download it isn't too hard to find a server to host the tracker which is pretty reliable.

    However, there apparently isn't any lack of trackers for ilegal content. On the other hand the potential uses of trackerless P2P for legal purposes are huge. We just don't see these applications yet because we don't yet have working trackerless P2P. Dismissing trackerless P2P as only being good for illicit activity before we see what develops is the same error as dismissing the VCR as only useful for illegal copying because the media companies couldn't predict the rise of video sales.

    Truly trackerless P2P completely changes the game. At the moment P2P offers few benefits besides a certain degree of anonymity so it is mostly used for people who want to share mp3s but wouldn't put them up on their webserver. If P2P goes trackerless if can REPLACE your webserver. Rather than posting your media to a website or single server you can post it directly to the P2P network.

    The potential applications are huge. Home users who don't have or want websites can easily use such a system to share files without worrying about keeping their computer always on. Popular, legal but socially akward material can be easily hosted. Right now if I want to share my pornographic home movies I either need to pay money to an ISP which allows porno (most wont and I face the danger of huge bandwidth fees) or keep my computer always on to run a tracker.

    In the future if some form of file ownership/change could be implemented P2P could replace webhosting. Imagine if sites like wikipedia could be started up without needing a foundation to pay for bandwidth because everyone who uses it contributes some of their bandwidth. This would finally realize the true potential of the web as equalizing sources of media.

    --

    If you liked this thought maybe you would find my blog nice too:

  33. Re:viva la bittorrent by JasontheMason · · Score: 2

    Welcome to Slashdot, where polite, factually correct posts are modded +5 Funny.

    --
    "Ad infinitem et ultra!" - Buzz Lightyear
  34. Comment removed by account_deleted · · Score: 2, Interesting

    Comment removed based on user account deletion

  35. Of course this is evolution! by Tatarize · · Score: 2, Interesting

    >>This is not an example of evolution but rather of Intelligent Design. An intelligence is required to implement the irreducibly complex decentralization.

    Nonsense. This is quite obviously a form of evolution.

    First off, we get IRC. It wasn't well known by the public and searching was quite difficult for the masses.

    Next, we get Napster. It was a good server, with huge increases in fitness due to searching, but it was too centralized (even more so than IRC). The main servers got killed with lawsuits and it died.

    Next we got Morpheus, which started because of the success of Napster (and to fill the niche left by Napster's extinction), which was more decentralized and used Kazaa's network. And included file searches for non-MP3 files. Kazaa killed it off because they were greedy, and owned the core part of the network.

    Kazaa was far enough away from the courts that they lived longer. However a series of lawsuits against users and the general peer to peer operation made it less fit.

    Bittorrent came out with the primary advantage of the uploading while download protocol set. Which also added a more decentralized aspect to the peer-to-peer paradigm. It constituted a huge leap in fitness.

    Bittorrent however is still based on trackers and torrent files. It needs a centralized location to start. These centralized locations are easy prey for predators such as MPAA and RIAA.

    This addition, frees that restriction. Improving the overall fitness of the product by increasing it's decentralization which reduces predation from anti-piracy services.

    Now, if, for example, back in 1998 decentralized Bittorrent networks showed up out of the blue. This would be a sign of intelligent design. No trial or error and it appeared fully formed. But, still not irreducibly complex. Each step towards decentralization adds fitness to the product. A slight increase (of decentralization) still yields an increase in fitness, which is all that is required for evolution.

    Overall, it is true that the program was designed and implemented by intelligent people. But, this is just the nature of programs. If it is a good idea it should have more fitness and do well, if it is a poor idea it gets sent off to Limewire limbo. This is the product of evolution.

    --

    It is no longer uncommon to be uncommon.
    1. Re:Of course this is evolution! by Tatarize · · Score: 2, Funny

      But where are the transitional forms? There is a missing link between IRC and Napster!

      Okay, you got me there. The programs are great examples of macroevolution, but on the micro-scale it's all ID.

      In the absense of reliable radio-carbon...dating

      This is just science fiction. I mean, do you know what kind of geeks write this stuff? They would be lucky to date anything. Carbon-dating by phone, internet or radio is pretty well out of the question.

      of file sharing technology, one must presume both originated from some intelligent designer at around the same time.

      Evolution does not concern itself itself with the original genesis of the things in question. Only how it changes over time based on fitness.

      But, if you must know. Sir Tim Berners-Lee gets some major credit, but also some of the very early packet switching technology inventers back in the Cold War era. And some more goes to Shannon's information theory. And even the inventer of the telegraph. Perhaps written language itself... *scratches head*... Evolution does not concern itself with the original genesis of the things in question!

      --

      It is no longer uncommon to be uncommon.
  36. Re:Not so by petermgreen · · Score: 2, Informative

    seeds/finished downloaders don't/can't engage in tit for tat and so will give you as much as they can.

    so it seems likely that in your case you were simply getting data from a seed/finished downloader when your rate spiked like that.

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
  37. Re:tried the search.. by DrDribble · · Score: 2, Informative

    The daemon runs on your local computer. Port 8002 is the web interface. So, if you cannot reach your own computer on port 8002, your daemon is not running. :-)

    Dr.

    --
    A clever person solves a problem. A wise person avoids it. -- Einstein