Slashdot Mirror
Interview Responses From BitTorrent's Bram Cohen
1) Bit-Torrent browsing... by CashCarSTAR
Has any effort/thought been put towards bit torrent page distribution?
Specifically, a way that one can use BT to mirror webpages. A way to get around the /. effect, and as well would work wonders the next emergency that comes out (see 9/11).
Bram:
Images in web pages are very small and require very low latency. BitTorrent is designed for much larger files, which download on the order of minutes or hours rather than seconds. BitTorrent uses the significant amount of time those downloads take to try out and compare different connections. This process has inherent latencies which make it unsuitable for images on web pages.
Certainly it would beis possible on paper to dramatically reduce the cost of hosting an ordinary web site using peer transfers, but the logistical problems of handling many small files at low latency have yet to be solved, and will probably require a protocol which looks significantly different from BitTorrent.
2) Forward successful download stats to originators... by gsfprez
Many freeware/shareware folks like to keep download stats for marketing purposes, so P2P software and mirrors really irk them....
In order to foster more love from freeware/shareware distributors, could BitTorrent be made to inform the end user (me) that BitTorrent was going to send a "notice of download" (not including any personal information, such as an IP, etc) upon sucessful download (that I could preview before sending of course)?
If *I* was Warner Bros, and eveyone offered to distribute and pay for all the bandwidth for the next version of the Animatrix, while I still got to see download statistics, i'm not sure I'd even would need to provide a direct link to the 150 meg QuickTime files.
With this kind of feedback mechanism, the software/media providers get all the love - download stats, far far far less bandwidth used - and we get all the goodness - their free movies, software, freeware, data, etc. Its the ultimate mirror.
Or am i missing something?
Bram:
I'm happy to report that you are, in fact, missing something. Clients report very detailed statistics to the BitTorrent tracker, including the number of complete downloads and the total amount each peer uploaded and downloaded. If you host a file using your own tracker, all of this data is readily accessible, the same as if you hosted it via http.
By the way, many people find out about tracker statistics reporting and falsely think that hacking their client to exaggerate their upload rate will increase download speeds. Clients actually decide who to upload to based strictly on the transfer rates they experience directly; Tracker statistics are never even sent to them.
3) Comparison to other P2P... by jfmiller
As far as I can tell the genius of BitTorrent is allowing peers who themselves do not yet have a complete file to share the parts they do. With all dew respect to the effort taken, the rest is just functional glue that allows the system to work as it should.
The eDonkey protocol used the same basic premise. How is BitTorrent different to it and other P2P protocols and why did you make that choice?
Bram:
That 'functional glue' is extraordinarily difficult to get to work well. Ever-changing network conditions and very high rates of peers disconnecting produce a very thorny logistical problem. Most existing swarming implementations don't even manage to fully utilize all the upload capacity available to them.
That said, there are other decent swarming implementations. For example, the one in eDonkey is quite serviceable, and Furthurnet's works okay as well. BitTorrent handles the little details of file transfer better than all of the others, but if that were the only difference its advantage would be relatively minor and subtle.
What sets BitTorrent apart is its very robust technique for rewarding specifically the peers which upload the most, known as leech resistance. On the highest level, this prevents a long-term meltdown of the system from being caused by people running leeching clients. It also causes upload and download rates to be somewhat correlated, so peers on good pipes get decent download rates, which increases general good feeling about how the system behaves. Overnet, the follow-on to eDonkey, may start using BitTorrent's peer protocol in the future specifically for the leech resistance properties.
By the way, people sometimes run clients hacked to not upload at all and still experience good download rates. Usually this is because they're downloading a file which has been available for a while and there are many clients which have finished downloading but been left running, so there's plenty of excess bandwidth to go around. Not uploading in a swarm which is still ramping up is generally ruinous for download rates.
4) Improvements... by BJH
Bram,
Do you have any plans for improvements to BitTorrent to improve some of its (few) weaknesses, such as searching for torrent files, bandwidth usage by trackers and inability to download if the tracker goes off the air?
Bram:
I have no plans to add search functionality, since that can be handled at a higher layer, such as google, and finding content via links is considerably more versatile and widespread than keyword searching anyway.
Bandwidth used by the tracker is currently around 1/1000 the total amount of bandwidth used. With some tweaking, I can get that down to around 1/10,000. Going lower than that would require sacrificing the tracker's ability to collect statistics, since those get significant at that scale.
Relying on a single tracker is really no different than relying on a single web site. Any well-colocated machine is plenty reliable enough, and if you really need failover you can do it at the DNS level.
4a) Re: Improvements... by ichimunki5) Impending doom... by damuI would like to refine this question because I have some specific nits that I'd like to pick: why doesn't the client/server open a single port and listen on that instead of opening a new port for each file? Second, why don't the peers maintain and share information about other peers once the download has started-- going through the central tracker provides a central point of failure. Wouldn't decentralizing allow for a .torrent file to have a list of seeds, and then each of the seeds would be able to share information about peers, eliminating the need for a tracker altoghether?
Bram:
Single port has been high on my list of things to do for a while now but keeps getting put off as more immediate concerns pop up. It mostly hasn't been done yet for a highly technical reason. The way BitTorrent currently shuts down is with a hack where the entire event loop is terminated; To support multiple downloads a cleaner technique which only stopped events and sockets related to a particular download which one of them terminates would be necessary. This is reasonably straightforward to implement, but requires a lot of surgery.
By the way, my mail load has made getting actual development done rather difficult as of late. I'm hoping to offset this with contributions from other developers. While there's been plenty of interest in contributing, and a significant amount of contribution to the tracker, to date noone other than me has made any significant changes to the core download functionality.
If anyone really wants to make a significant development contribution to BitTorrent, you should read over the codebase enough to understand it all (the irc channel can be helpful with this) then ask me what's on the to do list. I suggest you do not start implementing your own BitTorrent client. There are already several of those being worked on, and they're all very far from being as mature as the main line client. What's really needed is more development on the main branch.
Are you taking any precautions for your clash with the RIAA/MPAA?
Bram:
I don't expect to run into any legal trouble. BitTorrent can be used for any kind of content, and several web sites have used it for their own files. Also, all the etree usage (live show recordings of bands which permit it) is completely legal. BitTorrent's total bandwith usage would be quite substantial even if the etree distributions were all it was used for.
6) Future Considerations... by pgrote
Do you feel that BitTorrent's core functionality can one day be integrated in the operating system as a file system? The ability to share files among disparate systems in remote locations can be seen as extension of what was started with HTML, et. al.
Bram:
No. BitTorrent's API is one of starting a download and later being notified that the whole download is complete. File system APIs very specifically involve open(), seek(), read() and write(), which are completely different and wholly incompatible with the way BitTorrent works.
The same is true of http by the way. Attempting to make certain protocols act like local file file system access is kludgy at best, both as a literal concept and as a metaphor.
7) Panhandling for internet dollars... by Matey-O
You've got a paypal dontation button to help compensate you for your non-trivial expenditure of time...how well is that working? Is it an adequate revenue stream, or just enough for a pizza or two?
Bram:
So far, more than a pizza, but less than a living. The donations definitely help though.
8) Re: most obvious question... by Noksagt
...what do you think of what people have done with what you have created. I'm sure you might be sick of people asking you how to obtain a torrent for the latest movie, but are you troubled that it is being used for copyright infringement? Pleased? Apathetic?
Do you wish that it was used more for distributing legal ISOs and other files? If so, do you believe you should promote it more for this purpose or promote development of tools to push it in this direction (perhaps automatic creation of torrents on a successful build, etc.).
Bram:
I'm amused mostly. I find humans highly entertaining.
My attempts to promote BitTorrent for any specific purpose basically failed. It's grown almost entirely through guerilla marketing. That said, I'm hoping that in the future BitTorrent starts being used directly by content producers to distribute their own works.
9) Success... by pgrote
BitTorrent has seen a wide array of usage since it debuted. Many have been surprising and it has caught the fire that makes sofwtare a success. How do you personally measure the success of BitTorrent? Has it achieved the goals you first set?
Bram:
I generally measure software success by how many machines it's deployed on. In that sense BitTorrent has done very well, but it will probably become much more widespread as publishers make their content available using it. My current hope is that BitTorrent will one day be installed on almost all end user machines.
10) Commercial Interest... by Noksagt
I think that bittorrent can be of significant commercial interest. It might be used for software updates for instance. Have you pursued this path or have companies approached you? I certainly hope you'd keep a free version available, but a more feature-rich version would surely land you a great deal of money with the right pitch.
Bram:
So far there hasn't been much commercial interest, but I expect that to change now that large deployments have proven the technology so dramatically.
Starting a business is very tempting. BitTorrent has the potential to create such incredible amounts of value that if I manage to make even a tiny fraction of that I could do very well.
-----
My question would have been...
How do you feel about slashdot crushing every torrent web site and tracker everytime it runs a story on your program?
Davak
Normally the slashdot interviewees take a long time to answer their questions, (I'm not complaining as the candidates are normally very busy people), but this one seems like it was much quicker than any recent one.
Perhaps he distributed the answering of the questions?
one day, just maybe, he'll even make a living from it...
Bram hopes to make a living off code that he wrote that the community seems to really like? Queue the peanut gallery with cries of "sell-out" and "greed" and random smatterings of the words "corporate" and "freedom". I've not used BT extensively but what little I've seen impressed me immensely. Hopefully he can turn it into something that funds its own improvements, and if he's lucky to help pay some bills as well.
Go here to get it http://prdownloads.sourceforge.net/bittorrent/
My advice would be to license the source code under the GPL for OSS projects, and additionally under a commercial license for businesses.
Provide BT technology for incorporation into random commercial products. Resell your consulting skills at a good rate. Train others to be able to do the same. With licensing and consulting fees, you will do nicely.
Sig for sale or rent. One previous user. Inquire within.
Ward Cunningham's Wiki on Patterns has an interesting page on the attitude of referring to details as *just* details.
Very often, the person saying "Oh you just did it this way" has some more learning to do.
A good project for someone to use, is to have the corporate version where the main corporate site can have the file as a bittorrent, and always be serving it. If it cant find any other clients, it uses the corporate file LAST to download from.
;-) oh well, bittorrent rocks!
this way the first few people on the thing would be getting it from the corporate client, then after that from other peers, but then when the file becomes unpopular, people would then basically be getting it from the corporate client again.
This would a little improvement. Though this may just show my ignorance of how bittorrent works as well. Currently I download some files using bittorrent (wolfenstein enemy territories) but when all the seeds go away it can cause issues.
So basically make it so that there is a relatively permanent seed, and he is always requested from LAST. that way if the file is popular the site doesnt have to worry about losing bandwidth.
also, stats tracking should be "ramped up" a little, to where someone would have to register to use the torrents on a specific site, this way the tracking per user could be used. Now this wouldnt interfere with anyones right to privacy, but could be used as a "bonus" system, to provide incentive to keep the torrent open. IE the more you upload the more "credit" you are given. If you think of it in slashdot subscriber terms, perhaps people that have a high "credit" (ie they leave their client open after being finished) would get earlier access to files. maybe have a 3 teir file access. top teir (high uploaders) would get the file as soon as it was served. second teir would get at it 20 minutes later, and 3rd teir get it 45 minutes to an hour later.
this would allow sites to reward those that are high quality users, and maybe allow them to track site benefits based on participation.
maybe call it "sitetorrent" or such.
and this is actually an original idea i thought of trying to get some freinds of mine and myself to code 2 years ago, but I had neither the experience nor the time to work on it. Then someone showed me bittorrent about 2 months ago and I was like "holy shit thats exactly what my product was going to be sans user participation"
Oh, and you cant steal my idea, i provide it free to the public today 6/2/03, as a business application given freely and documented.
Buzz OUT!
If you don't vote, you don't matter, so don't waste your time telling me your opinion
"I don't expect to run into any legal trouble. BitTorrent can be used for any kind of content, and several web sites have used it for their own files"
This hasn't seemed to stop them in the past... The RIAA even admitted that at least 15% of Napster use was legal, more than the amount of legal use they admitted in the betamax case...
I think he should start saving up those paypal donations fo the legal fund because in all likelyhood he is going to need it!
Visualize the world of wine
Unless, of course, he has a hot 15 year-old daughter that wears skimpy clothes and says, "I'm Bitty. Share me!". Aimster/Madster probably patented that business model, though.
Do you even lift?
These aren't the 'roids you're looking for.
Also, all the etree usage (live show recordings of bands which permit it) is completely legal. BitTorrent's total bandwith usage would be quite substantial even if the etree distributions were all it was used for.
many people are not aware bands like Dave Matthews Band have an open taping policy. while not soundboard, many audience recordings are really close. many tapers spend $5000-6000 dollars in equipment and acheive pristine copies of the concerts. access to the shows has become even easier thanks to an amalgamation between archive.org and etree.org, we now have the etree.org audio archive.
these files are distributed in the lossless SHN format so each copy will sound the same no matter which generation of the disc you have.
with the addition of BitTorrent the trading of these concerts has become even easier. Many links can be found under the music of Smiler's BitTorrent site. But here are a few direct links; here and here.
Check out the etree newbie FAQ and the etree trader database for more info.
The best part is the RIAA can do nothing about it, imagine that legal free music!
Mike
... Are you concerned that M$ might decide to make a P2P system that works similarly to this and start bundling the client with Windows, or even as a part of their Media Player? They would then license the tech to the media companies to use for distributing movies, etc. Such a move could dramatically reduce the growth potential of BitTorrent (see "Netscape" and "RealPlayer").
Even if M$ just gave it away at first in order to take the biggest chunk of the market for later reaping, the impact on other products such as yours and Kazaa and others would be, well, bad.
Flash is the Herpes of the Internet.
your.opinion >
He said images on a website are too small to bother with. Well, how about a tarball of the entire site?
... torrent://slashdotted.site.com
With the home page at the front. It would be terrific if people didn't have to fear being slashdotted. It would be cool if an Apache module could be developed to detect when bandwidth reached over a certain level, made a tarball and only allowed Torrent download of that. Then later, reverted to normal.
Making a file system driver for BitTorrent - not possible too different? I don't buy that. I could be done. Of course, there'd be latency.
Perhaps not handy of interactive use.
Also, how about new bowser protocol tag (like http://)
Since Gnome's VFS already does smb: etc this
would be a nice place to add it.
This application is highly I/O-bound, not CPU-bound, so raw processing speed is not a factor. It only has to be "fast enough", which it is. The things that do matter are things Python is good at:
;-)
- Security. This is a server, so buffer overflows and memory allocation errors are not acceptable.
- Readability. Bram expressed a strong interest in getting more developers involved, making readability essential.
- Platform neutrality.
Other languages cover some of these requirements too, of course. But Python is a great choice.
As for reducing the slashdot effect using a distributed mechanism, I'd like to see something like this: Slashdot runs a BitTorrent server and provides a "package" for every story. Users run a small local HTTP server that fetches web pages from Slashdot story packages, downloaded via BitTorrent. Slashdot lets users set a preference that converts all front page URLs to fetch from the local HTTP server instead of the real site.
The net effect is Slashdot provides a "cache" without actually using up bandwidth. We wouldn't even have to change the BitTorrent protocol. Slashdotters unite!