Bittorrent Implements Cache Discovery Protocol
An anonymous reader writes "CacheLogic and BitTorrent introduce an open-source Cache Discovery Protocol (CDP) that allows ISP's to cache and seed Bittorrent traffic. Currently, Bittorrent traffic is suffering from bandwidth throttling ISP's that claim that Bittorrent traffic is cluttering their pipes. This motivated the developers of the most popular Bittorrent clients implement protocol encryption to protect bittorrent users from being slowed down by their ISP's. However, Bram Cohen, the founder of Bittorrent doubted that encryption was the solution, and found (together with CacheLogic) a more ISP friendly alternative."
We have the technology -- we can make him stronger, faster, better! ...now, if only there were some more seeders.
A computer once beat me at chess, but it was no match for me at kick boxing.
Just read this and wonder what the legal position for ISP's will be with regards to caching non-legal P2P files (warez, music files etc)?
With the files being on my PC and served from my PC I'm the responsible party... if the ISP then is caching that data to make it more available (speed/latency/load reduction etc) then the ISP could be deemed to being a party to an illegal act...
--- Users are like bacteria -> Each one causing a thousand tiny crises until the host finally gives up and dies.
Given that a lot of torrents are copyrighted content, are ISPs really going to want to do this? The moment they start caching these files on their servers, they become a huge target for lawsuits.
when will this be implemented in azureus and utorrent? i appreciate bram's work immensely but i'm not too keen on his app...
Large print giveth, and the small print taketh away
IANAL, but it doesn't really seem like an ISP could run this as an open, unprotected service. The legal rammifications to them of becoming more actively involved in torrenting are monstrous.
---- I'll take you in a Hunt deathmatch any day.
Currently, Bittorrent traffic is suffering from bandwidth throttling ISP's that claim that Bittorrent traffic is cluttering their pipes.
You mean tubes.
CDP = Cisco Discovery Protocol
http://www.javvin.com/protocolCDP.html
Isn't torrents clogging up the tubes the real problem?
between the clogged tubes and the friggin SNAKES... on a PLANE! I'm not sure what to do...
Beware of the Leopard.
It's no different than them hosting usenet servers. When contacted by copyright holders they are required to remove the infringing material(s). As long as they aren't actively monitoring what they're caching, they aren't required by law to do anything about it. +1 for legal precedence before lobbyists took over our government (at least the telecom portion).
Currently, Bittorrent traffic is suffering from bandwidth throttling ISP's that claim that Bittorrent traffic is cluttering their pipes.
Jeez, who writes this stuff? Must be clueless because everyone knows the internet uses tubes. Sheesh.
spoonerize "magic trackpad"
Seems like CacheLogic will be providing hardware supporting this new CDP protocol (which, ahem, CISCO Discovery protocol also shares the same acronym). Neato. It's open source as well, so I'm sure we'll see ISP's deploying linux boxes running the CDP daemon..CacheLogic and BitTorrent didd good. One thing I noticed on the official press release was that the engine caches content, but specifically 'legitimate content'. Hmm..
Is this a good time not to say anything about that "port 119 service" thingy that we geeks are not supposed to ever mention?
Gentoo Linux - another day, another USE flag.
"However, Bram Cohen, the creator of the bittorrent protocol and the developer of the mainline bittorrent client did not believe that encryption was the solution, and found (tohether with Cachelogic) a more ISP friendly alternative. However, this new and improved version is promising the opposite, downloads will be accelerated instead of throttled. However, only for commercially licensed content."
Well, I guess that takes care of the legal liability issue.
Also, *barf* at three sentences in a row starting with "However."
I think the ISP's are right and that this particular program is doing a great time helping the Net to become clogged up. Not to extreme amounts ofcourse but all little bits help in the process.
I've used torrents for 2 periods; one time I only let it run 4 - 6 hours to grab some mediafiles and noticed how my bandwith consumption was actually threefold of what I'd normally use. To download a 60Mb (or so) I was at some point with 20Mb downloaded and approx. 60Mb uploaded. Since speed goes both ways (what goes up can't come down (at the same time anyway) and I had a maximum amount of data traffic to consider I decided to stop using the program after this session. Picture my surprise when I kept noticing 'torrent connects' on my firewall logs for the next 4 weeks! I really consider that a major overhead, especially if you consider that not every firewall blocks a port by giving out a response "sorry no access" but many, like mine, simply ignore the whole attempt alltogether. Thats bound not to work well with regards to timing.
And now that we're on the issue of firewalls. I think that the flexibility to change the used ports is something simply needed in such software. If you can change ftp ports, why wouldn't you be able to change torrent usage ports? However, it would have been a lot nicer if you could specify what port(s) you used so that others would stick to it. I don't like opening up a zillion ports on my firewall, so when I opened up the very basic range in my second session attempt (approx. 1/2 - 1 year later) I noticed that an increase of peers wasn't using the ports I specified to be using. In fact, even though I clearly indicated that I wanted the "default" range I kept torrent hits on ports never progagated (or so I assume) by my torrent client/server.
So my simple conclusion is that while the whole concept (spreading the load over multiple sources) is a smart one the reality shows a completely different picture where there is a massive amount of overhead being created. Either they look at the global picture (no need anymore to keep sending 60Mb (for example) from your site over and over again, that load is spread over many sites) or simply take a look at a very narrow picture (no problem if there is a server with a slow upload somewhere, there are many others being used in parallel) but it seems no one pays attention to the generated overhead.
Yes, its nice that you can grab a 60Mb file from many sites in parallel. But is it really as fast as people claim? Using several feeds means more overhead on your box with regards to dataprocessing. Then there's the bandwith itself to keep in mind, you only have so much to spare... But when I see that a 60Mb download actually generates 180Mb worth of data then I can't agree with people saying how much better a torrent is and that the spreading of data is actually a good thing. Sure, perhaps in a global picture... But for anything else (security, bandwith, etc.) I think its a poor concept.
bittorrent causes a lot of traffic. I mean come on, the internet isn't like some sort of truck you can just dump stuff on. It's a series of tubes, man!
Moo.
I swear to god I'll come at you like a spider monkey!
No ISP cooperation necessary. This has been tested experimentally a couple of times.
See http://del.icio.us/tag/p2p+locality
Azureus has supported JPC (http://www.joltid.com/index.php/peercache) for quite a while now.
Your hair look like poop, Bob! - Wanker.
Here in the UK, for an ISP to buy a 622Mb pipe into BT's network (our beloved monopoly telco) costs £1.5m per year. That's a wholesale price of £200 per Mb, which is over 10-20x more than the external bandwidth is going to cost. So even if your traffic is only going from your local cache direct to your customers, it still costs WAY more to send it that one last hop than it would to get the same amount of traffic from anywhere else on the internet.
Net result, those crappy bandwidth quotas / "bad boy" pipes / (un)fair use policies are staying.
I'm not sure how broadband economics work out in other countries, but here any high-bandwidth applications are still prohibitively expensive and it'll stay that way until Ofcom (our telecoms regulator) can finish their tortuous process of opening BT's network up to competition.
Matthew @ Bytemark Hosting
Do we finally have a model where a software developer is working hand in hand with the ISP, End-Users and the Content (DRM) folks and managing to make all happy?
I just see this guy has someone who has a freaking clue as how best to manage the many touchpoints a product like his makes when out in the wild and is using his business/technical acumen to move things forward all the while making each layer 'happy'
Kudos to Bram and anyone contributing to the cause...
sig goes here!
Stop twatting about with all of this jiggery-pokery and deal with the real problem:
Get more and faster computers, more and faster networks and tubes that don't get clogged up every time somebody sends you an internet.
Folks are using the internet a lot, that's what they want, that's what you [ISPs] want: they pay you for that.
Don't oversell, now!
I have to confess to not really knowing about this stuff, but all the torrents I download are used by relatively few people in isp terms ... does this not mean that to have any significant benefit to end users, the storage requirements of such a cache would be vast? The ISPs may as well trawl the internet for torrents and become seeders themselves. I bet the MPAA would prefer non obfuscating clients too.
Wouldn't IP Multicast be a more appropriate solution to this problem (and, for that matter, also for the whole lot of streaming content that flows on the 'net nowadays)? AFAIK it has been standardised for some time now, both for IPv4 for IPv6. Why, then, is it that multicast is virtually unused outside private networks?
Score: i, Imaginary
Now I can do 'show cdp neighbor eth0' on my linux box and actually get something back!
Is that a salami in my pants or am I just happy to be me?
The sender can multicast the file in a loop. The recipients will get the pieces starting from whenever they started "listening" on the ongoing multicast, and then get the earlier parts, when the sender finishes and starts over again.
This is far more efficient, than for the sender to push the same data to each client in parallel.
In Soviet Washington the swamp drains you.
You've never seen a legal torrent? Seriously?
Most of the GNU/Linux distributions I've downloaded were via Torrents.
Encryption should be on EVERYTHING, be it legal or not.
---- Booth was a patriot ----
So you can just point and click as an end using tube consumer.
No more up/down pipes for the customer.
You do not host anymore.
You accept what they put up for you to consume.
Domestic spying is now "Benign Information Gathering"
Some games distribute updates via bittorrent (such as Gunz: the duel)
All misspellings and grammatical errors in the above post are intentional and part of my artistic expression.
Let's make the ISPs liable for everything we download!!!! Yeah, that'll stop ISPs from censoring Bittorrent. Why didn't I think of that?
...but without the crypto.
It's a shame more ISPs don't run freenet, tor, or i2p nodes. Usenet servers were a good idea, and torrent caching servers are a step in the right direction.
The problem, at least at the small ISP I work for, isn't with out upstream connection; we've got bandwidth to spare in the NOC. For me, the problem is actually in the last mile. This would only work if I could buy about fifty of these caches, and deploy them at or near my POPs. I'm gonna take a wild guess and say that's not cost-effective for me.
Azureus already have LAN Peer Finder and JPC (Joltid Peer Cache). Not sure how this is different from JPC on the practical level:
Looks like by going its own way, the official client will once again create segmentation, just like with DHT.
Belief is the currency of delusion.
A locality-aware swarming protocol can only discover other peers at the same ISP that are running at the same time, but a cache hosted by the ISP is always running and can serve content that was downloaded by another client earlier (sort of cooperative prefetching). Also, the bandwidth between the cache and a customer is usually going to be much higher than the bandwidth between two customers because of asymmetric connections.
It's not GNU/Linux distributions that have caused ISPs to decide to bandwidth throttle bittorrents.
Yeah, finally, a way to keep the tubes from getting over filled.
Skiffy is Spiffy, but Ort is tort.
I remember when bittorrent launched, the idea was to save bandwidth. Now that idea is what hurts them.
Chewbacon
The Bible is like Wikipedia: written by a bunch of people and verifiable by questionable sources.
Bittorrent as cool as it is, really puts a strain on an otherwise smoothly running network! (just a reality) - I like bittorent otherwise!
me (the 'Dan' that replied to the article on that site) said this:
.au ISP and i would argue that the users use their "favourite applications" for sharing ILLEGAL software - hence it probably won't catch on with any ISP, UNLESS someone creates a new 'killer service' to satisfy this great new isp-based p2p seeding capability.
bah... i work for a major
I can say right now that all that is needed for ISPs to provide GREAT service levels to customers for LEGITIMATE application use (web2.0 + video stuff, etc), is to simply throttle back the amount of illegal file trading activities - which is what we're doing!
It seems to me that this technology is simply providing a solution to a problem that doesn't quite exist yet.
Okay... So you sell a Internet connection with 1Mbit with a flat price. And people actually USE it? Not any fun? Do what the ISPs do in Sweden - upgrade. 1, 2,5 and 10Gbit backbones are everywhere around here. If they were to throttle connections there would be a riot over here. Blocking / Throttling is a stupid idea. Feh.
What we need to do here to free up all these tubes is to order up a bunch of lottery balls and shoot them through the tubes at a high velocity to keep the tubes clear. Then everyone is happy.
:)
I'm shocked that no one has thought of this.
"...the shortest distance between two points may be straight line, but it is by no means the most interesting."
And World of Warcraft...
oh no, bit torrents cloging up the tubes. why didnt we listen to ted stevens.
Cisco today made patent on CDP (Cisco Discovery Protocol)
I am trying to download Harry Potter, dammit!
Don't say Telco. You blame the Telco for the throttling... when the problem is the ISP. The Telco would LOVE to sell more bandwidth. The ISP does not want to buy more bandwidth. If your ISP is also the Telco, well than that's your fault for being stupid.
In the next few years, you'll see ATM-based DSL move over and it'll be replaced by ethernet over copper, or Ethernet-First-Mile. Even before that happens, you will hear about more ATM-to-Vlan based services in the Telcos as they prepare for the change. VLAN-based edge technologies are going to allow for newer QoS and accounting processes. But, no one wants to go to the satellite method of charging for bandwidth used. They'd just as soon shoot themselves in the foot.
And no ISP wants to buy an armload of servers and park them at every POP. It'd be like Usenet News all over again. And who wants the ISP to keep a record of what is stored, who grabbed it, etc? And what happens when the ISP filters Torrents, and has a $hitty retention policy? Torrent will mutate into something else, and the entire investment will do down the tubes except for a few ISPs that implement it.
Keep the ISP out of the business. They should provide as little "service" as possible... basically offering access to the internet and the basic services. Usenet, Mail, Webhosting.
If I were an ISP and had a bittorrent problem (and it's obviously an issue with pirated content on bittorent), I'd be interested in having the proxy up if it really helped defer my bandwidth costs.
BUT...I'd DEFINITELY want it to be transparent and invisible.
So basically many ISP's will want this software BAD. But they don't want anybody to KNOW they do it for fear of lawyers from the RIAA/MPAA/SPCA/ECT comming down on them like a ton of bricks.
Any time the ISP gets owned on bandwidth (or in any other way) because they handed out crappy asymmetric connections is a good time.
-- The act of censorship is always worse than whatever is being censored. Always.
It's a series of tubes. (cue techno music)
Coding with assembly is like playing with Legos. Coding an application in assembly is like building a car with Legos.
Will you people get off the man's back?
Would you be as unforgiving had he said "pipes"?
I hear "pipes" used interchangably with "bandwidth" all the time.
Dictionary.com defines "tube" as: A hollow cylinder, especially one that conveys a fluid or functions as a passage.
Dictionary.com defines "pipe" as: A hollow cylinder or tube used to conduct a liquid, gas, or finely divided solid.
They're freakin synonyms! How is this deserving of endless mockery? The analogy made sense.
Ideally, locality-aware algorihtms could give wonderful results, such as orders of magnitude lower P2P load on backbones. Caches may give same results. See How hard will P2P hit backbones? For inherited asymmetric-last-mile networks caches are obviously better. If a network is built with P2P in mind, it might need no caches.