ISPs Experimenting With New P2P Controls
alphadogg points us to a NetworkWorld story about the search by ISPs for new ways to combat the web traffic issues caused by P2P applications. Among the typical suggestions of bandwidth caps and usage-based pricing, telecom panelists at a recent conference also discussed localized "cache servers," which would hold recent (legal) P2P content in order to keep clients from reaching halfway around the world for parts of a file.
"ISPs' methods for managing P2P traffic have come under intense scrutiny in recent months after the Associated Press reported last year that Comcast was actively interfering with P2P users' ability to upload files by sending TCP RST packets that informed them that their connection would have to be reset. While speakers rejected that Comcast method, some said it was time to follow the lead of Comcast and begin implementing caps for individual users who are consuming disproportionately high amounts of bandwidth."
give increased speeds when you don't leave the network. downloads will complete faster, so less peering will be done.
> which would hold recent (legal) P2P content ...
Yeah -- THAT will solve P2P congestion. (Morons)
Ian Ameline
ISP's to quit offering unlimited service, or stop overselling what they have. What's the point of having a 15 or 20 Megabit downstream, when I can only download 50 Gigabytes of traffic per month? Because i'm sure as hell not going back to renting my porn from the video store...
Is there heaven? Is there Hell? Is that a Tuna Melt I smell?-Primus
1. cut a hole in a box
2. put an FP in the box
This is all we need. The problem is not that the providers aren't giving us enough bandwidth (they aren't). The problem is that they care what we spend it on.
DRM: Terminator crops for your mind!
Ok so, my ISP (theoretically) wants to keep the data my neighbour has downloaded, incase I want to download it to.
Yet, obviously these caches will have to be legal content, which means filtering out illegal content, which means they will be tracking everything I download, and thus, can force me to 1) pay more for this, 2) notify appropriate authorities, 3) limit my interaction with the rest of the world via the internet.
Although as stated in the article/summary its supposedly "temporary" but this means that ISP will have to start gathering massive amounts of storage, inevtiably making one ISP better at this than another, and hey fuck it, lets just have one ISP... and the internet just becomes Wikipedia.
I honestly can't see any benefit to this, it seems to just end up with steralization whichever way I look at it.
Support multicast. If you build it, they will come and make a multicast P2P program on top of it, relieving your backbone connections of all the redundant connections.
Here's how media companies will kill the free internet we all know and love:
"Legitimate" media caches and disruption of all other P2P traffic only makes step one worse. They will continue to slow the rest to lower than their heavily filtered networks can deliver. The result will look like broadcast media does today, one big corporate billboard, instead of a free press. Part of censorship is shouting louder than others.
Yeah, I've said this before. As long as ISPs have the same story, so will I.
How about they roll out the infrastructure we paid for with our tax dollars, then not apply any "controls".
you know, a proper, neutral internet that fulfills the promises they made again and again to our government officials when they were given grants, local monopolies, etc. etc.
VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
Ok, what are those caps? What are the exact limits of bandwidth. If I download X bytes, will I have Y speed? Until they answer that, it's all hot air.
Isn't this just what alt.binaries was doing for the ISPs? Local caching? And they just got rid of those.
"localized "cache servers," which would hold recent (legal) P2P content..."
And we all know what a wonderful job ISP's have done in the past at deciding what content is legal and what's illegal. I wonder what they'll do about encrypted traffic.
1 - sort of defeats the purpose
2 - id rather them not know what i'm getting, be it legal or not.
---- Booth was a patriot ----
My ism, it's full of beliefs.
making sure anonymous posting still works.
how about we also have http controls, and mms controls, and...
oh wait those are not being continuously vilified by the MAFIAA, who also own the news.
VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
Having a local cache server, while it does spark privacy concerns, is actually probably the best solution they've come up with yet. ISPs won't have to spend a great deal of money on upgrading infrastructure, and users don't get shafted by reset packages. It's something of a compromise between doing it the right way (upgrading everything) and the wrong way (strangling the users).
Admit it. You post strawman arguments as AC so you get modded Insightful for refuting them, rather than Troll
Even better: make the pricing also destination-based and time-of-day-based, and suddenly, P2P software will care about locality and peak hours, solving the traffic issues.
As an ISP, if you bill the user exactly what it costs you, then the user will minimize your costs because he minimizes his! You also end up charging your "problematic" users appropriately (or losing them) so you don't mind them, and you win against the competition because they lose money on people who find their plan cheaper, and they lose the customers who find your plan cheaper.
Instead ISPs use convoluted pricing schemes so they run into all kinds of problems and need this telecom conference to help them.
I say, make the pricing scheme as accurate as possible, and let the market forces solve the problem.
I don't see a whole lot of difference in legality between this and hosting newsgroup messages. Legit reasons for both.
Check out my sysadmin blog!
I don't know why people keep getting hung up on legal vs. illegal content; the law clearly says that ISPs have no copyright liability for their caches:
http://www.bitlaw.com/source/17usc/512.html
I'm told I get 10 MBPS. As far as I'm concerned, that means 10 MPBS 24 hours a day, 7 days a week, for as long as I pay my bill. Any effort to throttle that back and I sue for false advertising.
I piss off bigots.
I hate to applaud AT&T on anything, but they have made a ginuwine commitment to a nuetral network refusing to partake in shaping until forced by legislation or until they find a solution that dosn't hurt their customer base. All it takes for traffic shaping to fail is for one person so not do it...then everyone goes to that one person. At the same time AT&T is rolling out increased infrastructure. I upload consistently at 112 kps almost 24/7 (I backup 10 gig files almost daily to colocated servers). My clients cable provider disconnects their internet if excessive upstream is detected...it seems like this is more of an issue for the cable companies rather than dsl providers becuase DSL providers sell dedicated BW as opposed to portions of shared BW (like cable does).
Trying to install linux on my microwave, but keep getting a kernel panic...
1. Cache known legal content to improve download performance.
2. Significantly reduce performance of content with "unknown" legal status.
3. Result: legal content gets preferential treatment so legal downloading performs better.
4. Non-"neutral" treatment completely justified by the war against contraband.
5. Hit content providers for kickbacks, those that don't pay get their content treated as "unknown" legal status.
6. PROFIT!
P2P shifts costs of distribution from central servers and spreads the load out among the downloaders. This is *helpful*, and it is more equitable given that the marginal costs of data copying is near zero - pushing the price of downloaded content lower and lower.
The pricing seems like such a non issue. The elephant in the room is that companies like Comcast are making a killing, taking a ton of money selling services that largely go unused. many service businesses over sell their capacity to ensure high usage rates, but broadband has taken it to an absolute extreme.
The obvious and easy solution is for providers of cable and DSL services to price their offerings according to usage, and when it comes to bandwidth, the accurate solution is 95% billing: you use a ton of bandwidth, the customer gets charged more. They don't really want to do this though - they make a lot more money buying in bulk and selling little access services for much higher rates than the bandwidth used.
One huge upside of changing the pricing system for home Internet to 95% billing is that you don't have to go metering and capping bandwidth to homes. People could get an *extremely* fast connection, but if they utilize it fully 24/7 then they get billed a high rate. This is not that complex a concept to implement technically.
You should be allowed to use the bandwidth you paid for as you please. It's not your ISP's business what you decide to do with what they sold you. Whether it's downloading via BT, or watching video on Hulu, no one else should be trying to decide which are Good Bits and which are Bad Bits.
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
I have Comcast, and I've never experienced any traffic shaping or throttling.
Their policy, now that it's no longer P2P specific, seems sane.
Two conditions have to be met for them to throttle your traffic:
1) You have to be one of their heavy heavy users. By heavy, I mean torrenting 24/7.
2) The network has to be congested at that moment.
If granny next door can't check her email because you're downloading/uploading pron all day every day, they reserve the right to throttle back your connection until the congestion clears. Seems fairly reasonable.
Also, it's far, FAR better than than the capped, $1 per GB plan that Time Warner Cable is piloting.
If Comcast advertises 6Mbps I expect 6Mbps or an equal share of the remaining available bandwidth I can receive at any moment.
They have the pipe and customers are bidding on that share of pipe. Inevitably that pipe is going to get clogged just like our California freeways during rush hour. If I'm paying $60 a month I expect my own freaking lane.
I believe communication companies need incentive to upgrade their bandwidth. If they want people to pay for more bandwidth they should have to expand their network infrastructure and not limit the amount other users can download.
Just make it equal share for everyone up to the bandwidth cap they advertise. If a user who is paying $40 a month is getting the same bandwidth as the person paying $60 a month then there is no incentive for the customer to pay the $60. If the ISP wants people to pay $60 a month then they could go ahead and upgrade their networks to support more bandwidth. Just deliver what you advertise. Is that so much to ask?
Tell me Comcast: Just how did your cable suddenly get better once you start charging me 2X to 5X as much as before?
They're just a bunch of fsking liars!
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
Wow would I like to be on a system like that!!!
Or did you possibly mean: 10 M b PS?
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
This just gave me an idea. Why not have the next generation of P2P protocol have ad space in the client. The catch is, the ads are pushed from other P2P clients. The receiver would then display ads from the top 3 seeders (measured by bitrate or bytes sent, or whatever makes sense). Then all of a sudden, we have incentive for these ISPs to seed.
If my ISP promises me 4mbps download and unlimited traffic that should mean that I can download up to about 1TB per month (450KB/s 24hours a day for 30 days). If they want to limit me to, say, 100GB/month then this amount should be indicated somewhere in the agreement and should not be advertised as "unlimited".
If the network is congested I expect an equal share of the available bandwidth. Actually, I should get a share of the available bandwidth that is proportionate to my max bandwidth. For example, in a congested network I should get four times as much bandwidth as the person paying for 1mbps connection.
ISPs can do whatever they want (for example throttle P2P) just say so in the advertisement or at least when someone asks about it.
I am happy because my ISP appears not to limit my traffic (although I usually download only 100-200GB/month peaking at about 500GB/month)
P.S. why do I have to insert br tags to make a new line?
Furthermore, don't they have common carrier status, so all of it is legal for them to cache??
JUMP JUMP JUMP JUMP JUMP JUMP JUMP JUMP IRRIGATE
"While speakers rejected that Comcast method, some said it was time to follow the lead of Comcast and begin implementing caps for individual users who are consuming disproportionately high amounts of bandwidth."
-GOD FUCKING FORBID we use the bandwidth we purchased.
Knowing Google's lust for data collection, the Soviet Union is still alive and well inside the psyche of Sergey Brin....
Sounds like a good idea. Cache is a very good concept, that has proved itself across and in different systems.
Basically in an environment where size matters less than speed, cache brings benefits.
i.e. IMO, cache servers would do Internet good as a whole, provided they are:
1. Enviromentally competitive - draw little power, so they do not contribute to a whole lot of watts Internet contributes to already. I am talking about inexpensive systems with lots of cheap hard drive space. A lot of cache server systems to 'speed up' Internet means a lot of power draw, so obviously a factor.
2. Legal P2P content? Oh, lets play police again shall we? 90% of p2p traffic is illegal, so how caching 10% of the part that is legal is a solution? Besides, is encrypted traffic illegal? Speaking in Apache terms, is it an 'allow-deny' or a 'deny-allow' rule?
Perhaps use routers with a hard drive. That way it is a polymorph system, that acts as a good old TCP/IP router, but may retrieve content from cache, if the connection allows it. Replacing old routers with such upgraded systems can be done over time.
A cheap harddrive is what, a 5W? It only needs to be faster than cache-miss data retrieval equivalent, right?
...but they have made a ginuwine commitment to a... Let's play spot the person who listened to late 90's hip hop "stars". That would just be ludacris.The summary makes it sound like these guys are implementing the ideas covered in Van Jacobson's 2006 Google Tech Talk called "A New Way To Look At Networking" (Google Video).
I think this was covered somewhere on Slashdot previously, but I can't immediately find the article after a bit of searching.
Downloading music for free is destroying the music industry, yet downloading child pornography for free is helping the child pornography industry...?
What? Doublethink? Naw....
If I'm serving up ad-supported content I don't want my content cached unless I can count the viewers so I can bill my advertisers.
If I'm serving up restricted-access content I definitely don't want it cached unless it can be done in a secure way.
If I'm serving up content subject to change I don't want it cached unless I can guarentee some level of up-to-dateness.
Having said that...
It's in the interest of "big content" to cooperate with "big pipe" to improve the customer experience. Happy customers are more likely to come back for additional products, which means more ca-ching! for everyone.
Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
The first line of this article could easily be reworded "alphadogg points us to a NetworkWorld story about the search by ISPs for new ways to stop rendering the service for which their customers pay."
Thomas Galvin
caching so called "legal p2p content" regionally is supposed to alleviate the web traffic crunch?
How about not throttling my HTTP streams you douchebag comcast?
I'm downloading my revision3 shows and some porn at the same time and all of a sudden, I can't load google?
try caching web content regionally. Oh wait, that's a stupid idea also.
their plan here is to say, ok you can legally download all of this content from local p2p servers. Anyone not using our servers is downloading illegally.
At that point, it's no longer p2p. And, when you start altering p2p streams, who is then liable for downloading anything? I didn't download anything, they changed the stream in route.
They're using their grammar skills there.
The truth is, content blocking (which is what this really is, none of that 'filtering' crap) is yet another hurdle to overcome. Things like encrypted BitTorrent and Distributed Hash Tables (DHT, or decentralized bittorrent) are only the first step.
Without a legal or free-market solution (since most ISPs are geographical monopolies or duopolies), a technological solution must be developed. The truth is, these content blocking appliances are pervasive in the ISPs network, and can pretty much masquerade as the intended endpoints for most traffic. The most effective solution, it seems, is to blind these appliances.
It makes the most sense for these boxes to take a multi-pronged approach:
1. Protocol Recognition (combatted by encrypted bittorrent)
2. Tracker snooping (a hole AFAIK)
3. Traffic/connection heuristics
If a P2P application is moved to a 'plane' above the usual network protocols and conventions, with encryption every step of the way, P2P communications will appear as noise or an unrecognized protocol, or not even as a single application at all.
Imagine this: A .torrent file that contains a URL to an authentication server. The authentication server is an https server, with the certificate published right along with the .torrent on thepiratebay.org or a similar site. After verifying the certificate, the BitTorrent client (Azureus, uTorrent whatever) contacts the authentication server, which presents a Turing Test (CAPTCHA). After the user selects all the kittens in the picture, the authentication server returns the tracker URL and the public key used for communication. The tracker then behaves like a normal BitTorrent tracker.
This way of joining the swarm completely prevents packet sniffing by using encryption every step of the way, and also stops the content blocking appliance from masquerading as a BitTorrent client by using a CAPTCHA. Without knowing the members of the P2P swarm, the appliance cannot block the connections made to and from those hosts.
As soon as the client becomes a part of the swarm, it must also take steps to avoid heuristics-based detection. It must not listen for connections on a single port. In fact, every server (I'm talking about TCP clients and servers now), must only accept a small number of connections, and new server ports must be opened to accept new clients. After a short time, those connections must be severed, and new ones opened, effectively migrating the data streams to completely new client and server ports, giving the appearance of multiple different TCP/IP applications being used at different times. The traffic might even be hidden in a known protocol, such as HTTP, to avoid the appliances that throttle all unrecognized protocols. (BitTorrent over HTTP, now that's funny).
So far, with this kind of detection avoidance, the only flaw is a spike in the user's bandwidth usage, which may not really be a big deal.
The beauty of this plan is that it requires little modification to current BitTorrent clients and trackers, as opposed to what's involved in a completely new protocol.
I recommend they add a valve to everyone's internet pipe. If they become troublesome, you simply close their valve down a little bit to stop the flow of the internet through the pipes.
We are one consciousness experiencing itself subjectively. Back to you with the weather, Bob!
I believe it's important to note that trying to stop P2P or anything of this nature isn't going to happen and that ISPs need to consider two facts of the situation: some people will use their service above average assumed levels of consumption and the floor of average consumption is rising. The second fact is more of a problem than the former since as technologies improve on computers people expect more bang for their buck, why should it bottleneck at the network? I got more bang for my buck in the last five years in CPU calculations, GPU calculations, HDD space, RAM capacity (and bandwidth), and so on. How the hell does the "ISP industry" suppose it's immune to the same market forces that hardware manufacturers in computers and electronics deal with as an everyday reality?
I'm only asking because it just seems to me that ISPs today are doing their own private form of "government" regulation, where their collectivistic trade group acts as boss over the customer. Now, I understand that improving any infrastructure is a costly venture, but they (the ISPs that are whining the most) need to get a grip and accept that they will have to charge more for the floor consumption which is rising, and stop trying to find scape goats like illegal P2P to make up for their lack of willingness to do as all good businesses (maintain product/service quality). Maybe I'm old fashioned, but the market free or otherwise works both ways.
1) Set a price ($1 a gig, minimum $50 a month).
2) Allow competition from providers in your area.
3) Observe the speed/bandwidth increase since it is being paid for.
4) Then observe the price drop as competition brings it down.
Without competition, you can't have this and will exceed your bandwidth eventually.
She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
These issues are complex, but going by the article summary I'm not sure we're all on the same page.
It sounded (to me) like they're looking for ways to maintain internet traffic, but help alleviate some of the costs of that traffic by using caches. Just because you pledge to allow certain levels of users access, it doesn't mean you have to provide them with that functionality in the MOST expensive way possible.
If they want to brain storm on ways to improve the means, I say have at it.
Also I see nothing wrong with having certain users paying a higher fee for using a higher percetange of the system. It doesn't make any sense for somebody that likes to browse html at broadband speeds to be placed in the same category as a differnt person that likes to download 2-3 new dvd-quality movies a day.
The average NON-P2P user would probably accept a rate structure based on transferred gigabytes. The worst abusers could be reduced (but no need to stop them completely) just by making their fun cost more. MEANWHILE, some of the profits generated by that should be plowed into expanding the infrastructure. Then the rate structure can be reduced a bit, encouraging more people to do P2P (or do more P2P) and pay more for the extra gigs transferred...and the cycle can continue, until the infrastructure is basically more than capable of handling any likely load, and the amount people pay ends up being only a little more than nowadays (not counting inflation).
So by that I have the legal right to run a server and I can tell my ISP to fuck off and die?
Still waiting on Serviscope_minor to wake up to fucking reality and realize that Jessica Price isn't going to fuck him.
at the 2 minute mark of using iChat for a video conference, my bandwidth from Comcast in Houston gets throttled to less than dial-up speeds, effectively making iChat useless.
After dealing with that for a few months I finally tracked down a preference in iChat to limit bandwidth useage, and if I set it to 100 kbps the throttling doesn't occur, but then 4-way video calls don't work well.
Comcast is the only broadband choice where I live. I have Verizon for my phone service, but they don't offer DSL or FiOS in my neighborhood.
It isn't about bandwidth. The ISPs have no equivalent problem with movies and other large content from Amazon, iTunes, Netflix and TV over internet. These usages are way huger than P2P traffic. But those bandwidth users are sanctioned and about control of what you see, how you see and under what conditions.
It isn't about efficiency. P2P technologies for downloads properly done are much more efficient.
It isn't about pirating. If it was they wouldn't be threatening an entire type of internet technology. You don't threaten and choke a technology because of the way some people use it.
No, it is about one and only one thing. It is about pushing a mass of consumer and few producer model. It is about control. It is about denying freedom and innovation. Today almost all internet accounts are not suitable for true peering. They don't have static IPs. IPV6 is stalled. I don't think it is an accident. The existing elites fear massive full two-way participation by anyone and everyone.
If, as seems likely, the ISPs, supported by governments and organitions like the RIAA, strangle the net as we known it - what can we do?
I have a mesh router, and so do a couple of my neighbours. We have them on our roofs. We share our iTunes libraries and other stuff over them. They're fast - very fast. Of course, we're reliant on our ISPs for email and WAN access, but if *enough* people did what we were doing, what could happen? A cultural shift would certainly be needed, but if we could re-create the freedoms we currently enjoy on the ISP-controlled fixed-line internet ... could that be the light at the end of this tunnel?
"And the meaning of words; when they cease to function; when will it start worrying you?"
Many ISPs in Australia already provide P2P caches for popular content.
Make P2P protocols favour closer peers over those further away.
I'm quite happy with my unlimited service. After taking one ISP's (almost) top 8MB package and quickly (within days) getting cut off for overuse, I switched to a UK ISP (entanet reseller) that offers a truly unlimited connection at 2MB, albeit for a *little* more than usual. I know they mean it, because their other packages list transfer limits like 320GB per month off peak, and this one simply says n/a under those columns. Just in case, I saved a copy of the package comparison page though.
You CAN still get a decent product, if you don't accept the B.S. products and keep looking.
We recently pleasure of telling both comcast AND verizon to f*ck off as we also have RCN in our area. Not only are they cheaper, but download speeds have are about 3x faster in some cases.
What comcast hasn't admitted is that they apparently throttle ALL downloads: I could only ever get about 750 KB/s when downloading large files, whereas the same files from the same sites (ftp's of linux distro ISO's from university servers) download at roughly 2400 KB/s via RCN. Ping times are basically the same. I always suspected this was happening and it was the first thing tested when we switched.
Another difference is the telephone service: comcast and verizon both use VOIP, verizon even disconnects your POTS wire even if you dont want them to. With RCN we get plain old POTS which is often the only thing working in a blackout.
Screw comcast and their "network management", screw verizon and their overpriced FIOS. RCN kicks their asses. THIS is free market competition in action.
I have mod points. The reign of terror begins now.
There's no good and much evil that will come from ISP caches. Technically, P2P is a local cache powered by your neighbors. An "official" node created by your ISP would just be another neighbor but one you should not trust. Basically, they will be deploying a better Media Defender network. The ISPs talking about this stuff are the same ISPs that block ports and have been sending reset packets for P2P. They should trusted to do more of the same.
It would be better to open the public servitude and spectrum to real competition than to grant ISPs more power over us. To turn their own goofey argument around, a network that can be saturated by less than 5% of it's users is completely inadequate. It is obvious that there is big money to be made but those with monopoly grants would rather partner with big publishers.
There is an interesting new "ISP" that provides guarantees network neutrality as a service. The service also has a bittorrent web interface. I've been using both for about week, and personally I really like the service. I'm in the dorms where we can't really play games as we are blocked by a firewall, but the Zercurity service gets around this issue. Anyways you guys should check it out. http://www.zercurity.com/
It's time that everyone who is about to get into a contract with an ISP tells them directly upfront: I am going to be a heavy P2P user. You will take this into account right now and will either turn me down as a customer or offer to me some form of service that will support my activity and I want it in writing in my contract that I can actually USE all of my bandwidth and capacity and you will NOT interfere with my usage. I want it in my contract signed by you.
That is what should be done, either they will accept you as a customer on your terms or you shouldn't be their customer.
You can't handle the truth.
bullshit. What ISPs need to do, is to stop lying to their customers.
As a lot of people here have allready mentioned, they advertise internet access subscriptions
with guaranteed speeds, unlimited access, guaranteed uptime, and so on.
And then they have the balls to whine when some users actually use the features *as is was advertised*.
I mean, come on. What a bunch of fucking hypocrites.
If your hardware/infrastructure can't handle the bandwidth or the number of connections you advertise,
then don't offer the service. It's like if a car rental company had 100 customers on a day-to-day basis, but only 4 cars to lend out. It's hilarious.
What is RCN?
Lodragan Draoidh
The more you explain it, the more I don't understand it. - Mark Twain
http://www.justfuckinggoogleit.com/
I have mod points. The reign of terror begins now.