Slashdot Mirror
Bandwidth as Commodity
TwoSticks writes "This NY Times article (CT:required
annoying but free registration) and one at Yahoo talk about the Enron corporation working to set up a market for bandwidth, similar to the existing markets for buying and selling gas and electricity, but with transaction times in seconds. They claim this is essential for next generation network management, and I'm inclined to agree. "
Data Communications ran a really good, comprehensive article on this in this month's issue. It talks about the competitors in this market, strengths and weaknesses, and issues like fraud. I think Enron's PR department is just doing a better job than those of folks like arbinet, which is why they get credit for 'proposing' an idea that's already been implemented by at leat seven companies.
FYI, the article at Data.com says you can get a T1 from NY to LA for between $3900 and $4800 through the brokers, compared to three times that from major carriers.
Data Comm...gude sctuff.
Sure, a network of caching web proxy servers sounds OK. But there are issues...
would SlashDot be served well for users on @Home who sucked up the recent "reconfigure your browser" e-mail (i.e., to configure it to run againt @Home's proxy servers)? Sure, they seem to get things downloaded faster, but what about real content?
What about more nefarious things like "intelligent, filtering" proxy servers that sort of lose "bad", "inappropriate", etc. data?
Maybe if HTTP could be split, or maybe when things like CSS, etc., could allow two streams of download: one stream for graphics, the other for the text. But none of the Ad-driven sites will go for that because it'll mean it's too easy then to just ignore the graphics pipe...
Then there's service level agreements, what happens during a fiber cut... it all sounds like a nightmare. I think it is a neat idea, but the devil is in the details on this one.
But this may not be so good for the everday users. We're back on the cost-per-connection model that everyone loves to hate.
Every bandwidth consumer must be connected to a "pooling point" at both ends. A pooling point is a router or group of routers, and all bandwidth sold in the commodity market is between pooling points.
When the consumer reaches an agreement with a provider, both parties contact the pooling point operator and receive a /30 range of IP addresses. (That is, 4 of them.) If the bandwidth changes hands, the IP addresses are assigned to the party that receives it.
Then, when it's time to actually deliver the bandwidth, the routers must be configured to send traffic like this: (The last two bits are not actually specified in the document, just here as an example)
Consumer (source)
|
| local, "fixed" network (leased line?)
V
IP xxxxxxx00
San Jose pool
IP xxxxxxx01
|
| provider network
V
IP xxxxxxx10
Wash, DC. pool
IP xxxxxxx11
|
| local, "fixed" network
V
Consumer (destination)
So, what the bandwidth provider is selling is a promise to route traffic coming out of IP xxxx01 through IP xxxx10 (and the other way around, presumably), and the consumer must direct all traffic it wants to go on that link through the corresponding IP addresses. In other words, the consumer treats the "middle section" like a router with connections to both of his sites.
The problem I see with this is it makes routing tables huge. Every connection you sell needs a separate routing entry, since they're unlikely to be aggregateable. Plus, you'd have to either have a dedicated line between the two ends you provided, or do tunnelling, to guarantee that you treated the packets as the contract specified. (Otherwise, how can you distinguish between packets on your network from one contract and another? Remember, the original contractee can resell the bandwidth to anybody, so you don't know what the actual source and destination addresses are until the packets actually start flowing.) The bandwidth provider has to do routing based on the gateway address, not the source and destination.
First of all, I don't believe the infrastructure to buy and sell bandwidth is in place yet, at least for arbitrarily located machines. This is being worked on, for sure, but in general case I don't think you cannot buy or sell anything but what is essentially a leased line.
You're thinking of the n^2 possible connections between the sites on the network, and if you did need to connect them all, then yes, it wouldn't be feasible to trade bandwidth like a commodity. Fortunately, this is not the case.
Recall that the basic network topography is more or less hierarchical. (If you imagine it as a balanced binary tree, then the number of hops to connect two arbitrary machines is O(log n), where n is the number of nodes in the network, and there's a 50% chance that you will pass through the top level on any given connection.) So you can start with bandwidth trading on the routes between the big backbone sites and still reap much of the huge benefits of commodification -- after all, almost all traffic passes through the backbone eventually. (For those who've forgotten their econ: the benefit of an exchange is that it becomes much easier to match up buyers and sellers. Think how much aggravation and time would be saved if, say, houses could be bought and sold in minutes rather than weeks.)
And as the market matures, bandwidth trading will naturally spread to lower and lower levels of the network tree. I think it's unlikely that you or I will be trading bandwidth any time soon, though, any more than you or I invest in oil futures before heading to the gas station, but odds are that very soon our ISPs will.
Besides, there is a book (IIRC called "Virtual City", but I am not sure) that very well describes a similar system where you buy remote processing power in micro-chunks on the as-needed basis. The book is recommended, by the way, it explores the consequences of being able to transfer human consciousness into a piece of software.
You're thinking of Greg Egan's Permutation City, which is lots of fun if you're into AI, madness and Platonism. The ending is seriously weak, though.
Bandwidth bartering is a little silly today, given the high cost and low speed of residential local loops. But imagine how things will change if local loop / MAN connectivity (Metropolitan Area Network) starts resembling a LAN more than a WAN (fast, ubiquitous and cheap).
First off, it's likely that your average person will have a much higher local connectivity speed than they could expect to use for free over the WAN. This is not the case today- the Internet WAN is SO much faster than most people's MAN connection (their analog POTS modem) that there's a reasonable expectation that you can get a MAN speed connection between any two points on the Internet WAN without paying extra. This will not be the case as the multimegabit MAN becomes a reality. I can't expect to get a 2Mb/s connection from my home in Houston to my Dad in Chicago for "free".
However, both producers and consumers of content and network-based applications will want to be able to take advantage of that new MAN speed, and are likely to be willing to pay for it. This creates a market for guaranteed quality bandwidth from point to point. In the consumer market, this need is likely to be on-demand. If I decide I want to "rent" a streamed episode of the Simpsons from the Fox website, I'll be happy to pay a few extra cents for a guaranteed quality connection for the time I need it to watch the show. This won't negate the need an unguaranteed Internet like we have today, but will create the financial motivation to introduce guaranteed QOS either through separate parallel networks or some sort of traffic prioritization. I believe Enron is building a parallel network.
This dramatically changes the economics of the WAN bandwidth. Right now, both information distributors and consumers share the cost of WAN connectivity by paying to connect to an "upstream" Internet provider. The producer pays it directly, and the consumer pays it as part of their ISP bill. However, in a world where high quality bandwidth is requested and paid for on demand, this cost burden must shift to the producer entirely since it's the producer who is providing the on-demand service and will be able to pass the costs of that on-demand bandwidth to the end user directly (or subsidize it with advertising).
As the guaranteed QOS WAN bandwidth companies begin to compete for the business of the producers, it becomes critical that they be able to promise nearly universal reach; to be able to connect to as many consumers as possible. So they will be motivated to connect to as many of the local loop providers (local ISPs) as possible. This won't happen if the local loop provider has to pay for the WAN connections, so companies like Enron will offer connectivity to ISPs for free or even pay them for the right to reach their subscribers.
So in the new world, it works like this. A content or application distributor will connect to some sort of MAE-like bandwidth trading facility and buy WAN connectivity from the various WAN vendors located there. At first, the bandwidth units will be traded in large chunks, but it will become more and more granular as routing protocols evolve and dynamic financial-cost routing and accounting becomes more practical. The content producer will either charge the customer for the content and delivery bandwidth, or will pay for the services via advertising. The consumer's ISP will be paid by these WAN bandwidth companies for the privilege of reaching the consumer, who may end up paying nothing for their MAN connection (similar to the TV broadcast model).
Enron is betting the farm that this will happen. They're investing big bucks in building this huge fiber network in anticipation of providing this service, and they are already hooking up to local ISPs to make it possible.
At least, this is how I read it. What do y'all think?
IMHO, network admins are a completely different bunch of people than stock brokers. Who will do the dealing? Will network admins have to learn to phone with 3 people at once? Or will stock brokers learn about BGP4? Only time will tell...
Any technology which is distinguishable from magic is not sufficiently advanced.
This is one of my areas of economics . . .
.. .
There is fundamental differences between this and other commodities markets, even the newer ones such as electrical distribution. Electricty or gas, once you get it there, is the same regardless of where it came from. Bandwidth, on the other hand, is the "getting there" portion of this. Electricity *can* be moved from Boston to San Francisco, and so can gas, by bumping the gas along the way (though it's not the same in & out).
But bandwidth is always betwen A&B, and the only way to replace this is A->C->g->B. If you don't have ends at A & B, you just can't do it.
Some type of commoditization is certainly possible, but I've alwasy assumed it to be through a semi-intelligent part of the packet that chooses a path as it goes based on the cost& lag of each path
The chronological problem isn't to bad; it's been solved for electricity--you buy howevermany gigawatts for 2 pm on thursday, just as bandwidth would be. But there's those two loose ends of the path that need to be dealt with for bandwidth .
First of all, I don't believe the infrastructure to buy and sell bandwidth is in place yet, at least for arbitrarily located machines. This is being worked on, for sure, but in general case I don't think you cannot buy or sell anything but what is essentially a leased line.
Second, for this to work well, we need some kind of micropayments structure in place, plus reasonably intelligent software agents that would be able to go out onto the net and buy bandwidth for us when we need it. I don't see this happening in the near future. In five years we'll see.
Besides, there is a book (IIRC called "Virtual City", but I am not sure) that very well describes a similar system where you buy remote processing power in micro-chunks on the as-needed basis. The book is recommended, by the way, it explores the consequences of being able to transfer human consciousness into a piece of software.
Kaa
Kaa
Kaa's Law: In any sufficiently large group of people most are idiots.
Bandwidth as a tradable commodity has got to be
one of the most evil "Internet" money-grabs i've seen come down the pike since 1993. Think about it: when you add in a middle-man who make his living by trading what Party A creates and Party B consumes the price goes UP, not down. Look at any manufacturer-distributor-retailer model.
The next problem with this is that Fortune 1000 corps. are not going to accept a "Sorry, we couldn't buy (or sell you) any more bandwidth today" explanation from their ISP or net-broker. So you can bet corporations will be buying their own big chunks from their ISPs. Which means that only the little guys are going to feel the price difference here.
The third problem with this is that network packets are not natural gas. Natural gas is purchased by corporations like ENRON at THE SOURCE, and then transported to a refinery. This model works because a cubic foot of gas (or gallon of crude) has an intrinsic value. Your data is usually worthless, except to you and the person you want to read it.
This is a really good idea to support if you want to be paying 5 times what you are now to some talentless fool in Chicago or New York who's raking it in today because some other idiot put a back hoe through the piece of fiber your packets usually blink across. And if you want inferior service.
By making bandwidth a commodity that can be traded and bartered, we can start using it efficiently.
Currently, most (not all) web surfing could be adequately serviced by an extensive network of caching servers. Currently, most users get content directly from a site's main servers, which most likely is not the most efficient means of distributing data.
Also, compression techniques will improve as vendors attempt to be more miserly about the bandwidth they use - most web content could be compressed for transmission much more than it is now.
Compression and caching systems are but two technologies that would improve dramatically if we had to treat bandwidth as a commodity.
Look, there is no reason why most of us should pay anyone for bandwidth. That's just a myth perpetuated by telecoms companies.
:v)
All we need to do is turn the world into one big, anarchistic, wireless WAN and run it by the people, for the people.
See http://www.indranet.co.nz for an 11Mbit system currently trialing in New Zealand and Freenet on http://www.dcs.ed.ac.uk/~iic/4yp/
The sooner people get off their arses and organise this, the sooner we'll be free of the complexities of ISPs, large IP bills, government censorship and dependence on telcos. All it needs is for someone to make an affordable comms link that will work across a road, and to make the design open source. Let's face it; that shouldn't cost more than a modem does now.
Vik
PS If you have such a device LET ME KNOW!
The enron.net web site has a white paper, too, but you need to register to download it.
Yes, but in the end the world simply isn't that great and simple a place.
Here in Europe, where the telecom companies have been largely unchallenged (the introduction of competition is pretty much a farce) and unregulated, and we have the high metered local phone calls, they are already introducing prices per megabyte transferred on the new DSL and Cable modem services so as not to make them a cheap option to metered modems and isdn. The prices are ridiculous (try 5.5 cents per megabyte on a 2 mb/s line), but have to be so that they won't cost less much less than the phone call for joe-smoe-surfer-the-web.
In America, you have to opposite situation, where because you have never been metered (well, not since the aol days anyways), and the companies are therefore offering DSL and cable at flat rates. Flat rates for lines of 2 megabit/s and above are just as ridiculous as cited Euro numbers however, it just won't hold.
I see the bandwidth problem amounting to a giant pyramid game, where everyone just wants more and more and without paying, and it is great for a while, but then suddenly you reach the threshold, and the whole shit comes falling down on your head.
The Internet's bandwidth needs to be a commodity so people begin realizing its worth, whatever it may be.