Why the Olympics Didn't Melt the Internet
perlow tips his blog entry over at ZDNet on why the Internet didn't melt when millions of users streamed 480i video for a week. The short answer is Limelight Networks of Tempe, Arizona. "[W]hy the Internet didn't 'melt' is quite simple — [Limelight is] completely 'off the cloud.' In other words, unlike Akamai and similar content caching providers, their system isn't deployed over the public Internet... Limelight has partnered with over 800 broadband Internet providers worldwide... so that the content is either co-located in the same facility as your ISP's main communications infrastructure, or it leases a dedicated Optical Carrier line so that it actually appears as part of your ISP's internal network. In most cases, you're never even leaving your Tier 1 provider to get the video."
Comment removed based on user account deletion
Fuck. I haven't watched the Olympics at all because I didn't have access to a tv (or a tivo). But for a change, the networks got their asses in order and actually put decent streaming video up? Now you tell me!
If the general cloud does not also support high-bandwidth content viewing, the pipe providers (cable cos) will grab our throats and shake us down for money.
This trend ought to be resisted, by net neutrality legislation or just more peer to peer innovation.
Where are we going and why are we in a handbasket?
I'm on a bandwidth cap you insensitive clo(u)d!
GAAH! MY PRINTER IS ON FIRE!!! PUT IT OUT! PUT IT OUT!
I kind of wish the internet HAD melted. Not only would that have made a cool youtube video, but I waste too much time on the internet.
Come to think of it, I wouldn't have been able to view the youtube video then.
Also come to think of it, I'm wasting time on the internet right now.
Because of the fractal shape of IP traffic, until some time ago, the only solution was to over dimension the trunk capacity, now, a lot of new techniques where developed to properly dimension and forward data packets.
We may have a lot of data, but we have also more efficient ways to deliver it.
Math is beautiful... e^(pi*i)+1=0
Other than watercooler chat about "that swimmer kid", this has to be the least watched Olympics ever. China got the big FAIL on this one.
I want to delete my account but Slashdot doesn't allow it.
... resolves them as a "hostile" IP range. How interesting and (Alanis) ironic; someone that PGLabs views as "hostile" managed to distribute a high content of data seamlessly over the internet.
Why do I M2 everything negatively?
I thought it was because nobody actually cares enough to watch.
Ummm...I run XP and had no problems at all.
Maybe nobody was watching:
Tom Steinert-Threlkeld has a great rundown of the numbers behind this weekend's Olympic coverage. The highest day of coverage was on August 10th and it saw about 3.42 million video streams with 66.7 million page views and an average time spent on the site of 15 minutes. Pretty good numbers but as the BTL piece notes, that's only about 2% of a typical YouTube day. So it didn't exactly take the world by storm.
reference
Let me get this straight. Olympics content is getting special treatment due to commercial deals between the Olympics Committee, Limelight Networks, and a bunch of ISPs?
How does this bode for Net Neutrality?
"In prison you just have to shut your eyes and take it. Here you have to shut your eyes and give it."
"cloud" in reference to the internet he will he recieve a digital kick in the balls.
Fuck "clouds" and "Web2.0".
(But fuck clouds more)
In a manner of speaking the entire Internet is a cloud of computers.
AAAARRGGHH!
[whimper]
A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
NBCOlympics.com doesn't support linux for their videos. That's why the internet didn't melt: linux users can't watch.
no, I don't have a sig
I work for an ISP in Australia, we and a number of other local ISPs have local Akamai clusters. I haven't RTFA, mainly because if the summary isn't right, then the article probably isn't right either. It is mutually beneficial for content providers and ISPs to host content locally. For the content provider, they have more content distribution points, which is a selling point to use with their customers. For the ISP, it shifts typically fairly large amounts and "types" of traffic off of their Internet transit links, saving them money.
The Internet's nature is peer to peer - 20050301_cs_profs.pdf
Because our esteemed broadcaster, Channel 7, decided that it wouldn't stream anything of note at all online live.... at all.
Rather than, oh, I don't know, streaming what was being shown on tv onto the web (with ads and all, hence just the damn same revenue possibility, only with more viewers), they decided to occasionally stream some match that no-one was actually interested in at all, while they showed the 'good stuff' on tv. Which sucked, because in Australia most of the good stuff is happening while we're at work.
Except, well, channel seven's coverage has been ABYSMAL.
They:
* Spend half their time showing recaps and highlights of stuff that's already happened instead of showing things that are ACTUALLY ON RIGHT NOW
* Spend a sizeable chunk of their time broadcasting Australian Rules Football matches instead of the Olympics! For god sakes! I'm sure the footy fans can live without a bloody live football match during the Olympics... show the games when the Olympics are not happening RIGHT NOW!
* Spend a huge amount of time advertising all the shows we don't want to watch on their channel that will be on after the olympics, including one horrendously insulting one where they show some Olympic gold moment, then a bit from one of their shows, then an olympic moment, then one of their shows, all the while with soaring music and a voice over being overly earnest. Trying to suggest that they are reaching for gold, and doing their personal best and trying to compare themselves to Olympic athelets when showing Australia's next Top Model is, frankly disgusting.
* Then when they do show anything live, they seem to like showing heats and almost entire matches of deciding games of hockey or the like rather than showing finals of things that are happening RIGHT NOW.
Urgh, the coverage of the games in Australia this year has been downright pathetic, and I hope Channel 7 gets a downturn rather than an upturn in their ratings to punish them for treating them with the utter contempt they have.
The Olympics, it seems, is not without a sense of irony.
I'm not a prophet or a stone-age man,
I'm just a mortal with potential of a super man.
The website said that it was Vista only, on the main page when I checked, even if the stream worked fine on every platform, a lot of people would have seen that and not bothered going any further
Not sure how big you have to be, but if you are of sufficient size, Akamai will approach you. They did to the university where I work. Their deal was simple: They cover all the costs, you put their computers in your datacentre. Basically the provide a number of cache engine computers and a switch to connect them to. You then mess with your routing so that traffic prefers those over their central site.
It's win-win. It costs you nothing other than some staff time, reduces your bandwidth usage (we knocked off an average of like 5mbps) and increases the speeds your users see. They of course also get the benefit of reduced bandwidth usage.
I'm sure they don't do it for every tiny ISP out there, but you you are of reasonable size (may be if you have your own ASN), expect Akamai to take notice and come offering cache engines.
Neither could most Macintosh users. Silverlight 2 only supports intel-based Macs. It won't run on any of the 3 Macs or 2 PCs I have at home.
1. Timezones: The majority of content was encoded outside of the timezone for North America where the traffic was targeted so there was a huge opportunity to store and forward the content, in this case on limelight although it could have been handled by any of the major CDNs such as Akamai or Highwinds
2. I think there was a lot of last second optimizations done at the ISPs to make sure that fingers didn't point at them.
the original article was really speaking to the live streams which cannot be cached beyond a few seconds. Lets pull up the statistics.
http://nbcumv.com/release_detail.nbc/sports-20080814000000-olympicsontrackto.html
22 million streams served, 4 million of which were live streams, and additional 3 million stream served via the mobile platform and other VOD outlets.
Its going to break a lot of records. But i think that the original article and the OP here missed the point totally. If an event of this magnitude can go off with hardly a hitch, then why is it exactly that we need (the ISPs need) traffic shaping, bandwidth caps, and throttling? The ISPs among others have been saying for years that the internet is going to melt under the load of video, and using it as an excuse to add these technologies. The article on ZDnet asks the question.. is it really and we will find out in a few days (article was prior to the olympics). The real question remains that if 22 million videos at an average of 20 minutes per video and an average bitrate of 700kb weren't enough (3.5Million hours of content) in ADDITION to whatever people are doing everyday then 'why do we need traffic shaping and bandwidth management?'
sure, when you add the ?sort=gold it matches the other sites, however if you just go to http://stats.cbc.ca/olympics_medals.asp it sorts by total medal count by default, which is what NBC is doing.
-- "Freedom is the right of all sentient beings" -Optimus Prime
Obviously MS has an in with msNBC but the choice to force the use of a relatively uncommon 'Flash wannabe' is close to Vista marketing tactics.
If given a choice any web designer would choose Flash or just go straight for wmv/mpg/avi. The only reason to choose an unadopted distribution method is because of the arrogance of the distributor.
You don't seem to understand. The Internet data isn't carried by cars in the trunk. It is a series of tubes. It can only go so fast in the tubes, kind of like how the water in your sink won't come out any faster. Unless you install pumps on your tubes, but then it may pump faster than you can fill it!
We are one consciousness experiencing itself subjectively. Back to you with the weather, Bob!
That's why the internet didn't melt: linux users can't watch.
Funny, but the real reason it didn't melt is because they refuse to stream video across international boundaries so most of the world cannot access it. Living in Canada my wife cannot access the NBC videos and I cannot access the BBC videos. Given the UK's fantastic performance so far this Olympics is it incredibly frustrating to have to read about it or to catch the odd event on CBC - who actually are very good at covering non-Canadian centric events but obviously don't give foreign medal wins top billing so they are hard to catch unless you watch them live.
Given that the Olympic ideal is bringing the world together perhaps they might like to extend that to web video coverage and allow all of us to watch our home countries athletes wherever we are in the world instead of going out of their way to implement technological barriers to obstruct this?
Nobody was. This is an ad for Limelight.
Karma: Incomprehensible (Mostly affected by posting at +5, reading at -1, and metamoderating everything unfair.)
Really? Almost 2/3rds of the people in the world watched the opening ceremony? I appreciate that the Wikipedia article cites their source, but the article it quotes doesn't give any metric for their estimation.
I can't believe that between people who couldn't watch it, people who didn't want to watch it, and people who just didn't despite urge and ability, that 4 billion people still caught it.
Akamai does the exact same thing. Limelight is nothing special. The technique is the same. Any CDN worth its salt will have boxes colocated with major ISPs -- the more, the better.
Furthermore, why didn't it melt the internet ? Oh, that's easy. The Olympics streamed a couple million streams, total. This, in the grand scheme of things, is a nice bit of engineering, but nothing special. YouTube does more traffic than the olympics did in a week, in a day. I don't know what the bigger Apple keynotes got, but I'm sure it's up in those heights, too. I have a vague idea how much BitTorrent traffic there is on the net, and it dwarfs the olympic traffic by several orders of magnitude.
The Slashdot story is a marketing piece for LLNW. They have a decent product, to be sure, but they didn't do anything revolutionary here.
I"m sorry, but this is a puff piece about Limelight and nothing more. Limelight and Akamai are both "edge servers", Akamai has been putting cache boxes into ISPs for a long time. So Limelight put stream proxies into DSL providers head ends, it's not brain surgery; it's just making a business deal.