Are Internet News Sites Ready for Major World News?

An anonymous reader asks: "Heading says it all really - are Internet news websites ready for the next big world event? news.bbc.co.uk already switches format under heavy load (not sure if this is automatic or not) and i'm sure some other sites do the same. But should a major world event take place in the coming months/years, the Internet is going to be the primary news source for many millions of people, particularly those without access to a quality television news service. How will / can it cope?"

Comments

In a word, no.

[FreeLinux]

No they can't cope. It's been proven already. Even giants like the BBC and CNN had several moments where they could not handle the load on September 11th.

I'm sure that they have taken steps to improve things in the future but, there is only so much that you can do, or at least do cost effectively. There is no substitute for hardware and bandwidth but, maintaining enough to support the entire planet at one critical moment in time, that may or may not come, is not cost effective.

When the time comes, the news sites will buckle under the load, just as the telephone system does. The best source for news, during times of disaster are television and more so, radio. Even in the most remote places, you can still get radio and with new satellite radio, you can get it anywhere.

September 11th

[sql*kitten]

Keynote have oublished a reporton the performance of major web sites on September 11th, 2001.

Of course, there's a lot of dark fibre around, so the capacity is there if it's really needed. Once the current recession is over, we can expect to go back to the days of massive overprovision and redundancy as content and bandwidth providers seek to build in capacity to handle peaks. What will really help is multicasting for video streams, and well-designed caches at ISPs.

Re:September 11th

[drdink]

As a SlashNET administrator, I appreciate the fact that people acknowledge and appreciate the efforts of our users to provide up to the minute news in times of crisis. We hope to continue doing this in the future as time dictates, and we've improved our ability to do so in the future as necessary.

The problem with the web is that it is graphics intensive. When you go to CNN, you have to download a ton of graphics, you have to initiate a new connection with the server on each request, etc. With IRC, you don't have any of the graphics and you don't have to reconnect to it in order to get updates 5 minutes later.

The history of IRC is pretty spotty. Most of the times it can be pretty lame and pointless, but it has always become a useful communications tool. I hope this practice continues.

How sites seem to cope now

[jht]

Ever since 9/11, I've noticed that the heavily-trafficked sites cope with sudden floods of hits by switching over to static pages with minimal graphics. The NY Times, for instance, did this when the AA flight went down in Queens last November. CNN's done it a couple of times as well.

When we're looking at scale, though, it's useful for us to remember that these sites can handle way more traffic than even the typical slashdotting can deliver. Most breaking major news can be handled by them with only a little bit of slowdown. It's only the 9/11-scale events that can really bring the news sites to their knees - so lets hope that we don't have to see anything that brings on a overload scenario for the big news sites.

The other thing to consider is that most of the news providers are still investing some money in their infrastructure - just less than before. It's very well possible that a 9/11-scale event might not hammer the servers the way they were hammered last year. A lot of web sysadmins learned valuable lessons that day that I'm sure have been applied since then.

Re:won't replace TV

[nicklott]

The BBC has its bandwidth graphs online here.

Sept 11 is just on the left of graph at the bottom. Interestingly a normal day's traffic is now greater than the sept 11th spike, maybe they could handle major news events.

(I can't think what the early april spike is, but the raised traffic in june/july is the world cup)

Streaming Media and Large Audiences

[ellbee]

I ran a major streaming media distribution net on 9/11. We saw a steady 75k - 100k simultaneous users (mostly audio) for the next several days as people used webcasts to get live news while at work. We had a few glitches as video streams were inserted by customers without warning us of the oncoming load, but they were mostly transient as we adjusted for capacity. At the edge we were seeing between two and four terabits/second being sent out, and could have turned up more if we needed it.

I've since built some even larger systems; I've no doubt that it's possible to scale Internet streaming media distribution to millions or even tens of millions of simultaneous viewers using today's technology and protocols.

ellbee