BBC on Website Slow Downs
HiveMaster writes "The BBC is carrying a report about the impact on websites as people try to get news regarding the war in Iraq. It talks of a report from Keynote Systems, which tests the reponsiveness of websites, which shows that the BBC news site has shown a fourfold increase in response times. However, Government sites in both the US and the UK are being hit, with the US Army site taking over 80 seconds to load at peak times." Also, here is a press release this. You can also read My journal where I've talked quite a bit about what Slashdot has done in preperation for traffic bursts.
Curiously enough, Pravda also has a story on the subject.
Comment removed based on user account deletion
They run the whole thing off of a Sun Blade 500MHz with 2GB RAM.
Pretty cool actually.
Let's see. Loading the news.bbc.co.uk from Western Canada, right... now!
:)
10 seconds to render the whole page. OK, that's been significantly faster than I've been experiencing the last few days, It's been about 30-40 seconds in some instances in the past several days.
Do try the low graphics version of the BBC, it loads almost instantly, and you can click on "Low Graphics" version while the rest of the page is trying to load.
CNN does seem significantly better than years ago during major events. They must have tackling the planetary event slashdot effect thing down. But then again, I voted "Any non-us venue" on the poll..
http://www.gulufuture.com/news/kate_adie030310.htm
ISTR that the NYT websute switched to a very graphics-light format in 11 September 2001, in order to cope with the mass traffic. Slashdot is already mostly text, but if necessary it could be lightened a bit. But I imagine the main load is CPU and memory, handling all those database queries and updates, rather than bandwidth; I don't see an easy way of dealing with that short of adding a few more machines. Imagine a... No, I won't :-)
Real Daleks don't climb stairs - they level the building.
According this, the average web page is around 90 Kb. Google is a little over 10 Kb.
If you can read this, thank an english teacher.
I've always wondered, why is /. immune to the /. effect anyway?
Iraq's website, www.uruklink.net, has been inaccessible quite often.. during the few occassions it has been online, it has been terribly slow.
nope, but an interesting side effect could probably be more ad impressions and as a result, more revenue. honestly, /. could easily get more advertising impressions if they started temporarily mirroring the content from the stories posted on slashdot. everyone knows about the slashdot effect. why not use that in a manner where both slashdot and slashdot readers benefit?
-- Kircle
Such are the side effects of outrageously high demand for their news content, I guess.
My boss came to me around the 13th asking what were we gonna do on the 17th if we went to war...basically, how are mission critical apps gonna communicate over our school's internet connection if everyone is streaming video of war coverage?
:)
Luckily Shock and Awe started after most of our classes were done for the week and Thurs wasn't that bad. I guess with all the Kazaa traffic, streaming web didn't stand a chance
Can't wait for that packetshaper to get here.
Comment removed based on user account deletion
Slashdot got slashdotted too: Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, pater@slashdot.org and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Apache/1.3.26 Server at slashdot.org Port 80
I'm not sure if this counts as /.'ing, but /. is quite frequently broken. It forgets that you are logged in, unable to verify your cookie I assume, and sometimes you can't even view articles, they just take you to the homepage.
Then the next day it all works again (I only check a couple of times a day, so to be fair, it could have been fixed the same day)
Also can have a mirror server on other bandwidth that rejects connections that don't come through a known caching proxy server. I like to reject traffic from people this way if my load becomes to high. That way anyone that still wants to access my server can use IRCache.net or some other major proxy servers. Any decent ISP should also offer such a proxy their users can use.
At what price learning? At what cost wisdom? The price is a man's peace of mind, and the cost is his life.
Thus without Hitler's deranged ambitions, the Third Reich might really have lasted a thousand years. Similarly, if Stalin had kept his genocidal ambitions in check, the Soviet Union might have continued to enjoy its initial popularity among sections of the West and at home.
With these examples in mind, the leader has been eliminated as a factor in U.S. politics. George W. Bush's very nullity as a politician throws into relief the fact that the United States has long been governed, not by its people, but by interests that are happy to remain largely anonymous, do not rely on individuals for their hold on power, and are recognizable in public mainly by a soothing corporate blue.
Americans often seem baffled that others fail to admire their system of government. They know after all that in the United States there exists a lively culture of debate, where the whole lunatic spectrum of opinion can find a platform of one kind or another (though at the same time the difference between the political parties it is actually possible to elect is vanishingly small) ...
They have a vibrant and largely unchecked artistic community. They have the First Amendment ...
The reason for all this is that the new totalitarianism has learned a second lesson from its heavy-handed predecessors. If artists and intellectuals were able to do precisely nothing about Hitler or Stalin or any of the legion of tin-pot dictators around the world, it follows that you might as well have freedom of expression.
In the new totalitarian system, people can say whatever they like, and it makes absolutely no difference.
The impending war on Iraq is only one example among many of a supposedly sovereign public completely powerless in the face of a government bent on a course of action ...
The most important lesson to the new totalitarianism, then, comes from ancient Rome, and is simply that people sufficiently supplied with bread and games will put up with anything.
LibBT: BitTorrent for C - small - fast - clean (Now Versio
Actually, I heard that story on NPR (Cheney/Haliburton/Brown & Root getting govt. contracts) while I was driving home from work last week, so it's not absolutely unreported in the States.
Comment removed based on user account deletion
That reminds me. The new RealVideo codecs have been out for awhile, and there is a noticable difference.
If you want to see oodles of stats about the BBC's own website, take a gander at http://support.bbc.co.uk/support
:-)
Lots of mrtg graphs, response times, uptimes etc. Even a webcam of the support team
IF your data can be cached. Same thing with slashdot, the webpage is rendered depending on your karma, and account. Cache wont work, when its re-rendered for each person. (It should work for all the AC's loading the same page thou...)
We use cheap netra t1's in a cluster behind load balancers, but our bandwidth usage per user is very small (1-5K) compared to Slashdot 50-100K page pulls.
Strange how people design networks and server configurations without knowing the purpose. This is why when a product is handed off to the customer, they customers end up redesignning the architecture. Its not a cookie cutter world people...
-
You know the world's gone mad when the best rapper is a white guy, the best golfer is a black guy, the Swiss hold the America's Cup, France is accusing the USA of arrogance and the Germans don't want to go to war.
I think the point isn't that Bush has started a war just so that Halliburton can get a load of money, it's about why Halliburton got the contract instead of other companies - are they really the best or did they just get it as a favour for Cheney?
We host a fair few (60 or so) financial-orientated websites, with an average query-level of some 10-20 queries per second on the database supporting those sites.
:-)
:-( I prefer the idea of hitting a limit in Apache that triggers a script that limits access (dynamic firewalls)
:-)
We have an 8-way cluster of machines to support this (way-overkill for the most part) but recently, we've been (almost) hitting limits... The apache service has logged peaks of 1000 connections/second, with the DB query-level going as high as 70,000/second....
I'm actually fairly happy that the system can more-or-less cope with the load, but nonetheless, I want to make sure (or at least as-sure-as-possible) that we can't be easily DOS'd, so this weekend I'll be writing an Apache module to monitor the number-of-connections-per-second on an IP-by-IP basis, and take a decision to run a script depending on thresholds....
I think stateful firewalls could probably manage it but for historical reasons we're stuck with what we have, and having apache call a bandwidth-limiting script on an IP address that's registered 5000 hits in the last minute (for example) seems reasonable
If there's something that can do this already, I'd like to know - I've found (ntal), but running a script per packet doesn't appeal
Ideas gratefully received
Simon
Physicists get Hadrons!