Slashdot Mirror

jackvalko asks: "Recently Keynote Systems began an upgrade of Transaction Perspective, one of their performance measuring products. The data collected is used by the Executive staff at the dotcom I work for as a means to evaluate our customer experience. Now that they are almost done, we've noticed a better than 40% reduction in response time of our site. While I'm happy that our performance 'looks' good, this major change has given us pause to question the statistical relevance of the data that is being collected and the somewhat arbitrary nature of performance metrics collection in general. And, of course, how we message all of this to upper management. So I put it to you, Slashdot! Do you find performance metrics relevant to your customer experience? How do you manage expectations and change to upper management? And, most importantly perhaps, are organizations that collect this data still relevant on The Internet as it exists today?"

jackvalko asks: "Recently Keynote Systems began an upgrade of Transaction Perspective, one of their performance measuring products. The data collected is used by the Executive staff at the dotcom I work for as a means to evaluate our customer experience. Now that they are almost done, we've noticed a better than 40% reduction in response time of our site. While I'm happy that our performance 'looks' good, this major change has given us pause to question the statistical relevance of the data that is being collected and the somewhat arbitrary nature of performance metrics collection in general. And, of course, how we message all of this to upper management. So I put it to you, Slashdot! Do you find performance metrics relevant to your customer experience? How do you manage expectations and change to upper management? And, most importantly perhaps, are organizations that collect this data still relevant on The Internet as it exists today?"

jackvalko asks: "Recently Keynote Systems began an upgrade of Transaction Perspective, one of their performance measuring products. The data collected is used by the Executive staff at the dotcom I work for as a means to evaluate our customer experience. Now that they are almost done, we've noticed a better than 40% reduction in response time of our site. While I'm happy that our performance 'looks' good, this major change has given us pause to question the statistical relevance of the data that is being collected and the somewhat arbitrary nature of performance metrics collection in general. And, of course, how we message all of this to upper management. So I put it to you, Slashdot! Do you find performance metrics relevant to your customer experience? How do you manage expectations and change to upper management? And, most importantly perhaps, are organizations that collect this data still relevant on The Internet as it exists today?"

Proudrooster writes "Keynote Systems Inc. made 154,000 VOIP calls during the months of May and June. In total they tested six VOIP providers and seven ISPs. Their conclusion was that VOIP isn't quite as robust as the public phone network due to dropped calls, lower audio quality, and latency (audio delay), but it is still pretty good. The worst VOIP provider had an availability of 94.8% (which isn't bad) and overall the reviewers were pleasantly surprised with the VOIP test results. Vonage ranked best for "most reliable" with 99.4% uptime, AT&T CallVantage ranked best for "audio clarity"." Personally I think 94.8% is pretty awful. I don't think 99.4% is very good either. But there is no doubt that audio quality is getting better. I only maintain my land line now for my HD Tivo to dial out from.

Proudrooster writes "Keynote Systems Inc. made 154,000 VOIP calls during the months of May and June. In total they tested six VOIP providers and seven ISPs. Their conclusion was that VOIP isn't quite as robust as the public phone network due to dropped calls, lower audio quality, and latency (audio delay), but it is still pretty good. The worst VOIP provider had an availability of 94.8% (which isn't bad) and overall the reviewers were pleasantly surprised with the VOIP test results. Vonage ranked best for "most reliable" with 99.4% uptime, AT&T CallVantage ranked best for "audio clarity"." Personally I think 94.8% is pretty awful. I don't think 99.4% is very good either. But there is no doubt that audio quality is getting better. I only maintain my land line now for my HD Tivo to dial out from.

An anonymous reader writes "Renesys (the people who previously brought you cool animated graphs of the US/Canada power outage has a new report out. It challenges the widely held belief that the Internet was largely unaffected by the power outage. Lots of important networks lost connectivity, including banks, hospitals, government organizations and investment funds. There's a cool appendix on the huge Italian power outage in September as well. They conclude that the Internet is not ready to be critical infrastructure."

An anonymous reader writes "Renesys (the people who previously brought you cool animated graphs of the US/Canada power outage has a new report out. It challenges the widely held belief that the Internet was largely unaffected by the power outage. Lots of important networks lost connectivity, including banks, hospitals, government organizations and investment funds. There's a cool appendix on the huge Italian power outage in September as well. They conclude that the Internet is not ready to be critical infrastructure."

HiveMaster writes "The BBC is carrying a report about the impact on websites as people try to get news regarding the war in Iraq. It talks of a report from Keynote Systems, which tests the reponsiveness of websites, which shows that the BBC news site has shown a fourfold increase in response times. However, Government sites in both the US and the UK are being hit, with the US Army site taking over 80 seconds to load at peak times." Also, here is a press release this. You can also read My journal where I've talked quite a bit about what Slashdot has done in preperation for traffic bursts.

Lovejoy writes "From a Reuters story: Keynote announced today that in its two-week, 26,000 message test-period 7.5% of its text messages never reached their destinations Ouch. I don't have SMS - Is this report consistent with your experience?"

This week's Slashdot interview guest, Ben Green, is director of Internet operations for Al Gore's presidential campaign. He's charged with making the algore2000 Web site as big, popular, and efficient as possible. Political campaigning on the Internet is new and still rather experimental in many ways. The point of this interview is not to boost (or diss) Al Gore or any other candidate, but to learn about the process of using the Internet as a political tool, which is of more long-term importance than any single election. One question per post, please. The complete Q&A session is scheduled to appear Friday.