What Makes a Valid Benchmark?

An anonymous reader writes "Benchmarks can make a big difference if they are accurate in predicting performance. That's simple enough to describe; it's not nearly so simple to implement. Benchmarks can be an excellent tool for predicting performance and estimating requirements, but they also can be misleading, possibly catastrophically so. This article looks at benchmarks; the good, the bad and the ugly."

Comments

Re:doubling times are slow for Desktop Sytems

[NeilTheStupidHead]

Everyone knows that to get a real increase in performance, you need to paint the case red and put a big flame decal on the side. And fins, lots of fins to reduce drag.

The Best Benchmark of All

[TwilightSentry]

Why, everyone knows that the only valid benchmark is bogomips!!!