Slashdot Mirror

← Back to Stories (view on slashdot.org)

Futuremark Delists Samsung and HTC Android Devices for Cheating 3DMark

Posted by Unknown on from the serious-bar-charts-people dept.

MojoKid writes "Benchmarks are serious business. Buying decisions are often made based on how well a product scores, which is why the press and analysts spend so much time putting new gadgets through their paces. However, benchmarks are only meaningful when there's a level playing field, and when companies try to 'game' the business of benchmarking, it's not only a form of cheating, it also bamboozles potential buyers who (rightfully) assume the numbers are supposed mean something. 3D graphics benchmark software developer Futuremark just 'delisted' a bunch of devices from its 3DMark benchmark results database because it suspects foul play is at hand. Of the devices listed, it appears Samsung and HTC in particular are indirectly being accused of cheating 3DMark for mobile devices. Delisted devices are stripped of their rank and scores. Futuremark didn't elaborate on which specific rule(s) these devices broke, but a look at the company's benchmarking policies reveals that hardware makers aren't allowed to make optimizations specific to 3DMark, nor are platforms allowed to detect the launch of the benchmark executable unless it's needed to enable multi-GPU and/or there's a known conflict that would prevent it from running."

1 of 188 comments (clear)

  1. Here's the RDF at work. by Anonymous Coward · · Score: 5, Insightful

    When Apple brought out Retina Display, that was 100% FAN BLOODY TASTIC according to Apple fans. Absolutely the best thing EVAR, and PROOF Apple are "innovative" by making displays finer in resolution than any other smartphone.

    Nokia didn't count, since they were ~12ppi lower resolution! SHUT UP!

    But now resolution is higher than Retina Display, higher resolution and better pixel count is BAD. Which, yet again, PROVES Apple are BEST EVAR because they don't waste time trying to get uselessly higher resolutions!

    7" tablets were too small when the iPad was only 10".

    But when the iPad mini comes out at 7", it's the best size for many many tasks!

    Phones were too big if they had a 4.3" screen. Until Apple brought out a bigger screen, then they had many uses!

    And so on.