Samsung Caught Boosting Galaxy S4 Benchmarks
A recent forum post at Beyond3D made an interesting claim: that the Samsung Galaxy S4's GPU ran at 532 MHz for certain whitelisted benchmark applications, and at 480 MHz for everything else. The folks at AnandTech decided to investigate and found out that the phone does indeed let its GPU run at a higher frequency when particular benchmark software is running. They found a similar oddity with the CPU — it wasn't restricted for other apps, but it was forced to run at max speed during benchmarks. Then they decided to look for direct evidence that this was intentional.
"Poking around I came across the application changing the DVFS behavior to allow these frequency changes – TwDVFSApp.apk. Opening the file in a hex editor and looking at strings inside (or just running strings on the .odex file) pointed at what appeared to be hard coded profiles/exceptions for certain applications. The string 'BenchmarkBooster' is a particularly telling one. ... Quadrant standard, advanced, and professional, linpack (free, not paid), Benchmark Pi, and AnTuTu are all called out specifically. Nothing for GLBenchmark 2.5.1 though, despite its similar behavior."
Newsflash. Apple do exactly the same thing, as does every other manufacturer.
When every sixth topic on Slashdot is about the evils and perils of Government Regulation, why are we constantly seeing examples of companies misleading, blatantly lying, to their customers? We need more teeth on consumer regulation. I bought my Samsung Galaxy S4 on certain assumptions of power. Remember Hyundai blatantly lying about their fuel numbers for half a decade? They were doled out a punishment, but the boost in sales due to in part by their chain-wide efficiency offset any net losses.
Slashdot readers will remember this, and probably choose an S4 when faced with so few choices. Samsung sees no benefit to not skewing numbers in the future.
They are liars and no self-respecting nerd should buy a phone from Samsung to boycott actions like this.
Sony has betrayed consumers more than almost any Tech company can name. They're universally hated across all spectrum of Slashdot users.
Yet they're largely poised to win the next "Console War" and they're still one of the premier names in the home entertainment business.
Companies have NOTHING to fear from consumer retaliation. Consumers are by and large stupid, with an extremely short term memory.
I remember old articles where ATI and Nvidia were both caught out gaming benchmarks, in one case by embedding particular benchmark game strings in their driver, and short cutting a few algorithms to boost their score.
My rights don't need management.
There seems to be an official answer from Samsung here: http://samsungtomorrow.com/4676
It's in Korean, but here is the translation, provided by sammobile.com:
"Under ordinary conditions, the Galaxy S4 has been designed to allow a maximum GPU frequency of 533MHz. However, the maximum GPU frequency is lowered to 480MHz for certain gaming apps that may cause an overload, when they are used for a prolonged period of time in full-screen mode. Meanwhile, a maximum GPU frequency of 533MHz is applicable for running apps that are usually used in full-screen mode, such as the S Browser, Gallery, Camera, Video Player, and certain benchmarking apps, which also demand substantial performance.
The maximum GPU frequencies for the Galaxy S4 have been varied to provide optimal user experience for our customers, and were not intended to improve certain benchmark results.
We remain committed to providing our customers with the best possible user experience."
Waiting for the Samsung fandroids to wake up and start explaining why this isn't cheating, it's optimizing, and even if it is cheating it's Apple's fault.
Shows how far behind Samsung is in terms of hardware engineering. They stack the deck and still can't touch a 9 month old phone. Both browser performance and gaming performance, the 2 most stressful use cases on a smartphone, are way behind Apple.
http://images.anandtech.com/graphs/graph6914/54294.png
http://images.anandtech.com/graphs/graph6914/54296.png
http://images.anandtech.com/graphs/graph6914/54300.png
http://images.anandtech.com/graphs/graph6914/54298.png
http://images.anandtech.com/graphs/graph6914/54305.png
I don't think we need to celebrate benchmarking phones, period. This was one of those flamebait trolling things that happened in the PC era where people boasted how superficially fast their beloved shoebox was by putting $10k worth of equipment into and liquid cooling it just to get some high number result in 3D Mark or some other meaningless program.
We don't need this for phones.
Yes phones play games, yes phones are getting faster, but realize that phones and tablets are a HUGE step back from the PC era in terms of performance so benchmarking them means you may as well drag out your dusty Pentium era PC and start boasting about good its benchmark numbers are.
Also when 80% of the apps on the Android platform are unstable POS then I don't care about how fast they crash. Even Chrome quits unexpectedly repeatedly and this is by the company that makes the Android platform on their own Nexus brand devices.
I haven't thought of anything clever to put here, but then again most of you haven't either.
I not sure that is boosting, normal processing may be 480mhz, because that is what they need, does you computer clock always runs at top of its resources?
/Rant
Build a Man a Fire, and He'll Be Warm for a Day. Set a Man on Fire, and He'll Be Warm for the Rest of His Life.
I suppose the old car analogy now applies to phones too.
Excuse me, but please get off my Pennisetum Clandestinum, eh!
I always thought the point of a benchmark is to show what a device is capable. So if the "phone does indeed let its GPU run at a higher frequency when particular benchmark software is running", Its just showing what its capable of. Though I would definitely want to run benchmarks the whole day and see what happens.
Some of us learn from other people's mistakes and the rest of us have to be other people. -- Zig Ziglar
Is a time old tradition. Started by Oracle.
(This is an HTC device rather than Samsung) When I origionally stumbled on this thread I assumed yea yea cyanogen must be doing something wrong using a shit driver or not doing something quite right using a conspiracy theory as an excuse to blurt out a lazy response.
http://forum.cyanogenmod.com/topic/75172-why-is-cyanogenmod-htc-one-so-slow-6250-on-quadrant-standard-instead-12500/
I suspect that A benchmark manipulation is not limited to Samsung. B there is still something screwy going on in cyanogen and C we're going to find out pretty quickly what the truth is.
It's not overclocking, it's just that Samsung underclocks their phones to save battery and to stay within the specified thermal envelope.
Only the benchmarking apps run at full speed, because they're the only apps that need the full power of the phone at all times.
Other apps can't handle the full power of the Samsung ecosystem, thus Samsung protects them from the overwhelmingly high power coolness that is the Samsung platform.
So really, everything we do is in the best interest of our customer. We protect our customers from experiencing the full power of our phones to preserve their mental cohesiveness. Anything less would open a wormhole in the fabric of reality, and we wouldn't want that.
If the chips can benchmark at a speed but then de-clocked to be released to the public what is wrong with it? Every car maker been doing this for years when it come to Torque and Horse Power. The TQ and HP number are higher then if a person would take his/her to a dyno. But no one screams.
The other way to look at it... I can savelly overclock this phone to x speed.
... buys a mobile phone based on benchmark scores anyway? It's a god damn phone, not a gaming rig, server, graphics workstation, etc.
Nothing new here. Move along.
now we need to go OSS in diesel cars
It's not an argument. "Regulation" is a code word for power. Either the government holds this power, or private interests hold this power. There's no middle ground, due to the convexity of the slippery slope. It's either a firewall configured with a default "block all" or a default "pass all". Those are your two choices, 100% mutually exclusive.
Besides, inhabiting the middle ground involves the tedious art of knowing the difference, which is not what people with power enjoy doing.
It is not cheating - benchmark shows you how fast it runs on a particular device.
They've caught out NVidia AND AMD (At that time ATI) doing some of the same sorts of hyjinx with PC benchmarks in years prior.
Having said this, they paid DEARLY for having done the deeds in question. Can we say the same thing from Samsung?