Android manufacturers are known to tout their flagship devices by showcasing raw performance compared to rivals and that’s completely fine, granted they don’t deliberately ‘tweak’ their firmware to bump clock frequencies, thus skewing benchmark results.
Samsung, HTC, Asus and others have all learnt their lesson when their handsets were caught red handed ‘cheating’ in various benchmark applications such as AnTuTu or Futuremark’s 3DMark. It however seems that a certain Chinese OEM isn’t quite happy with its latest flagship benchmark results, at least when put against competitors. – AnandTech noted several irregularities when benchmarking the Kirin 910T-powered Huawei Ascend P7.
The handset was found to react to 3DMark’s and GTXBench in such a way that the cpu governor was altered and the device thermal throttling limits raised in order to gain an edge on those benchmarks. In one particular instance the Ascend P7 A9 cores were being kept at a minimum of 1.7GHz instead of the average 1.3GHz. That 400MHz bump coupled with the fact that all four cores were being maxed out meant that the cheating handset managed to ramp up an increase of 15-30% in respective benchmarks.
Consequently Futuremark removed the Ascend P7 from their ‘best smartphone and tablet list’ as of their ground rule was broken.
The platform may not detect the launch of the benchmark executable. The platform must not…modify the usual functioning of the platform based on the detection of the benchmark.
This move will hopefully convince Huawei to stop optimizing or faking the raw performance of their devices.