Huawei cheating, mushing the lines at the benchmark test for efficiency of its top smartphones … and got delisted on 3DMark. read on!
Huawei very recently was caught optimizing some of its biggest smartphones to put up a better performance than what it really is worth. These phones are P20, P20 Pro, Nova 3 and the Honor Play.
On Tuesday, 4th of September, AnandTech discovered that Huawei P20 was programmed to maximize performance simply for operation on 3DMark, the popular benchmarking app.
In the early hours of today, the company, UL behind the operations of 3DMark released a press statement confirming that they had found this discrepancy that Huawei was indeed cheating and has delisted the P20 and the other three phones for the cheating behavior.
Naturally, phones are allowed to adjust performance based on workloads to allow for the different ways it will perform in different apps. But the Huawei took it a step further, they programmed or rather hard-coded peaks in performances simply to pass the benchmark app.
One of these was the fact that at the run of the benchmark app before now, the peak in performances was claimed by Huawei to be determined by AI. But according to UL,
Huawei said it was AI, but we found it wasn’t
Further Reading: How to save and boost the battery performance of your Tecno spark 2
The second test they performed using the internal version of 3DMark found that these phones performed so much worse, they were not even smart enough to identify high-performance demands on their own. This so far indicated that the benchmark score is not an exact reflection of how the phone would handle a typical app. As a measure of consequences, 3DMark delisted these phones from their leaderboard rankings and placed a note that “the phone’s manufacturer has not complied with UL benchmark rules.” Ultimately, it simply said the concept of Huawei cheating is so true.
Ironically the results of these benchmark tests do not mean so much to the general performances of these smartphones. One would ponder why taking the extra step? These benchmark results only really tell the performance of the phone under heavy stress like using gaming software. It would be worthy to note that several other smartphones company have been caught with this in the past such as Samsung in 2013
Further Reading: What would you do if you had no power for 4 days
In a press statement, however, Huawei admitted to this. According to the company ” it places user experience over benchmark scores as there is no direct connection between smartphone benchmarks and user experiences.”
We know this, but what we find it hard understanding is while taking the extra mile, why risk the company’s credibility. Huawei cheating could have been an avoidable issue.