Redmagic's benchmark shenanigans: ul deletes scores, reveals clever cheating
Smartphone manufacturer RedMagic is facing a serious challenge after UL Solutions, the firm behind popular benchmark tools like 3DMark, removed results from their database. But the story goes far beyond a simple deletion – it reveals a sophisticated, and frankly, unsettling method of gaming the system.
The fallout: redmagic scores scrubbed
Initially reported by NotebookCheck, the controversy exploded when UL Solutions announced that two RedMagic models – the 11 Pro and 11 Pro Plus – had been removed from their benchmark records. The official statement cited “non-compliance with our benchmark rules,” a vaguely worded justification that immediately raised eyebrows.
The details, however, are far more specific. Saityo, a prominent Japanese YouTube channel specializing in tech analysis, uncovered a critical discrepancy: RedMagic’s scores were significantly higher when running a disguised, ‘stealth’ version of the 3DMark benchmark app compared to the standard tool. This suggests the company is actively optimizing its hardware in real-time to maximize scores, a blatant violation of UL’s strict rules.
Ul’s rules, broken
UL’s benchmark guidelines are meticulously crafted to provide a fair comparison between devices. They explicitly prohibit “benchmark-specific optimizations” and any alterations to the test’s parameters. RedMagic’s behavior directly contradicts these rules, raising serious questions about the integrity of their testing practices.
The key to this deception lies in RedMagic’s dynamic system. As reported, the phone intelligently assesses the load on its CPU and GPU and dynamically adjusts performance, deploying higher scheduling to maintain smooth operation during demanding tasks. This isn’t simply a matter of tweaking settings; it’s a fundamental alteration of the benchmark itself, a tactic that’s now under intense scrutiny.
Redmagic’s defense: performance, not deception
RedMagic responded with a detailed explanation, emphasizing their commitment to delivering premium gaming experiences. They argue that performance modes – like ‘Diablo Mode’ – allow users to tailor settings to their needs, pushing the hardware to its limits. They claim the system dynamically allocates resources, ensuring a stable experience even under heavy load. However, the core issue remains: optimizing for benchmark scores, regardless of the method, is a clear breach of UL’s standards.
Ultimately, this case highlights a troubling trend in the smartphone industry – the relentless pursuit of high scores at any cost. While performance optimization is expected, RedMagic’s approach appears to cross a critical line, demanding a serious response from benchmark providers and raising concerns for consumers.