Samsung Accused Of Benchmark Manipulation, Again

AH Samsung logo new 12

Samsung has landed in yet another benchmark manipulation controversy. This time, the company has been caught cheating on TV benchmarks. Multiple sources have confirmed some of its best TVs to be exaggerating colors and brightness in benchmark results. The S95B QD-OLED and the QN95B Neo OLED LCD are among the affected TVs.

YouTube channel HDTVTest first reported Samsung’s benchmark manipulation on the S95B QD-OLED TV in April. They found the device to be falsely reporting color accuracy and luminance during measurement. The same level of accuracy isn’t available to users with real content.

Following this report, FlatpanelsHD checked and confirmed the discrepancy in the benchmark results. Moreover, the publication also discovered similar behaviors with Samsung’s QN95B Neo OLED LCD. They further found that the TV momentarily boosts the peak brightness by up to a staggering 80 percent when a benchmark software is run. The peak brightness during these tests goes all the way up to 2300 nits, from just 1300 nits in normal usage.


According to the report, this is possible “because the power supply can send short bursts into the miniLED backlight”. However, the screen cannot sustain such high peak brightness without damaging pixels.

Samsung denies any wrongdoing

The new reports suggest that Samsung may have employed algorithms to identify benchmark platforms and artificially boost color accuracy, luminance, and peak brightness on its TVs to mislead users. HDTVTest and FlatpanelsHD could bypass that algorithm by using a non-standard window such as 9% during tests. The cheating algorithm focuses on the standard 10% window that reviewers, calibrators, and certification agencies usually use.

However, the company has something else to say. In a statement to FlatpanelsHD, it suggested the results shown on the standard 10% window are accurate. Instead, those on the non-standard window are inaccurate. It plans to fix the issue with a software update for the affected TVs.


“Samsung remains committed to relentless innovation to provide the best picture quality to our consumers,” the statement read. “To provide a more dynamic viewing experience for the consumers, Samsung will provide a software update that ensures consistent brightness of HDR contents across a wider range of window sizes beyond the industry standard.”

Samsung also separately released a statement to The Register denying any wrongdoing. “Samsung Electronics does not use any algorithm for the purpose of yielding specific test results,” it said.

Nonetheless, the latest allegations of benchmark manipulation come shortly after Samsung got out of the massive GOS (Game Optimizing Service) controversy. The company was artificially limiting the performance of its devices in the name of thermal management and power efficiency. Several of its devices were banned from benchmark platforms for this. The company CEO also issued a public apology over the matter. The Korean giant can’t seem to catch a break.