When DXOMARK first started evaluating smartphone camera image quality in 2012, the process was called DXOMARK Mobile, and the top camera was the Nokia 808 PureView, which scored 61. After five revisions, the protocol is now called DXOMARK Camera V5, and leading devices have achieved a score of over 150. In just over a decade, smartphone photography has undergone a remarkable evolution. Powerful image technology has reached the hands of those who once used professional cameras.
The team at DXOMARK has tracked advances in smartphone camera technology and adapted their testing protocol over time. In October 2022, the latest version of DXOMARK’s camera protocol and scoring system was released. This article provides an in-depth look at the process. It provides unprecedented insights into test philosophy, methodology, image quality characteristics, sub-scores.
The core principle of DXOMARK’s testing methodology is to evaluate user experience. Evaluation is conducted scientifically and results are communicated with transparency and independence. The team regularly studies user preferences and updates the testing process accordingly.
The team at DXOMARK uses both approaches, as they believe that natural scenes and lab setups engage in a dialogue to produce scores consistent with real users’ preferences.
When evaluating texture in the lab, DXOMARK first measures texture acuity and provides detailed information using an artificial intelligence-based score on a chart.
DXOMARK’s philosophy is to conduct tests using the smartphone’s default mode and default camera application, as this represents the experience of most smartphone photographers. Certain modes are manually selected for testing, such as flash auto/off, zoom, portrait (depth or bokeh) mode, video resolution, and frame rate. DXOMARK’s approach is compatible with most users’ usage patterns. According to a DXOMARK-YouGov survey, 78% of smartphone users frequently use Default Mode, while only 11% of users use Pro Mode.