Industrial User Experience Index vs. Quality of Experience Models
IEEE Communications Magazine, 61 (1):
98-104 (January 2023)Abstract
Network operators have increased interest in understanding and quantifying the user perceived quality of experience (QoE). Appropriate QoE models allow mapping of measurable QoS parameters to QoE metrics like mean opinion scores (MOS) or poor-or-worse (PoW) ratios. Unfortunately, there are no QoE models for all applications available yet, and development and standardization is rather time-consuming. For that reason, industry often implements simple but effective approaches based on expert knowledge to get a user experience index able to deliver high value insights. This index is often defined based on thresholds of measurable QoS parameters to classify the resulting user experience. The question arises whether such a threshold-based user experience index can properly estimate the QoE in a system. We therefore answer in this work whether the user experience index is able to quantify the expected QoE in a system and if other QoE metrics like PoW ratios can be derived. Furthermore, we discuss the interpretation and the limits of the index. As a key contribution, we present a detailed systematic analysis of the threshold-based QoE concept and discuss its usability as QoE estimation methodology for industry.