Systematic evaluation methodology for cell phone user interfaces
Interact. Comput., 18 (2):
304--325 (2006)Abstract
As cell phones have expanded their functionality with enhanced mobile technology, use of cell phones has become complex. Although usability of cell phones has been improved by featuring hierarchical menu systems, designing comprehensible navigation in the menu hierarchy is still a major challenge to cell phone user interface (UI) developers as more diverse users are adopting cell phones. To develop an easy-to-use cell phone UI, an effective usability evaluation method (UE) is essential. While various usability evaluation methods (UEM) have been developed, laboratory-based usability testing produces high-quality usability data from actual users. Yet, the effectiveness of such testing can vary dramatically depending on what data is collected and how the data are analyzed. To provide a practical guidance for the effective laboratory testing, we developed a systematic evaluation methodology for cell phone user interfaces (SEM-CPU). SEM-CPU is specifically designed to integrate five empirical methods (scenario-based task performance, questionnaires, post-task interview, user observation, and retrospective think aloud) into a laboratory-based test in order to evaluate cell phone UIs. By following SEM-CPU, usability engineers should be able to (1) conduct laboratory-based testing with multiple empirical methods in an efficient way, (2) collect diverse but useful data to measure necessary usability attributes, (3) identify determinants of usability problems, and (4) integrate all usability data to generate proper solutions for the problems. Detailed descriptions of SEM-CPU are presented along with a case study where SEM-CPU was applied to a comparative cell phone usability test.
