Inproceedings,

SmartKom: Adaptive and Flexible Multimodal Access to Multiple Applications

, , , , , , , , , , and .
Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI '03), Vancouver, Canada, page 101--108. (2003)
DOI: 10.1145/958432.958454

Abstract

The development of an intelligent user interface that supports multimodal access to multiple applications is a challenging task. In this paper we present a generic multimodal interface system where the user interacts with an anthropomorphic personalized interface agent using speech and natural gestures. The knowledge-based and uniform approach of SmartKom enables us to realize a comprehensive system that understands imprecise, ambiguous, or incomplete multimodal input and generates coordinated, cohesive, and coherent multimodal presentations for three scenarios, currently addressing more than 50 different functionalities of 14 applications. We demonstrate the main ideas in a walk through the main processing steps from modality fusion to modality fission.

Tags

Users

  • @flint63
  • @sonntag

Comments and Reviews