@flint63

MATCH: An Architecture for Multimodal Dialogue Systems

, , , , , , , and . Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, PA, USA, page 376-383. (2002)
DOI: 10.3115/1073083.1073146

Abstract

Mobile interfaces need to allow the user and system to adapt their choice of communication modes according to user preferences, the task at hand, and the physical and social environment. We describe a multimodal application architecture which combines finite-state multimodal language processing, a speech-act based multimodal dialogue manager, dynamic multimodal output generation, and user-tailored text planning to enable rapid prototyping of multimodal interfaces with flexible input and adaptive output. Our testbed application MATCH (Multimodal Access To City Help) provides a mobile multimodal speech-pen interface to restaurant and subway information for New York City.

Links and resources

Tags

community

  • @flint63
  • @dblp
@flint63's tags highlighted