@porta

A Unified Approach for Semantic-Based Multimodal Interaction

, , , , , and . Towards the Internet of Services: The THESEUS Research Program, Springer, Berlin, (2014)
DOI: 10.1007/978-3-319-06755-1_11

Abstract

This article gives an overview of the basic dialog shell for multimodal interaction that was created as the foundation for the software components developed in the Core Technology Cluster of the THESEUS research program. It explains the basic setup of systems based on the dialog shell for specific use cases. The general processing paradigm for interaction in our framework using semantic interface elements as well as several dialog phenomena handled by the dialog shell are described. Finally, a selection of different demonstrator systems that were built for a range of applications is presented briefly. They offer access to quite varied use case scenarios featuring multimodal input and output, including gestures, multi-touch, spoken input and output, and interactions across mobile and stationary devices.

Links and resources

Tags

community

  • @flint63
  • @porta
@porta's tags highlighted