Temporal Symbolic Integration Applied to a Multimodal System Using Gestures and Speech
Gesture-Based Communication in Human-Computer Interaction - Proceedings of the International Gesture Workshop (Gif-sur-Yvette, France, March 1999), page 291-302. Springer-Verlag, (1999)Abstract
This paper presents a technical approach for temporal symbol integration aimed to be generally applicable in unimodal and multimodal user interfaces. It draws its strength from symbolic data representation and an underlying rulebased system, and is embedded in a multi-agent system. The core method for temporal integration is motivated by findings from cognitive science research. We discuss its application for a gesture recognition task and speech-gesture integration in a Virtual Construction scenario. Finally an outlook of an empirical evaluation is given.
