An Intelligent Multimodal Mixed Reality Real-Time Strategy Game
Proceedings of the 23rd IEEE Virtual Reality (IEEE VR) conference, page 223-224. IEEE, (2016)Abstract
This paper presents a mixed reality tabletop role-playing game with a novel combination of interaction styles and gameplay mechanics. Our contribution extends previous approaches by abandoning the traditional turn-based gameplay in favor of simultaneous real-time interaction. The increased cognitive and physical load during the simultaneous control of multiple game characters is counteracted by two features: First, certain game characters are equipped with AI-driven capabilities to become semi-autonomous virtual agents. Second, (groups of) these agents can be instructed by high-level commands via a multimodal—speech and gesture—interface.
