http://www.bibsonomy.org/burst/user/flint63/multimodalBibSonomy BuRST Feed for /user/flint63/multimodal2008-07-26T22:43:43+02:00http://www.bibsonomy.org/bibtex/24a1f33f03b48e145ee17050eaaf9f281/flint63flint632008-07-07T13:47:29+02:00processing multimodal smartkom ai language book v0805 dialog <span style="color:#555555;">Wolfgang <a href="http://www.bibsonomy.org/author/Wahlster">Wahlster</a> (eds.). </span><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2006</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, Heidelberg{SmartKom}: Foundations of Multimodal Dialogue Systems2006processing multimodal smartkom ai language book v0805 dialog The result of four years of intensive research in a large multimodal dialogue project involving 12 partners from academia and industry, SmartKom is one of the most advanced multimodal dialogue systems worldwide and is a landmark project in the history of intelligent user interfaces. The system provides symmetric multimodality in a mixed-initiative dialogue system with an embodied conversational agent. The same software architecture and components are used in three fully operational application scenarios. The theoretical and practical foundations of SmartKom represent a new generation of multimodal dialogue systems that deal not only with simple modality integration and synchronization, but cover the full spectrum of multimodal dialogue. With contributions by leading scientists in the field, this book gives the first comprehensive overview of the results of this seminal project.http://www.bibsonomy.org/bibtex/2e3bf87e577ada7f70f905d8587c8d972/flint63flint632008-07-07T13:47:29+02:00springer information user multimodal interface interaction ai retrieval v0805 book <span style="color:#555555;">Oliviero <a href="http://www.bibsonomy.org/author/Stock">Stock</a> and Massimo <a href="http://www.bibsonomy.org/author/Zancanaro">Zancanaro</a> (eds.). </span><em>Text, Speech and Language Technology </em><em>Springer, </em><em>Dordrecht, </em>(<em>2005</em>)Mon Jul 07 13:47:29 CEST 2008DordrechtText, Speech and Language TechnologyMultimodal Intelligent Information Presentation272005springer information user multimodal interface interaction ai retrieval v0805 book Intelligent Multimodal Information Presentation relates to the ability of a computer system to automatically produce interactive information presentations, taking into account the specifics about the user, such as needs, interests and knowledge, and engaging in a collaborative interaction that helps the retrieval of relevant information and its understanding on the part of the user. The volume includes descriptions of some of the most representative recent works on Intelligent Information Presentation and a view of the challenges ahead.http://www.bibsonomy.org/bibtex/28a2b06e91a8dad8336f77b7e1e87d881/flint63flint632008-07-07T13:47:29+02:00ai book sensor multimodal interaction action v0805 user speech analysis data image pattern recognition video traffic <span style="color:#555555;">Rainer <a href="http://www.bibsonomy.org/author/Stiefelhagen">Stiefelhagen</a> and John <a href="http://www.bibsonomy.org/author/Garofolo">Garofolo</a> (eds.). </span><em>volume4122ofLecture Notes in Computer Science, </em><em>Berlin, Heidelberg, </em><em>Springer, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergLecture Notes in Computer ScienceMultimodal Technologies for Perception of Humans: First International Evaluation Workshop on Classification of Events, Activities and Relationships, CLEAR 2006, Southampton, UK, April 6-7, 2006, Revised Selected Papers41222007ai book sensor multimodal interaction action v0805 user speech analysis data image pattern recognition video traffic This book constitutes the thoroughly refereed post-proceedings of the First International CLEAR 2006 Evaluation Campaign and Workshop on Classification of Events, Activities and Relationships for evaluation of multimodal technologies for the perception of humans, their activities and interactions, held in Southampton, UK, in April 2006. The 29 revised full system description papers and 1 institutional paper presented together with 2 invited papers were carefully reviewed and selected for inclusion in the book. CLEAR is an international effort to evaluate systems that are designed to analyze people's identities, activities, interactions and relationships in human-human interaction scenarios, as well as related scenarios. The papers are organized in topical sections on 3D person tracking, 2D face detection and tracking, person tracking on surveillance data, vehicle tracking, person identification, head pose estimation, acoustic scene analysis, and other evaluations.http://www.bibsonomy.org/bibtex/2aebea3503257dc0613002e7b1e7eeb8e/flint63flint632008-07-07T13:47:29+02:00learn interaction dialog springer v0805 book design multimodal ai interface user <span style="color:#555555;">Steve <a href="http://www.bibsonomy.org/author/Renals">Renals</a> and Samy <a href="http://www.bibsonomy.org/author/Bengio">Bengio</a> and Jonathan G. <a href="http://www.bibsonomy.org/author/Fiskus">Fiskus</a> (eds.). </span><em>volume4299ofLecture Notes in Computer Science, </em><em>Berlin, Heidelberg, </em><em>Springer, </em>(<em>2006</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergLecture Notes in Computer ScienceMachine Learning for Multimodal Interaction: Third International Workshop, MLMI 2006, Bethesda, MD, USA, May 1-4, 2006, Revised Selected Papers42992006learn interaction dialog springer v0805 book design multimodal ai interface user This book constitutes the thoroughly refereed post-proceedings of the Third International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006, held in Bethseda, MD, USA, in May 2006. The 39 revised full papers presented together with 1 invited paper were carefully selected during two rounds of reviewing and revision. The papers are organized in topical sections on multimodal processing, image and video processing, HCI and applications, discourse and dialogue, speech and audio processing, and NIST meeting recognition evaluation.http://www.bibsonomy.org/bibtex/2be52a3d64cafa5e7bbcf68ed3d609445/flint63flint632008-07-07T13:47:29+02:00interface ai user learn design interaction book v0805 springer multimodal dialog check <span style="color:#555555;">Andrei <a href="http://www.bibsonomy.org/author/Popescu-Belis">Popescu-Belis</a> and Steve <a href="http://www.bibsonomy.org/author/Renals">Renals</a> and Herv'e <a href="http://www.bibsonomy.org/author/Bourlard">Bourlard</a> (eds.). </span><em>volume4892ofLecture Notes in Computer Science, </em><em>Berlin, Heidelberg, </em><em>Springer, </em>(<em>2008</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergLecture Notes in Computer ScienceMachine Learning for Multimodal Interaction: 4th International Workshop, MLMI 2007, Brno, Czech Republic, June 28-30, 2007, Revised Selected Papers48922008interface ai user learn design interaction book v0805 springer multimodal dialog check This book constitutes the thoroughly refereed post-proceedings of the 4th International Workshop on Machine Learning for Multimodal Interaction, MLMI 2007, held in Brno, Czech Republic, in June 2007. The 25 revised full papers presented together with 1 invited paper were carefully selected during two rounds of reviewing and revision from 60 workshop presentations. The papers are organized in topical sections on multimodal processing, HCI, user studies and applications, image and video processing, discourse and dialogue processing, speech and audio processing, as well as the PASCAL speech separation challenge.http://www.bibsonomy.org/bibtex/2d82fdc469fc3f4111c1b8232880a4c01/flint63flint632008-07-07T13:47:29+02:00v0805 multimodal ai dialog processing interface mobile user language speech springer traffic book <span style="color:#555555;">Wolfgang <a href="http://www.bibsonomy.org/author/Minker">Minker</a> and Dirk <a href="http://www.bibsonomy.org/author/Bühler">B&#252;hler</a> and Laila <a href="http://www.bibsonomy.org/author/Dybkjær">Dybkj&#230;r</a> (eds.). </span><em>Text, Speech and Language Technology </em><em>Springer, </em><em>Dordrecht, </em>(<em>2005</em>)Mon Jul 07 13:47:29 CEST 2008DordrechtText, Speech and Language TechnologySpoken Multimodal Human-Computer Dialogue in Mobile Environments282005v0805 multimodal ai dialog processing interface mobile user language speech springer traffic book The ongoing migration of computing and information access from stationary environments to mobile computing devices for eventual use in mobile environments, such as Personal Digital Assistants (PDAs), tablet PCs, next generation mobile phones, and in-car driver assistance systems, poses critical challenges for natural human-computer interaction. Spoken dialogue is a key factor in ensuring natural and user-friendly interaction with such devices which are meant not only for computer specialists, but also for everyday users. Speech supports hands-free and eyes-free operation, and becomes a key alternative interaction mode in mobile environments, e.g. in cars where driver distraction by manually operated devices may be a significant problem. On the other hand, the use of mobile devices in public places, may make the possibility of using alternative modalities possibly in combination with speech, such as graphics output and gesture input, preferable due to e.g. privacy issues. Researchers' interest is progressively turning to the integration of speech with other modalities such as gesture input and graphics output, partly to accommodate more efficient interaction and partly to accommodate different user preferences.http://www.bibsonomy.org/bibtex/2d9fc8248d137395d443a8a8ece4afd2e/flint63flint632008-07-07T13:47:29+02:00dialog processing multimodal springer speech interface ai v0805 book user language <span style="color:#555555;">Jan van <a href="http://www.bibsonomy.org/author/Kuppevelt">Kuppevelt</a> and Ronnie W. <a href="http://www.bibsonomy.org/author/Smith">Smith</a> (eds.). </span><em>Text, Speech and Language Technology </em><em>Springer, </em><em>Dordrecht, </em>(<em>2003</em>)Mon Jul 07 13:47:29 CEST 2008DordrechtText, Speech and Language TechnologyCurrent and New Directions in Discourse and Dialogue222003dialog processing multimodal springer speech interface ai v0805 book user language This volume is unique in its breadth of coverage on key topics in the field from a variety of leading researchers. In one volume, readers gain exposure to several perspectives in the areas of corpus annotation and analysis, dialogue system construction; as well as theoretical perspectives on communicative intention, context-based generation, and modelling of discourse structure. In this book you will find high quality articles representing current and new directions in discourse and dialogue with an emphasis on Dialogue Systems; Corpora and Corpus Tools; and Semantic and Pragmatic Modelling of Discourse and Dialogue. The majority of the articles included come from the most outstanding papers presented at the 2nd SIGdial workshop on Discourse and Dialogue held in conjunction with Eurospeech 2001. The contents are supplemented with four invited papers from internationally recognized researchers in discourse and dialogue.http://www.bibsonomy.org/bibtex/23482bb6c310bde0103e086f3f492c74f/flint63flint632008-07-07T13:47:29+02:00speech springer interface processing user multimodal book v0805 language dialog ai <span style="color:#555555;">Jan van <a href="http://www.bibsonomy.org/author/Kuppevelt">Kuppevelt</a> and Laila <a href="http://www.bibsonomy.org/author/Dybkjær">Dybkj&#230;r</a> and Niels Ole <a href="http://www.bibsonomy.org/author/Bernsen">Bernsen</a> (eds.). </span><em>Text, Speech and Language Technology </em><em>Springer, </em><em>Dordrecht, </em>(<em>2005</em>)Mon Jul 07 13:47:29 CEST 2008DordrechtText, Speech and Language TechnologyAdvances in Natural Multimodal Dialogue Systems302005speech springer interface processing user multimodal book v0805 language dialog ai The main topic of this volume is natural multimodal interaction. The book is unique in that it brings together a great many contributions regarding aspects of natural and multimodal interaction written by many of the important actors in the field. It is a timely update of Multimodality in Language and Speech Systems by Björn Granström, David House and Inger Karlsson and, at the same time, it presents a much broader overview of the field. Its 17 chapters provide a broad and detailed impression of where the fairly new field of natural and multimodal interactivity engineering stands today. Topics addressed include talking heads, conversational agents, tutoring systems, multimodal communication, machine learning, architectures for multimodal dialogue systems, systems evaluation, and data annotation. This title will prove very valuable to scientists, researchers and practitioners working in the fields of natural interactive systems, multimodal systems, conversational agents, spoken dialogue systems, natural language processing applications, advanced human-computer interfaces, analysis of multimodal data, evaluation of multimodal systems, and educational systems.http://www.bibsonomy.org/bibtex/2713220323d619e8e410f0ba0c352b8ab/flint63flint632008-07-07T13:47:29+02:00v0805 springer book ai interaction multimodal <span style="color:#555555;">Thomas S. <a href="http://www.bibsonomy.org/author/Huang">Huang</a> and Anton <a href="http://www.bibsonomy.org/author/Nijholt">Nijholt</a> and Maja <a href="http://www.bibsonomy.org/author/Pantic">Pantic</a> and Alex <a href="http://www.bibsonomy.org/author/Pentland">Pentland</a> (eds.). </span><em>Lecture Notes in Computer Science </em><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergLecture Notes in Computer ScienceArtifical Intelligence for Human Computing : {ICMI} 2006 and {IJCAI} 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers44512007v0805 springer book ai interaction multimodal This book constitutes the thoroughly refereed post-proceedings of two events discussing AI for Human Computing: one Special Session during the Eighth International ACM Conference on Multimodal Interfaces (ICMI 2006), held in Banff, Canada, in November 2006, and a Workshop organized in conjunction with the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007), held in Hyderabad, India, in January 2007. A large number of the contributions in this state-of-the-art survey are updated and extended versions of the papers presented during these two events. In order to obtain a more complete overview of research efforts in the field of human computing, a number of additional invited contributions are also included in this book on AI for human computing. The 17 revised papers presented were carefully selected from numerous submissions to and presentations made at the two events and include invited articles to round off coverage of all relevant topics of the emerging topic. The papers are organized in three parts: a part on foundational issues of human computing, a part on sensing humans and their activities, and a part on anthropocentric interaction models.http://www.bibsonomy.org/bibtex/2e182017b8257348cb0391a8e5eaf0a4f/flint63flint632008-07-07T13:47:29+02:00multimodal emotion processing springer interface language book interaction v0805 user ai <span style="color:#555555;">Bj&#246;rn <a href="http://www.bibsonomy.org/author/Granström">Granstr&#246;m</a> and David <a href="http://www.bibsonomy.org/author/House">House</a> and Inger <a href="http://www.bibsonomy.org/author/Karlsson">Karlsson</a> (eds.). </span><em>Text, Speech and Language Technology </em><em>Kluwer, </em><em>Dordrecht, </em>(<em>2002</em>)Mon Jul 07 13:47:29 CEST 2008DordrechtText, Speech and Language TechnologyMultimodality in Language and Speech Systems192002multimodal emotion processing springer interface language book interaction v0805 user ai This book covers the topic of multimodality from a large number of different perspectives and provides the advanced student/researcher with a current survey of theories of multimodal communication between people as well as reviewing many aspects of multimodal input/output in technical systems. Chapters dealing with human-human multimodal communication include speech-gesture systems, semiotics of gesture, structure and functions of face-to-face communication, emotional relations and intercultural variation, and human-human communication which is mediated by computer for the handicapped. Chapters dealing with human-machine communication and interfaces cover the technology and science of creating talking faces, technology and methods for the development of animated interface agents in intelligent multimedia systems, and the integration of multimodal input and output in the computer interface. The book also covers computer processing and understanding of signal and symbol input from speech, text, and visual images.http://www.bibsonomy.org/bibtex/2365b5666745acf6755405a64a9d0d265/flint63flint632008-07-07T13:47:29+02:00shop xml paper soap v0805 service application business multimodal sap web acm interaction location mobile <span style="color:#555555;">Huaigu <a href="http://www.bibsonomy.org/author/Wu">Wu</a> and Yuri <a href="http://www.bibsonomy.org/author/Natchetoi">Natchetoi</a> </span><em>WWW '07: Proceedings of the 16th International Conference on World Wide Web, </em><em>page1259-1260. </em><em>New York, USA, </em><em>ACM, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008New York, USA{WWW '07:} Proceedings of the 16th International Conference on World Wide Web1259-1260Mobile Shopping Assistant: Integration of Mobile Applications and Web Services2007shop xml paper soap v0805 service application business multimodal sap web acm interaction location mobile The goal of this poster is to describe our implementation of a new architecture enabling efficient integration between mobile phone applications and Web Services. Using this architecture, we have implemented a mobile shopping assistant described further. In order to build this architecture, we designed an innovative XML compression mechanism to facilitate data exchange between mobile phones and Web Services. We also designed a smart connection manager to control asynchronous communication for all possible channels of a mobile phone. In addition, we used diverse input modes in order to extend users' access to Web Services.http://www.bibsonomy.org/bibtex/271134be7af6a8cfdc6836cc28b4731b1/flint63flint632008-07-07T13:47:29+02:00smartweb acm web dialog v0805 semantic dfki ai paper multimodal <span style="color:#555555;">Wolfgang <a href="http://www.bibsonomy.org/author/Wahlster">Wahlster</a> </span><em>MULTIMEDIA '07: Proceedings of the 15th International Conference on Multimedia, </em><em>page16. </em><em>New York, USA, </em><em>ACM, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008New York, USA{MULTIMEDIA '07:} Proceedings of the 15th International Conference on Multimedia16{SmartWeb:} Multimodal Web Services on the Road2007smartweb acm web dialog v0805 semantic dfki ai paper multimodal This keynote presents the anatomy of SmartWeb, its ontology-based information extraction and web service composition technology and explains the distinguishing features of its multimodal dialogue and answer engine.http://www.bibsonomy.org/bibtex/2d0176e4836c7c9c3784ed065dbecaa7f/flint63flint632008-07-07T13:47:29+02:00multimodal processing paper dfki dialog smartkom language v0805 ai <span style="color:#555555;">Wolfgang <a href="http://www.bibsonomy.org/author/Wahlster">Wahlster</a> </span><em>SmartKom: Foundations of Multimodal Dialogue Systems, </em><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2006</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, Heidelberg{SmartKom}: Foundations of Multimodal Dialogue Systems3-27Dialogue Systems Go Multimodal: The {SmartKom} Experience2006multimodal processing paper dfki dialog smartkom language v0805 ai Multimodal dialogue systems exploit one of the major characteristics of humanhuman interaction: the coordinated use of different modalities. Allowing all of the modalities to refer to and depend upon each other is a key to the richness of multimodal communication. We introduce the notion of symmetric multimodality for dialogue systems in which all input modes (e.g., speech, gesture, facial expression) are also available for output, and vice versa. A dialogue system with symmetric multimodality must not only understand and represent the user’s multimodal input, but also its own multimodal output. We present an overview of the SmartKom system that provides full symmetric multimodality in a mixed-initiative dialogue system with an embodied conversational agent. SmartKom represents a new generation of multimodal dialogue systems that deal not only with simple modality integration and synchronization but cover the full spectrum of dialogue phenomena that are associated with symmetric multimodality (including crossmodal references, one-anaphora, and backchannelling). We show that SmartKom’s plug-and-play architecture supports multiple recognizers for a single modality, e.g., the user’s speech signal can be processed by three unimodal recognizers in parallel (speech recognition, emotional prosody, boundary prosody). We detail SmartKom’s three-tiered representation of multimodal discourse, consisting of a domain layer, a discourse layer, and a modality layer. We discuss the limitations of SmartKom and how they are overcome in the follow-up project SmartWeb. In addition, we present the research roadmap for multimodality addressing the key open research questions in this young field. To conclude, we discuss the economic and scientific impact of the SmartKom project, which has led to more than 50 patents and 29 spin-off products.http://www.bibsonomy.org/bibtex/27ace6b869e9cb57e7dcf297a2b590035/flint63flint632008-07-07T13:47:29+02:00smartweb project paper web ai multimodal dialog semantic v0805 dfki <span style="color:#555555;">Wolfgang <a href="http://www.bibsonomy.org/author/Wahlster">Wahlster</a> </span><em>Informatikforschung in Deutschland, </em><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2008</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergInformatikforschung in Deutschland300-311{SmartWeb --- Ein multimodales Dialogsystem für das semantische Web}2008smartweb project paper web ai multimodal dialog semantic v0805 dfki http://www.bibsonomy.org/bibtex/2e092d235f4c2666eda7c96c09582f279/flint63flint632008-07-07T13:47:29+02:00v0805 book speech traffic springer dialog ai multimodal interface user <span style="color:#555555;">Roman <a href="http://www.bibsonomy.org/author/Vilimek">Vilimek</a> and Thomas <a href="http://www.bibsonomy.org/author/Hempel">Hempel</a> and Birgit <a href="http://www.bibsonomy.org/author/Otto">Otto</a> </span><em>Human-Computer Interaction: HCI Intelligent Multimodal Interaction Environments : 12th International Conference, HCI International 2007, Beijing, China, July 22--27, 2007, Proceedings, Part III, </em><em>volume4552ofLecture Notes in Computer Science, </em><em>page216-224. </em><em>Berlin, Heidelberg, </em><em>Springer, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergHuman-Computer Interaction: HCI Intelligent Multimodal Interaction Environments : 12th International Conference, HCI International 2007, Beijing, China, July 22--27, 2007, Proceedings, Part III216-224Lecture Notes in Computer ScienceMultimodal Interfaces for In-Vehicle Applications45522007v0805 book speech traffic springer dialog ai multimodal interface user This paper identifies several factors that were observed as being crucial to the usability of multimodal in-vehicle applications---a multimodal system is not of value in itself. Focusing in particular on the typical combination of manual and voice control, this article describes important boundary conditions and discusses the concept of natural interaction.http://www.bibsonomy.org/bibtex/238a9847aaa787e28bb9d556b55c7e3a2/flint63flint632008-07-07T13:47:29+02:00user paper multimodal embedded interaction interface device ai acm v0805 <span style="color:#555555;">Roel <a href="http://www.bibsonomy.org/author/Vertegaal">Vertegaal</a> and Ivan <a href="http://www.bibsonomy.org/author/Poupyrev">Poupyrev</a> </span><em>Communications of the ACM</em><em>51(6):26-30</em>(<em>2008</em>)Mon Jul 07 13:47:29 CEST 2008Communications of the ACM626-30Organic User Interfaces512008user paper multimodal embedded interaction interface device ai acm v0805 In this special section, we attempt to map out a future where new display technologies are commonplace. A future led by disruptive change in the way we will use digital appliances: where the shape of the computing device itself becomes one of the key variables of interactivity. We have invited a number of top researchers in this field to share their ideas on this topic. This section covers three tightly knit themes, which define what we refer to as an Organic User Interface (OUI).http://www.bibsonomy.org/bibtex/2164474b5a1ccb39a04a1303065a4a112/flint63flint632008-07-07T13:47:29+02:00dialog paper semantic dfki web ai v0805 smartweb multimodal <span style="color:#555555;">Daniel <a href="http://www.bibsonomy.org/author/Sonntag">Sonntag</a> and Ralf <a href="http://www.bibsonomy.org/author/Engel">Engel</a> and Gerd <a href="http://www.bibsonomy.org/author/Herzog">Herzog</a> and Alexander <a href="http://www.bibsonomy.org/author/Pfalzgraf">Pfalzgraf</a> and Norbert <a href="http://www.bibsonomy.org/author/Pfleger">Pfleger</a> and Massimo <a href="http://www.bibsonomy.org/author/Romanelli">Romanelli</a> and Norbert <a href="http://www.bibsonomy.org/author/Reithinger">Reithinger</a> </span><em>Artifical Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, </em><em>volume4451ofLecture Notes in Computer Science, </em><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, HeidelbergArtifical Intelligence for Human Computing: {ICMI} 2006 and {IJCAI} 2007 International Workshops272-295Lecture Notes in Computer Science{SmartWeb} Handheld---Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services44512007dialog paper semantic dfki web ai v0805 smartweb multimodal SmartWeb aims to provide intuitive multimodal access to a rich selection of Web-based information services. We report on the current prototype with a smartphone client interface to the Semantic Web. An advanced ontology-based representation of facts and media structures serves as the central description for rich media content. Underlying content is accessed through conventional web service middleware to connect the ontological knowledge base and an intelligent web service composition module for external web services, which is able to translate between ordinary XML-based data structures and explicit semantic representations for user queries and system responses. The presentation module renders the media content and the results generated from the services and provides a detailed description of the content and its layout to the fusion module. The user is then able to employ multiple modalities, like speech and gestures, to interact with the presented multimedia material in a multimodal way.http://www.bibsonomy.org/bibtex/2eabd45abea6db5d738e86978a636f774/flint63flint632008-07-07T13:47:29+02:00crisis ieee interface processing v0805 paper information graphics management spatial language 3d ai multimodal <span style="color:#555555;">R. <a href="http://www.bibsonomy.org/author/Sharma">Sharma</a> and M. <a href="http://www.bibsonomy.org/author/Yeasin">Yeasin</a> and N. <a href="http://www.bibsonomy.org/author/Krahnstoever">Krahnstoever</a> and I. <a href="http://www.bibsonomy.org/author/Rauschert">Rauschert</a> and G. <a href="http://www.bibsonomy.org/author/Cai">Cai</a> and I. <a href="http://www.bibsonomy.org/author/Brewer">Brewer</a> and A. M. <a href="http://www.bibsonomy.org/author/MacEachren">MacEachren</a> and K. <a href="http://www.bibsonomy.org/author/Sengupta">Sengupta</a> </span><em>Proceedings of the IEEE</em><em>91(9):1327-1354</em>(<em>2003</em>)Mon Jul 07 13:47:29 CEST 2008Proceedings of the IEEE91327-1354Speech-Gesture Driven Multimodal Interfaces for Crisis Management912003crisis ieee interface processing v0805 paper information graphics management spatial language 3d ai multimodal Emergency response requires strategic assessment of risks, decisions, and communications that are time critical while requiring teams of individuals to have fast access to large volumes of complex information and technologies that enable tightly coordinated work. The access to this information by crisis management teams in emergency operations centers can be facilitated through various human-computer interfaces. Unfortunately, these interfaces are hard to use, require extensive training, and often impede rather than support teamwork. Dialogue-enabled devices, based on natural, multimodal interfaces, have the potential of making a variety of information technology tools accessible during crisis management. This paper establishes the importance of multimodal interfaces in various aspects of crisis management and explores many issues in realizing successful speech-gesture driven, dialogue-enabled interfaces for crisis management. This paper is organized in five parts. The first part discusses the needs of crisis management that can be potentially met by the development of appropriate interfaces. The second part discusses the issues related to the design and development of multimodal interfaces in the context of crisis management. The third part discusses the state of the art in both the theories and practices involving these human-computer interfaces. In particular, it describes the evolution and implementation details of two representative systems, Crisis Management (XISM) and Dialog Assisted Visual Environment for Geoinformation (DAVE/spl I.bar/G). The fourth part speculates on the short-term and long-term research directions that will help addressing the outstanding challenges in interfaces that support dialogue and collaboration. Finally, the fifth part concludes the paper.http://www.bibsonomy.org/bibtex/2711e33895fe7603c1360440d65238563/flint63flint632008-07-07T13:47:29+02:00test language smartkom paper ai dialog multimodal v0805 processing <span style="color:#555555;">Florian <a href="http://www.bibsonomy.org/author/Schiel">Schiel</a> </span><em>SmartKom: Foundations of Multimodal Dialogue Systems, </em><em>Springer, </em><em>Berlin, Heidelberg, </em>(<em>2006</em>)Mon Jul 07 13:47:29 CEST 2008Berlin, Heidelberg{SmartKom}: Foundations of Multimodal Dialogue Systems617-643Evaluation of Multimodal Dialogue Systems2006test language smartkom paper ai dialog multimodal v0805 processing In this chapter we will give a brief overview about what different methods of evaluation were applied to the SmartKom prototypes and which of them resulted in utilizable results and why others did not. Since there are no established benchmarking methods yet for multimodal HCI systems and very few debatable methods for monomodal dialogue systems our work within the SmartKom prototype evaluations was rather an exploration of new methods than the simple application of standard routines.http://www.bibsonomy.org/bibtex/21ae51aa4a32e74014383cc4d7fda2cbb/flint63flint632008-07-07T13:47:29+02:00dialog smartweb semantic paper web v0805 multimodal ai dfki <span style="color:#555555;">Norbert <a href="http://www.bibsonomy.org/author/Reithinger">Reithinger</a> and Gerd <a href="http://www.bibsonomy.org/author/Herzog">Herzog</a> and Anselm <a href="http://www.bibsonomy.org/author/Blocher">Blocher</a> </span><em>KI -- K&#252;nstliche Intelligenz</em><em>2007(2):30-33</em>(<em>2007</em>)Mon Jul 07 13:47:29 CEST 2008KI -- Künstliche Intelligenz230-33{SmartWeb}: Mobile Broadband Access to the Semantic Web20072007dialog smartweb semantic paper web v0805 multimodal ai dfki SmartWeb provides an intuitive multimodal access to a rich selection of web-based information services. Available system prototypes include a smartphone client, an advanced motorbike human machine interface, and an automobile demonstrator with an on-board dialogue system that is updated automatically with new content from the web using broadcast technology. An advanced ontology-based representation of facts and media structures serves as central description for rich media content. Underlying content is both derived from existing web pages and provided by conventional web services. Semantic annotations are generated automatically using different processing techniques. The different variants of the SmartWeb client enable the user to employ multiple modalities, like speech and gestures, to interact with the presented multimedia material.