Multimodal Sentence Similarity in Human-Computer Interaction Systems
F. Ferri, P. Grifoni, and S. Paolozzi. Knowledge-Based Intelligent Information and Engineering Systems: KES 2007 -- WIRN 2007, 11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy, volume 4693 of Lecture Notes in Artificial Intelligence, Springer, Berlin, (2007)
DOI: 10.1007/978-3-540-74827-4_51
Abstract
Human-to-human conversation remain such a significant part of our working activities because its naturalness. Multimodal interaction systems combine visual information with voice, gestures and other modalities to provide flexible and powerful dialogue approaches. The use of integrated multiple input modes enables users to benefit from the natural approach used in human communication. However natural interaction approaches may introduce interpretation problems. This paper proposes a new approach to match a multimodal sentence with a template stored in a knowledge base to interpret the multimodal sentence and define the multimodal templates similarity. We have assumed to map each multimodal sentence to the natural language one. The system then provides the exact/approximate interpretation according to the template similarity level.
Knowledge-Based Intelligent Information and Engineering Systems: KES 2007 -- WIRN 2007, 11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy
%0 Book Section
%1 FerriGrifoniPaolozzi07KES
%A Ferri, Fernando
%A Grifoni, Patrizia
%A Paolozzi, Stefano
%B Knowledge-Based Intelligent Information and Engineering Systems: KES 2007 -- WIRN 2007, 11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy
%C Berlin
%D 2007
%E Apolloni, Bruno
%E Howlett, Robert J.
%E Jain, Lakhmi
%I Springer
%K 01624 springer paper ai language processing user interaction multimodal interface analysis dialog zzz.mmi
%P 403--410
%R 10.1007/978-3-540-74827-4_51
%T Multimodal Sentence Similarity in Human-Computer Interaction Systems
%V 4693
%X Human-to-human conversation remain such a significant part of our working activities because its naturalness. Multimodal interaction systems combine visual information with voice, gestures and other modalities to provide flexible and powerful dialogue approaches. The use of integrated multiple input modes enables users to benefit from the natural approach used in human communication. However natural interaction approaches may introduce interpretation problems. This paper proposes a new approach to match a multimodal sentence with a template stored in a knowledge base to interpret the multimodal sentence and define the multimodal templates similarity. We have assumed to map each multimodal sentence to the natural language one. The system then provides the exact/approximate interpretation according to the template similarity level.
%@ 978-3-540-74826-7
@incollection{FerriGrifoniPaolozzi07KES,
abstract = {Human-to-human conversation remain such a significant part of our working activities because its naturalness. Multimodal interaction systems combine visual information with voice, gestures and other modalities to provide flexible and powerful dialogue approaches. The use of integrated multiple input modes enables users to benefit from the natural approach used in human communication. However natural interaction approaches may introduce interpretation problems. This paper proposes a new approach to match a multimodal sentence with a template stored in a knowledge base to interpret the multimodal sentence and define the multimodal templates similarity. We have assumed to map each multimodal sentence to the natural language one. The system then provides the exact/approximate interpretation according to the template similarity level.},
added-at = {2017-05-06T22:01:21.000+0200},
address = {Berlin},
author = {Ferri, Fernando and Grifoni, Patrizia and Paolozzi, Stefano},
biburl = {https://www.bibsonomy.org/bibtex/29fa67df5b9b24b3faa1941e4c41c1556/flint63},
booktitle = {Knowledge-Based Intelligent Information and Engineering Systems: KES 2007 -- WIRN 2007, 11th International Conference, KES 2007, XVII Italian Workshop on Neural Networks, Vietri sul Mare, Italy},
crossref = {KES2007b},
doi = {10.1007/978-3-540-74827-4_51},
editor = {Apolloni, Bruno and Howlett, Robert J. and Jain, Lakhmi},
file = {SpringerLink:2007/FerriGrifoniPaolozzi07KES.pdf:PDF},
groups = {public},
interhash = {610cd95fa8768749173c7db4d7abd612},
intrahash = {9fa67df5b9b24b3faa1941e4c41c1556},
isbn = {978-3-540-74826-7},
issn = {0302-9743},
keywords = {01624 springer paper ai language processing user interaction multimodal interface analysis dialog zzz.mmi},
pages = {403--410},
publisher = {Springer},
series = {Lecture Notes in Artificial Intelligence},
timestamp = {2017-07-13T17:49:35.000+0200},
title = {Multimodal Sentence Similarity in Human-Computer Interaction Systems},
username = {flint63},
volume = 4693,
year = 2007
}