sign in · help · news · about · deen

BibSonomy ::  publication ::

The blue social bookmark and publication sharing system.
entry of flint63 and 2 other users:    
(0)
This publication has not been reviewed yet.
rating distribution
average user rating
?
The average rating is computed over all reviews. However, some of them may be invisible to you due to the visibility setting chosen by the reviewers.
(0.0 of 5.0 based on 0 reviews)

Looking Under the Hood: Tools for Diagnosing Your Question Answering Engine

by: Eric Breck, Marc Light, Gideon Mann, Ellen Riloff, Brianne Brown, Pranav Anand, Mats Rooth, and Michael Thelen
In: Proceedings of the ACL 2001 Workshop on Open-Domain Question Answering, Toulouse, France (2001) , p. 1-8.
Citation format (all formats):

Resources (URL, PDF, PS...)

Abstract

In this paper we analyze two question answering tasks: the TREC-8 question answering task and a set of reading comprehension exams. First, we show that Q/A systems perform better when there are multiple answer opportunities per question. Next, we analyze common approaches to two subproblems: term overlap for answer sentence identification, and answer typing for short answer extraction. We present general tools for analyzing the strengths and limitations of techniques for these subproblems. Our results quantify the limitations of both term overlap and answer typing to distinguish between competing answer candidates.

BibTeX record

Endnote record

a gripper