BibSonomyburst/bibtex/1bedf8921e99bf7867e4bb6a165bf26dcBibSonomy RSS feed for /bibtex/1bedf8921e99bf7867e4bb6a165bf26dc2012-02-17T09:35:00+01:00http://www.bibsonomy.org/bibtex/282a0e0c21ee324f677ac9dc34ef64812/diego_madiego_ma2007-12-14T02:42:33+01:00question_answering evaluation resources <span class="authorEditorList"><a href="/author/Lin">Jimmy Lin</a> </span><em>Proc. SIGIR&#039;05, </em>(<em>2005</em>)Fri Dec 14 02:42:33 CET 2007Proc. SIGIR'05Evaluation of Resources for Question Answering Evaluation2005question_answering evaluation resources In contrast to traditional information retrieval systems, which return ranked lists of documents that users must manually browse through, a question answering system attempts to directly answer natural language questions posed by the user. Although such systems possess language processing capabilities, they still rely on traditional document retrieval techniques to generate an initial candidate set of documents. In this paper, we argue that document retrieval for question answering represents a different task than retrieving documents in response to more general retrospective information needs. Thus, to guide future system development, specialized question answering test collections must be constructed. We have shown that the current evaluation resources have major shortcomings, and to remedy the situation, we have manually created a small, reusable question answering test collection for research purposes. This article describes our methodology for building this test collection and discusses issues we encountered along the way regarding the notion of ?answer correctness?.http://www.bibsonomy.org/bibtex/2dd2a22af52e9979a7411d1ac77989295/dblpdblp2006-08-22T00:00:00+02:00dblp <span class="authorEditorList"><a href="/author/Lin">Jimmy J. Lin</a> </span><em>SIGIR, </em><em>page 392-399. </em><em>ACM, </em>(<em>2005</em>)Tue Aug 22 00:00:00 CEST 2006SIGIRconf/sigir/2005392-399Evaluation of resources for question answering evaluation.2005dblp dblp