Inbook,

A Comparative Evaluation of QA Systems over List Questions

, and .
page 115--121. Springer International Publishing, Cham, (2016)
DOI: 10.1007/978-3-319-41552-9_11

Abstract

The evaluation of a Question Answering system is a challenging task. In this paper we evaluate our system, LX-ListQuestion, a Web-based QA System that focuses on answering list questions. We compare our system against other QA Systems and the results were analyzed in two ways: (i) the quantitative evaluation of answers provides recall, precision and F-measure and (ii) the question coverage that indicate the usefulness of the system to the user by counting the number of questions for which the system provides at least one correct answer. The evaluation brings interesting results that points to a certain degree of complementary between different approaches.

Tags

Users

  • @defeatnelly

Comments and Reviews