entry of diego_ma and 2 other users:
(0)
This publication has not been reviewed yet.
rating distribution
average user rating
?
The average rating is computed over all reviews. However, some of them may be invisible to you due to the visibility setting chosen by the reviewers.
Automatic Evaluation of Summaries Using N-Gram Co-occurrence Statistics
by:In: Proc. HLT-NAACL
(2003)
, p. 8 pages.
Resources (URL, PDF, PS...)
Abstract
Following the recent adoption by the machine translation community of automatic evaluation using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for evaluating summaries. The results show that automatic evaluation using unigram co-occurrences between summary pairs correlates surprising well with human evaluations, based on various statistical metrics; while direct application of the BLEU evaluation procedure does not always give good results.


publication