BibSonomy :: publication ::

tag user group author concept BibTeX key search:all search:diego_ma

The blue social bookmark and publication sharing system.

entry of diego_ma:

(0)

This publication has not been reviewed yet.

rating distribution

average user rating

The average rating is computed over all reviews. However, some of them may be invisible to you due to the visibility setting chosen by the reviewers.

(0.0 of 5.0 based on 0 reviews)

Intrinsic versus Extrinsic Evaluations of Parsing Systems

by: Diego Mollá, and Ben Hutchinson

In: Proc. European Association for Computational Linguistics EACL, workshop on Evaluation Initiatives in Natural Language Processing Budapest: ACL (April 2003) , p. 43-50.

Abstract

A wide range of parser and/or grammar evaluation methods have been reported in the literature. However, in most cases these evaluations take the parsers independently intrinsic evaluations, and only in a few cases has the effect of different parsers in real applications been measured extrinsic evaluations. This paper compares two evaluations of the Link Grammar parser and the Conexor Functional Dependency Grammar parser. The parsing systems, despite both being dependency-based, return different types of dependencies, making a direct comparison impossible. In the intrinsic evaluation, the accuracy of the parsers is compared independently by converting the dependencies into grammatical relations and using the methodology of Carroll:1998 for parser comparison. In the extrinsic evaluation, the parsers' impact in a practical application is compared within the context of answer extraction. The differences in the results are significant.

BibTeX record

@inproceedings{Moll'a:2003b,
  abstract = {A wide range of parser and/or grammar evaluation methods have been reported in the literature. However, in most cases these evaluations take the parsers independently (intrinsic evaluations), and only in a few cases has the effect of different parsers in real applications been measured (extrinsic evaluations). This paper compares two evaluations of the Link Grammar parser and the Conexor Functional Dependency Grammar parser. The parsing systems, despite both being dependency-based, return different types of dependencies, making a direct comparison impossible. In the intrinsic evaluation, the accuracy of the parsers is compared independently by converting the dependencies into grammatical relations and using the methodology of \newcite{Carroll:1998} for parser comparison. In the extrinsic evaluation, the parsers' impact in a practical application is compared within the context of answer extraction. The differences in the results are significant.},
  added-at = {2008-01-29T08:19:28.000+0100},
  address = {Budapest},
  author = {Moll{\'a}, Diego and Hutchinson, Ben},
  biburl = {http://www.bibsonomy.org/bibtex/2a9ae1ef031141fe460eaa6deea6036d7/diego_ma},
  booktitle = {Proc. European Association for Computational Linguistics (EACL), workshop on Evaluation Initiatives in Natural Language Processing},
  interhash = {c39636076c0c039471b07265565ed060},
  intrahash = {a9ae1ef031141fe460eaa6deea6036d7},
  keywords = {parsers evaluation AnswerFinder gram_rels molla_publication},
  month = {April},
  organization = {Association for Computational Linguistics},
  pages = {43-50},
  publisher = {ACL},
  timestamp = {2008-01-29T08:19:28.000+0100},
  title = {Intrinsic versus Extrinsic Evaluations of Parsing Systems},
  year = 2003
}

Endnote record

%0 Conference Paper
%1 Moll'a:2003b
%A Moll{\'a}, Diego
%A Hutchinson, Ben
%B Proc. European Association for Computational Linguistics (EACL), workshop on Evaluation Initiatives in Natural Language Processing
%C Budapest
%D 2003
%I ACL
%K 
%P 43-50
%T Intrinsic versus Extrinsic Evaluations of Parsing Systems
%X A wide range of parser and/or grammar evaluation methods have been reported in the literature. However, in most cases these evaluations take the parsers independently (intrinsic evaluations), and only in a few cases has the effect of different parsers in real applications been measured (extrinsic evaluations). This paper compares two evaluations of the Link Grammar parser and the Conexor Functional Dependency Grammar parser. The parsing systems, despite both being dependency-based, return different types of dependencies, making a direct comparison impossible. In the intrinsic evaluation, the accuracy of the parsers is compared independently by converting the dependencies into grammatical relations and using the methodology of \newcite{Carroll:1998} for parser comparison. In the extrinsic evaluation, the parsers' impact in a practical application is compared within the context of answer extraction. The differences in the results are significant.