The use of corpora for automatic evaluation of grammar inference systems
Roberts, A and Atwell, ES
(2003)
The use of corpora for automatic evaluation of grammar inference systems.
In: Archer, D, Rayson, P, Wilson, A and McEnery, T, (eds.)
Proceedings of the Corpus Linguistics 2003 conference.
Corpus Lingusitics 2003, 28-31 Mar 2003, Lancaster University.
Lancaster University
, 657 - 661.
Abstract
The evaluation of grammar inference systems is clearly a non-trivial task, as it is possible to have more than one correct grammar for a given language. The ‘looks good to me’ approach, carried out by computational linguists analysing their own grammar inference system results, has prevailed for many years. This paper explores why this method has been so popular, in terms of its strengths, and also why it is no longer adequate as a reliable means to measuring performance. Corpus based methods, that can be performed automatically, are investigated to see how they can meet the needs of this difficult problem.
Metadata
Authors/Creators:
Roberts, A
Atwell, ES
Copyright, Publisher and Additional Information:
Roberts, A and Atwell, ES (c) 2003, University of Leeds. Reproduced with permission from the copyright holders.
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)