Roberts, A and Atwell, ES (2003) The use of corpora for automatic evaluation of grammar inference systems. In: Archer, D, Rayson, P, Wilson, A and McEnery, T, (eds.) Proceedings of the Corpus Linguistics 2003 conference. Corpus Lingusitics 2003, 28-31 Mar 2003, Lancaster University. Lancaster University , 657 - 661.
Abstract
The evaluation of grammar inference systems is clearly a non-trivial task, as it is possible to have more than one correct grammar for a given language. The ‘looks good to me’ approach, carried out by computational linguists analysing their own grammar inference system results, has prevailed for many years. This paper explores why this method has been so popular, in terms of its strengths, and also why it is no longer adequate as a reliable means to measuring performance. Corpus based methods, that can be performed automatically, are investigated to see how they can meet the needs of this difficult problem.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | Roberts, A and Atwell, ES (c) 2003, University of Leeds. Reproduced with permission from the copyright holders. |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) > Artificial Intelligence & Biological Systems (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 25 Nov 2014 12:58 |
Last Modified: | 19 Dec 2022 13:28 |
Published Version: | http://ucrel.lancs.ac.uk/cl2003/ |
Status: | Published |
Publisher: | Lancaster University |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:81222 |