Yu, J., Khosla, S., Moosavi, N.S. orcid.org/0000-0002-8332-307X et al. (3 more authors) (2022) The Universal Anaphora Scorer. In: Calzolari, N., Béchet, F., Blache, P., Choukri, K., Cieri, C., Declerck, T., Goggi, S., Isahara, H., Maegaard, B., Mariani, J., Mazo, H., Odijk, J. and Piperidis, S., (eds.) Proceedings of the Thirteenth Language Resources and Evaluation Conference, LREC 2022. 13th Conference on Language Resources and Evaluation (LREC 2022), 20-25 Jun 2022, Marseille, France. European Language Resources Association (ELRA) , pp. 4873-4883. ISBN 9791095546726
Abstract
The aim of the Universal Anaphora initiative is to push forward the state of the art in anaphora and anaphora resolution by expanding the aspects of anaphoric interpretation which are or can be reliably annotated in anaphoric corpora, producing unified standards to annotate and encode these annotations, deliver datasets encoded according to these standards, and developing methods for evaluating models carrying out this type of interpretation. Such expansion of the scope of anaphora resolution requires a comparable expansion of the scope of the scorers used to evaluate this work. In this paper, we introduce an extended version of the Reference Coreference Scorer (Pradhan et al., 2014) that can be used to evaluate the extended range of anaphoric interpretation included in the current Universal Anaphora proposal. The UA scorer supports the evaluation of identity anaphora resolution and of bridging reference resolution, for which scorers already existed but not integrated in a single package. It also supports the evaluation of split antecedent anaphora and discourse deixis, for which no tools existed. The proposed approach to the evaluation of split antecedent anaphora is entirely novel; the proposed approach to the evaluation of discourse deixis leverages the encoding of discourse deixis proposed in Universal Anaphora to enable the use for discourse deixis of the same metrics already used for identity anaphora. The scorer was tested in the recent CODI-CRAC 2021 Shared Task on Anaphora Resolution in Dialogues.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | © European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0 (http://creativecommons.org/licenses/by-nc/4.0/). |
Keywords: | Anaphora Resolution; Evaluation; Univeral Anaphora |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 07 Jun 2023 12:29 |
Last Modified: | 29 Oct 2024 12:06 |
Published Version: | https://aclanthology.org/2022.lrec-1.521 |
Status: | Published |
Publisher: | European Language Resources Association (ELRA) |
Refereed: | Yes |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:199940 |