LLMs as narcissistic evaluators: when ego inflates evaluation scores

Liu, Y., Moosavi, N.S. orcid.org/0000-0002-8332-307X and Lin, C. (2024) LLMs as narcissistic evaluators: when ego inflates evaluation scores. In: Ku, L-W., Martins, A. and Srikumar, V., (eds.) Findings of the Association for Computational Linguistics: ACL 2024. The 62nd Annual Meeting of the Association for Computational Linguistics, 11-16 Aug 2024, Bangkok, Thailand. Association for Computational Linguistics , pp. 12688-12701.

Abstract

Metadata

Item Type: Proceedings Paper
Authors/Creators:
Editors:
  • Ku, L-W.
  • Martins, A.
  • Srikumar, V.
Copyright, Publisher and Additional Information:

© 2024 The Authors. This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Dates:
  • Published: 1 January 2024
  • Published (online): 1 January 2024
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield)
Depositing User: Symplectic Sheffield
Date Deposited: 14 Nov 2024 15:01
Last Modified: 14 Nov 2024 15:01
Status: Published
Publisher: Association for Computational Linguistics
Refereed: Yes
Identification Number: 10.18653/v1/2024.findings-acl.753
Related URLs:
Open Archives Initiative ID (OAI ID):

Export

Statistics