Madabushi, H.T., Gow-Smith, E., Garcia, M. et al. (3 more authors) (2022) SemEval-2022 Task 2 : multilingual idiomaticity detection and sentence embedding. In: Emerson, G., Schluter, N., Stanovsky, G., Kumar, R., Palmer, A., Schneider, N., Singh, S. and Ratan, S., (eds.) Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022). 16th International Workshop on Semantic Evaluation (SemEval-2022), 14-15 Jul 2022, Seattle, WA, USA. Association for Computational Linguistics (ACL) , pp. 107-121. ISBN 9781955917803
Abstract
This paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification task aimed at identifying whether a sentence contains an idiomatic expression, and (b) a task based on semantic text similarity which requires the model to adequately represent potentially idiomatic expressions in context. Each subtask includes different settings regarding the amount of training data. Besides the task description, this paper introduces the datasets in English, Portuguese, and Galician and their annotation procedure, the evaluation metrics, and a summary of the participant systems and their results. The task had close to 100 registered participants organised into twenty five teams making over 650 and 150 submissions in the practice and evaluation phases respectively.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | © 2022 Association for Computational Linguistics. Published under a a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/). |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Funding Information: | Funder Grant number Engineering and Physical Sciences Research Council EP/T02450X/1 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 01 Sep 2022 13:28 |
Last Modified: | 01 Sep 2022 13:28 |
Published Version: | https://aclanthology.org/2022.semeval-1.13 |
Status: | Published |
Publisher: | Association for Computational Linguistics (ACL) |
Refereed: | Yes |
Identification Number: | 10.18653/v1/2022.semeval-1.13 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:190381 |