Padro, M., Idiart, M., Villavicencio, A. orcid.org/0000-0002-3731-9168 et al. (1 more author) (2014) Comparing similarity measures for distributional thesauri. In: Calzolari, N., Choukri, K., Declerck, T., Loftsson, H, Maegaard, B., Mariani, J., Moreno, A., Odijk, J and Piperidis, S., (eds.) Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). Ninth International Conference on Language Resources and Evaluation (LREC'14), 26-31 May 2014, Reykjavik, Iceland. European Language Resources Association (ELRA) , pp. 2964-2971. ISBN 9782951740884
Abstract
Distributional thesauri have been applied for a variety of tasks involving semantic relatedness. In this paper, we investigate the impact of three parameters: similarity measures, frequency thresholds and association scores. We focus on the robustness and stability of the resulting thesauri, measuring inter-thesaurus agreement when testing different parameter values. The results obtained show that low-frequency thresholds affect thesaurus quality more than similarity measures, with more agreement found for increasing thresholds. These results indicate the sensitivity of distributional thesauri to frequency. Nonetheless, the observed differences do not transpose over extrinsic evaluation using TOEFL-like questions. While this may be specific to the task, we argue that a careful examination of the stability of distributional resources prior to application is needed.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | © 2014 European Language Resources Association (ELRA) |
Keywords: | distributional thesauri; frequency filters; similarity measures |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 21 Nov 2019 15:07 |
Last Modified: | 21 Nov 2019 16:29 |
Published Version: | http://www.lrec-conf.org/proceedings/lrec2014/pdf/... |
Status: | Published |
Publisher: | European Language Resources Association (ELRA) |
Refereed: | Yes |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:153572 |