Clough, P. and Sanderson, M. (2004) Assessing translation quality for cross language image retrieval. In: Comparative Evaluation of Multilingual Information Access Systems : 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers. Lecture Notes in Computer Science (3237). Springer , Berlin / Heidelberg , pp. 594-610. ISBN 978-3-540-24017-4
Abstract
Like other cross language tasks, we show that the quality of the translation resource, among other factors, has an effect on retrieval performance. Using data from the ImageCLEF test collection, we investigate the relationship between translation quality and retrieval performance when using Systran, a machine translation (MT) system, as a translation resource. The quality of translation is assessed manually by comparing the original ImageCLEF topics with the output from Systran and rated by assessors based on their semantic content. Quality is also measured using an automatic score derived from the mteval MT evaluation tool, and compared to the manual assessment score. Like other MT tasks, we find that measures based on the automatic score are correlated with the manual assessments for this CLIR task. The results from this short study formed our entry to ImageCLEF 2003.
Metadata
Item Type: | Book Section |
---|---|
Authors/Creators: |
|
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield) |
Depositing User: | Repository Officer |
Date Deposited: | 23 Sep 2008 16:36 |
Last Modified: | 08 Feb 2013 16:58 |
Published Version: | http://dx.doi.org/10.1007/b102261 |
Status: | Published |
Publisher: | Springer |
Series Name: | Lecture Notes in Computer Science |
Refereed: | Yes |
Identification Number: | 10.1007/b102261 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:4711 |