White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Assessing translation quality for cross language image retrieval

Clough, P. and Sanderson, M. (2004) Assessing translation quality for cross language image retrieval. In: Comparative Evaluation of Multilingual Information Access Systems : 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers. Lecture Notes in Computer Science (3237). Springer , Berlin / Heidelberg , pp. 594-610. ISBN 978-3-540-24017-4


Download (287Kb)


Like other cross language tasks, we show that the quality of the translation resource, among other factors, has an effect on retrieval performance. Using data from the ImageCLEF test collection, we investigate the relationship between translation quality and retrieval performance when using Systran, a machine translation (MT) system, as a translation resource. The quality of translation is assessed manually by comparing the original ImageCLEF topics with the output from Systran and rated by assessors based on their semantic content. Quality is also measured using an automatic score derived from the mteval MT evaluation tool, and compared to the manual assessment score. Like other MT tasks, we find that measures based on the automatic score are correlated with the manual assessments for this CLIR task. The results from this short study formed our entry to ImageCLEF 2003.

Item Type: Book Section
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)
Depositing User: Repository Officer
Date Deposited: 23 Sep 2008 16:36
Last Modified: 08 Feb 2013 16:58
Published Version: http://dx.doi.org/10.1007/b102261
Status: Published
Publisher: Springer
Refereed: Yes
Identification Number: 10.1007/b102261
URI: http://eprints.whiterose.ac.uk/id/eprint/4711

Actions (repository staff only: login required)