White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Measuring pseudo relevance feedback & CLIR

Sanderson, M. and Clough, P. (2004) Measuring pseudo relevance feedback & CLIR. In: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval, 25-29 July, 2004, Sheffield, UK. ACM , New York , pp. 484-485. ISBN 1-58113-881-4

SIGIR2004CloughSanderson.pdf - Accepted Version

Download (197Kb)


In this poster, we report on the effects of pseudo relevance feedback (PRF) for a cross language image retrieval task using a test collection. Typically PRF has been shown to improve retrieval performance in previous CLIR experiments based on average precision at a fixed rank. However our experiments have shown that queries in which no relevant documents are returned also increases. Because query reformulation for cross language is likely to be harder than with monolingual searching, a great deal of user dissatisfaction would be associated with this scenario. We propose that an additional effectiveness measure based on failed queries may better reflect user satisfaction than average precision alone.

Item Type: Proceedings Paper
Copyright, Publisher and Additional Information: This is an author produced version of a paper published in "Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval". Uploaded in accordance with the publisher's self-archiving policy.
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)
Depositing User: Repository Officer
Date Deposited: 15 Sep 2008 17:22
Last Modified: 15 Apr 2014 15:33
Published Version: http://dx.doi.org/10.1145/1008992.1009082
Status: Published
Publisher: ACM
Identification Number: 10.1145/1008992.1009082
URI: http://eprints.whiterose.ac.uk/id/eprint/4580

Actions (repository staff only: login required)