Sanderson, M. and Clough, P. (2004) Measuring pseudo relevance feedback & CLIR. In: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval, 25-29 Jul 2004, Sheffield, UK. ACM , New York , pp. 484-485. ISBN 1-58113-881-4
Abstract
In this poster, we report on the effects of pseudo relevance feedback (PRF) for a cross language image retrieval task using a test collection. Typically PRF has been shown to improve retrieval performance in previous CLIR experiments based on average precision at a fixed rank. However our experiments have shown that queries in which no relevant documents are returned also increases. Because query reformulation for cross language is likely to be harder than with monolingual searching, a great deal of user dissatisfaction would be associated with this scenario. We propose that an additional effectiveness measure based on failed queries may better reflect user satisfaction than average precision alone.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | This is an author produced version of a paper published in "Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval". Uploaded in accordance with the publisher's self-archiving policy. |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield) |
Depositing User: | Repository Officer |
Date Deposited: | 15 Sep 2008 17:22 |
Last Modified: | 19 Dec 2022 13:20 |
Published Version: | http://dx.doi.org/10.1145/1008992.1009082 |
Status: | Published |
Publisher: | ACM |
Identification Number: | 10.1145/1008992.1009082 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:4580 |