Sanderson, M. and Clough, P. (2004) Measuring pseudo relevance feedback & CLIR. In: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval, 25-29 July, 2004, Sheffield, UK. ACM , New York , pp. 484-485. ISBN 1-58113-881-4
In this poster, we report on the effects of pseudo relevance feedback (PRF) for a cross language image retrieval task using a test collection. Typically PRF has been shown to improve retrieval performance in previous CLIR experiments based on average precision at a fixed rank. However our experiments have shown that queries in which no relevant documents are returned also increases. Because query reformulation for cross language is likely to be harder than with monolingual searching, a great deal of user dissatisfaction would be associated with this scenario. We propose that an additional effectiveness measure based on failed queries may better reflect user satisfaction than average precision alone.
|Copyright, Publisher and Additional Information:||This is an author produced version of a paper published in "Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval". Uploaded in accordance with the publisher's self-archiving policy.|
|Institution:||The University of Sheffield|
|Academic Units:||The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)|
|Depositing User:||Repository Officer|
|Date Deposited:||15 Sep 2008 17:22|
|Last Modified:||15 Apr 2014 15:33|