Al-Maskari, A., Clough, P. and Sanderson, M. (2006) Users' effectiveness and satisfaction for image retrieval. In: Proceedings of the LWA 2006 Workshop. LWA 2006: Lernen - Wissensentdeckung - Adaptivität, October 9th-11th 2006, Hildesheim. , pp. 84-88.Full text available as:
This paper presents results from an initial user study exploring the relationship between system effectiveness as quantified by traditional measures such as precision and recall, and users’ effectiveness and satisfaction of the results. The tasks involve finding images for recall-based tasks. It was concluded that no direct relationship between system effectiveness and users’ performance could be proven (as shown by previous research). People learn to adapt to a system regardless of its effectiveness. This study recommends that a combination of attributes (e.g. system effectiveness, user performance and satisfaction) is a more effective way to evaluate interactive retrieval systems. Results of this study also reveal that users are more concerned with accuracy than coverage of the search results.
|Item Type:||Proceedings Paper|
|Institution:||The University of Sheffield|
|Academic Units:||The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)|
|Depositing User:||Repository Officer|
|Date Deposited:||18 Sep 2008 16:36|
|Last Modified:||08 Feb 2013 16:56|