Sanderson, M. and Soboroff, I. (2007) Problems with Kendall's Tau. In: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval, July 23 - 27, 2007, Amsterdam, The Netherlands. ACM , New York , pp. 839-840. ISBN 978-1-59593-597-7Full text available as:
This poster describes a potential problem with a relatively well used measure in Information Retrieval research: Kendall's Tau rank correlation coefficient. The coefficient is best known for its use in determining the similarity of test collections when ranking sets of retrieval runs. Threshold values for the coefficient have been defined and used in a number of published studies in information retrieval. However, this poster presents results showing that basing decisions on such thresholds is not as reliableas has been assumed.
|Item Type:||Proceedings Paper|
|Institution:||The University of Sheffield|
|Academic Units:||The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)|
|Depositing User:||Repository Officer|
|Date Deposited:||08 Sep 2008 17:26|
|Last Modified:||15 Sep 2014 03:39|