White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Problems with Kendall's Tau

Sanderson, M. and Soboroff, I. (2007) Problems with Kendall's Tau. In: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval, July 23 - 27, 2007, Amsterdam, The Netherlands. ACM , New York , pp. 839-840. ISBN 978-1-59593-597-7


This poster describes a potential problem with a relatively well used measure in Information Retrieval research: Kendall's Tau rank correlation coefficient. The coefficient is best known for its use in determining the similarity of test collections when ranking sets of retrieval runs. Threshold values for the coefficient have been defined and used in a number of published studies in information retrieval. However, this poster presents results showing that basing decisions on such thresholds is not as reliableas has been assumed.

Item Type: Proceedings Paper
Keywords: Kendall’s Tau
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)
Depositing User: Repository Officer
Date Deposited: 08 Sep 2008 17:26
Last Modified: 15 Sep 2014 03:39
Published Version: http://dx.doi.org/10.1145/1277741.1277935
Status: Published
Publisher: ACM
Identification Number: 10.1145/1277741.1277935
URI: http://eprints.whiterose.ac.uk/id/eprint/4589

Actions (repository staff only: login required)