A similarity measure for indefinite rankings

ACM Transactions on Information Systems

Volumn 28, Issue 4, 2010, Pages

  Webber, William ^a   Moffat, Alistair ^a   Zobel, Justin ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Probabilistic models; Rank correlation; Ranking

Indexed keywords

DAILY LIVES; DOCUMENT RANKING; INCOMPLETE RANKINGS; MAXIMUM SCORE; MONOTONICITY; POINT ESTIMATE; PROBABILISTIC MODELS; RANK CORRELATION; RANKING; RETRIEVAL SYSTEMS; SIMILARITY MEASURE; USER MODELS;

SEARCH ENGINES;

INFORMATION RETRIEVAL;

EID: 80051482719     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1852102.1852106     Document Type: Article

References (23)

1. BAR-ILAN, J. 2005. Comparing rankings of search results on the Web. Inform. Proc. Manag. 41, 1511-1519. (Pubitemid 41050721)
2. BAR-ILAN, J., MAT-HASSAN, M., AND LEVENE, M. 2006. Methods for comparing rankings of search engine results. Comput. Netw. 50, 10(July), 1448-1463. (Pubitemid 43669058)
3. BLEST, D. C. 2000. Rank correlation-an alternative measure. Australian and New Zealand J. Statis. 42, 1, 101-111.
4. BUCKLEY, C. 2004. Topic prediction based on comparative retrieval rankings. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, M. Sanderson, K. Järvelin, J. Allan, and P. Bruza, Eds. 506-507.
5. CARTERETTE, B. 2009. On rank correlation and the distance between rankings. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, J. Allan, J. Aslam, M. Sanderson, C. Zhai, and J. Zobel, Eds. 436-443.
6. CLIFF, N. 1996. Ordinal Methods for Behavioural Data Analysis. Lawrence Erlbaum Associates.
7. FAGIN, R., KUMAR, R., AND SIVAKUMAR, D. 2003. Comparing top k lists. SIAM J. Discrete Mathem. 17, 1, 134-160.
8. GIBBONS, J. D. AND CHAKRABORTI, S. 2003. Nonparametric Statistical Inference 4th Ed. CRC.
9. GOODMAN, L. A. AND KRUSKAL, W. H. 1954. Measures of association for cross classifications. J. Am. Statis. Assoc. 49, 268, 732-764.
10. IMAN, R. L. AND CONOVER, W. J. 1987. A measure of top-down correlation. Technometrics 29, 351-357.
11. JÄRVELIN, K. AND KEKÄLÄINEN, J. 2002. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inform. Syst. 20, 4, 422-446. (Pubitemid 44642296)
12. KENDALL, M. G. 1948. Rank Correlation Methods 1st Ed. Charles Griffin, London.
13. KNUTH, D. E. 1997. The Art of Computer Programming, Vol. I: Fundamental Algorithms. 3rd Ed. Addison Wesley, Reading, MA.
14. LESTER, N., MOFFAT, A., WEBBER, W., AND ZOBEL, J. 2005. Space-limited ranked query evaluation using adaptive pruning. In Proceedings of the 6th International Conference on Web Informations Systems. A. H. Ngu, M. Kitsuregawa, E. J. Neuhold, J.-Y. Chung, and Q. Z. Sheng, Eds. Lecture Notes in Computer Science, vol. 3806, 470-477. (Pubitemid 43829654)
15. MELUCCI, M. 2007. On rank correlation in information retrieval evaluation. SIGIR Forum 41, 1, 18-33.
16. MELUCCI, M. 2009. Weighted rank correlation in information retrieval evaluation. In Proceedings of the 5th Asia Information Retrieval Symposium, G. G. Lee, D. Song, C.-Y. Lin, A. Aizawa, K. Kuriyama, M. Yoshioka, and T. Sakai, Eds. Lecture Notes in Computer Science, vol. 5839, 75-86.
17. MOFFAT, A. AND ZOBEL, J. 2008. Rank-biased precision for measurement of retrieval effectiveness. ACM Trans. Inform. Syst. 27, 1, 1-27.
18. QUADE, D. AND SALAMA, I. A. 1992. A survey of weighted rank correlation. In Order Statistics and Nonparametrics: Theory and Applications, P. K. Sen and I. A. Salama, Eds. Elsevier, 213-224.
19. SHIEH, G. S. 1998. A weighted Kendall's tau statistic. Statist. Probability Lett. 39, 17-24. (Pubitemid 128354678)
20. TARSITANO, A. 2002. Nonlinear rank correlation. Departmental working paper, Universitò degli studi della Calabria.
21. WU, S. AND CRESTANI, F. 2003. Methods for ranking information retrieval systems without relevance judgments. In Proceedings of the ACM Symposium on Applied Computing (SAC). 811-816.
22. YILMAZ, E., ASLAM, J. A., AND ROBERTSON, S. 2008. A new rank correlation coefficient for information retrieval. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, S.-H. Myaeng, D. W. Oard, F. Sebastiani, T.-S. Chua, and M.-K. Leong, Eds. 587-594.
23. ZHAI, C. AND LAFFERTY, J. 2004. A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inform. Syst. 22, 2, (Apr.). 179-214.