Parameter sensitivity in Rank-Biased precision

ADCS 2008 - Proceedings of the Thirteenth Australasian Document Computing Symposium

Volumn , Issue , 2008, Pages 61-68

  Zhang, Yuye ^a   Park, Laurence A F ^a   Moffat, Alistair ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Evaluation; Rank Biased precision; System comparison

Indexed keywords

EVALUATION; EVALUATION EXPERIMENTS; GEOMETRIC DISTRIBUTION; P-VALUES; PARAMETER SENSITIVITIES; RANK-BIASED PRECISION; RETRIEVAL EVALUATION; RETRIEVAL SYSTEMS; SYSTEM COMPARISONS; WEIGHTED SUM;

EXPERIMENTS; PROBABILITY DISTRIBUTIONS;

INFORMATION RETRIEVAL;

EID: 84872875391     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (8)

1. Chris Buckley and Ellen M. Voorhees. Retrieval evaluation with incomplete information. In Proc. 27th Ann. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pages 25-32, Sheffield, United Kingdom, 2004. ACM Press, New York.
2. Kalervo Järvelin and Jaana Kekäläinen. Cumulated gainbased evaluation of IR techniques. ACM Transactions on Information Systems, 20(4):422-446, 2002.
3. Alistair Moffat and Justin Zobel. Rank-biased precision for measurement of retrieval effectiveness. ACM Transactions on Information Systems, January 2009. To appear.
4. Alistair Moffat, William Webber, and Justin Zobel. Strategic system comparisons via targeted relevance judgments. In Proc. 30th Ann. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pages 375-382, Amsterdam, The Netherlands, 2007. ACM Press, New York.
5. Laurence A. F. Park and Yuye Zhang. On the distribution of user persistence for rank-biased precision. In Proc. 12th Australasian Document Computing Symp., pages 17-24. School of Computer Science and Information Technology, RMIT University, Australia, December 2007.
6. Tetsuya Sakai. Ranking the NTCIR systems based on multigrade relevance. In Proc. Asian Information Retrieval Symp., volume 3411, LNCS, pages 251-262. Springer, Berlin/Heidelberg, October 2004.
7. Ellen M. Voorhees and Donna Harman. Overview of the Ninth Text REtrieval conference (TREC-9). In Proc. 2000 TREC Text Retrieval Conf. National Institute of Standards and Technology, November 2000. http://trec.nist.gov/pubs/trec9/papers/overview_9.pdf.
8. William Webber, Alistair Moffat, and Justin Zobel. Score standardization for inter-collection comparison of retrieval systems. In Proc. 31st Ann. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pages 51-58, Singapore, July 2008. ACM Press, New York.