INEX 2005 evaluation measures

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3977 LNCS, Issue , 2006, Pages 16-29

  Kazai, Gabriella ^a   Lalmas, Mounia ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SCIENCE; FUNCTIONS; TECHNICAL PRESENTATIONS;

EXTENDED CUMULATED GAIN (XCG) MEASURES; INEX 2005 AD-HOC TASKS; QUANTISATION FUNCTIONS;

INFORMATION RETRIEVAL;

EID: 33746041096     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11766278_2     Document Type: Conference Paper

References (9)

1. W. Conover. Practical Non-Parametric Statistics, 2nd edn. John Wiley & Sons, Inc., New York, NY, USA, 1980.
2. K. Järvelin and J. Kekäläinen. Cumulated Gain-based evaluation of IR techniques. ACM Transactions on Information Systems (ACM TOIS), 20(4):422-446, 2002.
3. N. Kando, K. Kuriyama, and M. Yoshioka. Information retrieval system evaluation using multi-grade relevance judgements - discussion on averageable single-numbered measures (in Japanese). Technical report, 2001.
4. G. Kazai and M. Lalmas. eXtended Cumulated Gain Measures for the Evaluation of Content-oriented XML Retrieval. ACM Transactions on Information Systems (ACM TOIS), To appear.
5. J. Kekäläinen and K. Järvelin. Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology, 53(13): 1120-1129, 2002.
6. S. Malik, G. Kazai, M. Lalmas, and N. Fuhr. Overview of inex 2005. In N. Fuhr, M. Lalmas, S. Malik, and G. Kazai, editors, Advances in XML Information Retrieval and Evaluation: Fourth Workshop of the INitiative for the Evaluation of XML Retrieval (INEX 2005), Schloss Dagstuhl, 28-30 November 2005, volume 3977 of Lecture Notes in Computer Science, pages 1-15. Springer-Verlag, 2006.
7. C. J. V. Rijsbergen. Information Retrieval. Butterworth-Heinemann, Newton, MA, USA, 1979. Available at http://www.dcs.glasgow.ac.uk/Keith/Preface. html.
8. T. Sakai. New performance metrics based on multigrade relevance: Their application to question answering. In NTCIR Workshop 4 Meeting Working Notes, June 2004.
9. E. M. Voorhees. Evaluation by highly relevant documents. In SIGIR'01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pages 74-82, New York, NY, USA, 2001. ACM Press.