Relying on topic subsets for system ranking estimation

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 1859-1862

  Hauff, Claudia ^a   Hiemstra, Djoerd ^a   De Jong, Franciska ^a   Azzopardi, Leif ^b  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Evaluation; System ranking estimation

Indexed keywords

ALTERNATIVE APPROACH; COMPREHENSIVE ANALYSIS; EVALUATION; EVALUATION SYSTEM; PERFORMANCE OF SYSTEMS; RELEVANCE JUDGMENT; RETRIEVAL EFFECTIVENESS; RETRIEVAL SYSTEMS; SYSTEM RANKINGS; TEST COLLECTION;

KNOWLEDGE MANAGEMENT; SET THEORY;

ESTIMATION;

EID: 74549114782     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646249     Document Type: Conference Paper

References (8)

1. J. A. Aslam and R. Savell. On the effectiveness of evaluating retrieval systems in the absence of relevance judgments. In SIGIR '03, pages 361-362, 2003.
2. F. Diaz. Performance prediction using spatial autocorrelation. In SIGIR '07, pages 583-590, 2007.
3. J. Guiver, S. Mizzaro, and S. Robertson. A few good topics: Experiments in topic set reduction for retrieval evaluation. To appear in TOIS.
4. S. Mizzaro and S. Robertson. Hits hits trec: exploring ir evaluation results with network analysis. In SIGIR '07, pages 479-486, 2007.
5. R. Nuray and F. Can. Automatic ranking of information retrieval systems using data fusion. IPM, 42(3):595-614, 2006.
6. I. Soboroff, C. Nicholas, and P. Cahan. Ranking retrieval systems without relevance judgments. In SIGIR '01, pages 66-73, 2001.
7. A. Spoerri. Using the structure of overlap between search results to rank retrieval systems without relevance judgments. IPM, 43(4):1059-1070, 2007.
8. S. Wu and F. Crestani. Methods for ranking retrieval systems without relevance judgments. In SAC '03, pages 811-816, 2003.