Semiautomatic evaluation of retrieval systems using document similarities

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2007, Pages 873-876

  Carterette, Ben ^a   Allan, James ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

Clustering; Evaluation; Information retrieval; Test collections

Indexed keywords

CLUSTER HYPOTHESIS; CLUSTERING; DOCUMENT SIMILARITIES; EVALUATION; OTHER ALGORITHMS; RELEVANCE JUDGMENTS; RETRIEVAL SYSTEMS; TEST COLLECTIONS;

INFORMATION SERVICES; KNOWLEDGE MANAGEMENT; NATURAL LANGUAGE PROCESSING SYSTEMS;

INFORMATION RETRIEVAL;

EID: 63449106848     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1321440.1321564     Document Type: Conference Paper

References (12)

1. J. A. Aslam, V. Pavlu, and E. Yilmaz. A statistical method for system evaluation using incomplete judgments. In Proc. SIGIR, pages 541-548, 2006.
2. C. Buckley and E. M. Voorhees. Retrieval evaluation with incomplete information. In Proc. SIGIR, pages 25-32, 2004.
3. B. Carterette. Robust test collections for retrieval evaluation. In Proc. SIGIR, pages 55-62, 2007.
4. B. Carterette, J. Allan, and R. K. Sitaraman. Minimal test collections for retrieval evaluation. In Proceedings of SIGIR, pages 268-275, 2006.
5. G. V. Cormack and T. R. Lyman.Power and bias of subset pooling strategies. In Proc. SIGIR, pages 837-838, 2007.
6. G. V. Cormack, C. R. Palmer, and C. L. Clarke. Efficient Construction of Large Test Collections. In Proceedings of SIGIR, pages 282-289, 1998.
7. F. Diaz. Regularizing ad hoc retrieval scores. In Proceedings of CIKM, pages 672-679, 2005.
8. E. C. Jensen. Repeatable Evaluation of Information Retrieval Effectiveness in Dynamic Environments. PhD thesis, Illinois Institute of Technology, 2006.
9. T. Joachims. Evaluating retrieval performance using clickthrough data. In Text Mining, pages 79-96. 2003.
10. P. Komarek and A. Moore. Making logistic regression a core data mining tool: a practical investigation of accuracy, speed, and simplicity. Technical Report CMU-RI-TR-05-27, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, May 2005.
11. C. J. van Rijsbergen. Information Retrieval. Butterworths, London, UK, 1979.
12. E. Yilmaz and J. Aslam. Estimating average precision with incomplete and imperfect relevance judgments. In Proceedings of CIKM, pages 102-111, 2006.