Methods for ranking information retrieval systems without relevance judgments

Proceedings of the ACM Symposium on Applied Computing

Volumn , Issue , 2003, Pages 811-816

  Wu, Shengli ^a   Crestani, Fabio ^a  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Information Retrieval; Performance Evaluation; Ranking; Relevance Judgement

Indexed keywords

ALGORITHMS; DATA REDUCTION; SEARCH ENGINES; WORLD WIDE WEB;

RELEVANCE JUDGEMENT;

INFORMATION RETRIEVAL;

EID: 0038336780     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/952686.952693     Document Type: Conference Paper

References (12)

1. N. J. Belkin, P. B. Kantor, E. A. Fox, and J. A. Shaw. Combining the evidence of multiple query representations for information retrieval. Information Processing and Management, 31(3):431-448, 1995.
2. J. K. Callan, M. Connell, and A. Du. Automatic discovery of language models for text databases. In Proceedings of ACM SIGMOD International Conference, pages 479-490, Philadelphia, USA, May 1999.
3. G. Cormack, C. Palmer, and C. Clarke. Efficient construction of large test collections. In Proceedings of the 21st Annual International ACM SIGIR Conference, pages 282-289, Melbourne, Australia, August 1998.
4. J. H. Lee. Analysis of multiple evidence combination. In Proceedings of the 20th Annual International ACM SIGIR Conference, pages 267-275, Philadelphia, Pennsylvania, USA, July 1997.
5. J. A. Shaw and E, A. Fox. Combination of multiple searches. In Proceedings of 3rd Text Retrieval Conference (TREC-9), pages 267-275, Gaithersburg, Maryland, USA, April 1995.
6. I. Soboroff, C. Nicholas, and P. Cahan. Ranking retrieval systems without relevance judgements. In Proceedings of 24th Annual International ACM SIGIR Conference, pages 66-73, New Orleans, Louisiana, USA, September 2001.
7. E. M. Voorhees, editor. Proceedings of 10th Text Retrieval Conference, Gaithersburg, Maryland, USA, November 2001. National Technical Information Service of USA.
8. E. M. Voorhees and D. K. Harman, editors. Proceedings of 5th Text Retrieval Conference, Gaithersburg, Maryland, USA, November 20-22 1996.
9. E. M. Voorhees and D. K. Harman, editors. Proceedings of 8th Text Retrieval Conference, Gaithersburg, Maryland, USA, November 1999. National Technical Information Service of USA.
10. C. C. Vort and G. A. Cotterell. A fusion via a linear combination of scores. Information Retrieval, 1(3):151-173, October 1999.
11. S. Wu and F. Crestani. Data fusion with estimated weights. In Proceedings of the Eleventh International Conference on Information and Knowledge Management, McLean, USA, November 2001.
12. J. Zobel. How reliable are the results of large-scale retrieval experiments. In Proceedings of the 21st International Conference on ACM SIGIR Conference, pages 307-314, Melbourne, Australia, April 1998.