Inferring document relevance from incomplete information

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2007, Pages 633-642

  Aslam, Javed A ^a   Yilmaz, Emine ^a  

^a NORTHEASTERN UNIVERSITY   (United States)

Author keywords

Average precision; Incomplete judgments; Relevance judgments

Indexed keywords

AVERAGE PRECISION; INCOMPLETE INFORMATIONS; INCOMPLETE JUDGMENTS; RANDOM SAMPLES; RELEVANCE JUDGMENTS; RETRIEVAL PERFORMANCE; SYSTEM EVALUATIONS;

KNOWLEDGE MANAGEMENT;

LAKES;

EID: 63449125656     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1321440.1321529     Document Type: Conference Paper

References (11)

1. J. A. Aslam, V. Pavlu, and R. Savell. A unified model for metasearch, pooling, and system evaluation. In O. Frieder, J. Hammer, S. Quershi, and L. Seligman, editors, Proceedings of the Twelfth International Conference on Information and Knowledge Management, pages 484 - 491. ACM Press, November 2003.
2. J. A. Aslam, V. Pavlu, and E. Yilmaz. A statistical method for system evaluation using incomplete judgments. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval,pages 541 - 548. ACM Press, August 2006.
3. J. A. Aslam and E. Yilmaz. Inferring document relevance via average precision. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 601 - 602. ACM Press, August 2006.
4. J. A. Aslam, E.Yilmaz, and V. Pavlu. The maximum entropy method for analyzing retrieval measures. In G. Marchionini, A. Moffat, J. Tait, R. Baeza-Yates, and N. Ziviani, editors, Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 27 - 34. ACM Press, August 2005.
5. B. Carterette, J. Allan, and R. Sitaraman. Minimal test collections for retrieval evaluation. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 268 - 275, 2006.
6. G. V. Cormack, C. R. Palmer, and C. L. A. Clarke. Efficient construction of large test collections. In Croft et al. [7], pages 282 - 289.
7. W. B. Croft, A. Moffat, C. J. van Rijsbergen, R.Wilkinson, and J. Zobel, editors. Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Aug.1998.
8. D. Harman. Overview of the third text RE treival conference (TREC-3).In D. Harman, editor, Overview of the Third Text REtrieval Conference (TREC-3), pages 1 - 19. U.S. Government Printing Office, Apr. 1995.
9. E. M. Voorhees. Variations in relevance judgments and the measurement of retrieval effectiveness. In Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 315 - 323. ACM Press, 1998.
10. E. Yilmaz and J. A. Aslam. Estimating average precision with incomplete and imperfect judgments. In Proceedings of the Fifteenth ACM International Conference on Information and Knowledge Management, pages 102 - 111. ACM Press, November 2006.
11. J. Zobel. How reliable are the results of large-scale retrieval experiments? In Croft et al. [7], pages 307 - 314.