A comparison of pooled and sampled relevance judgments

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07

Volumn , Issue , 2007, Pages 785-786

  Soboroff, Ian ^a  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

Pooling; Sampling; Test collections

Indexed keywords

DATA ACQUISITION; DIGITAL LIBRARIES;

POOLED RELEVANCE JUDGMENTS; SAMPLED RELEVANCE JUDGMENTS; TEST COLLECTIONS;

INFORMATION RETRIEVAL;

EID: 36448954593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1277741.1277908     Document Type: Conference Paper

References (3)

1. J. A. Aslam, V. Pavlu, and E. Yilmaz. A statistical method for system evaluation using incomplete judgments. In Proceedings of SIGIR. 2006, pages 541-548, Seattle, Washington, July 2006.
2. C. Buckley, D. Dimmick, I. Soboroff, and E. Voorhees. Bias and the limits of pooling. In Proceedings of SIGIR. 2006, pages 619-620, Seattle, Washington, July 2006.
3. E. Yilmaz and J. A. Aslam. Estimating average precision with incomplete and imperfect judgments. In Proceedings of CIKM 2006, pages 102-111, Arlington, Virginia, November 2006.