The effect of sampling strategy on inferred measures

SIGIR 2014 - Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2014, Pages 1119-1122

  Voorhees, Ellen M ^a  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

Incomplete judgments; Sampling; Test collections

Indexed keywords

SAMPLING;

INCOMPLETE JUDGMENTS; SAMPLING STRATEGIES; TEST COLLECTION;

INFORMATION RETRIEVAL;

EID: 84904555283     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2600428.2609524     Document Type: Conference Paper

References (5)

1. T. Bompada, C.-C. Chang, J. Chen, R. Kumar, and R. Shenoy. On the robustness of relevance measures with incomplete judgments. In Proceedings of SIGIR 2007, pages 359-366, 2007.
2. K. Sparck Jones and C. van Rijsbergen. Report on the need for and provision of an "ideal" information retrieval test collection. British Library Research and Development Report 5266, 1975.
3. E. M. Voorhees. The TREC Medical Records track. In Proceedings of ACM Conference on Bioinformatics, Computational Biology and Biomedical Informatics, pages 239-246, 2013.
4. E. Yilmaz and J. A. Aslam. Estimating average precision when judgments are incomplete. Knowledge Information Systems, 16:173-211, 2008.
5. E. Yilmaz, E. Kanoulas, and J. A. Aslam. A simple and efficient sampling method for estimating AP and NDCG. In Proceedings of SIGIR 2008, pages 603-610, 2008.