Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes

Proceedings - 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009

Volumn , Issue , 2009, Pages 630-631

  Smucker, Mark D ^a   Allan, James ^b   Carterette, Ben ^c  

^a UNIVERSITY OF WATERLOO   (Canada)

^b The Manning College of Information and Computer Sciences   (United States)

^c Institute University of Delaware Newark   (United States)

Author keywords

Statistical significance

Indexed keywords

P-VALUES; RANDOMIZATION TESTS; SAMPLE SIZES; STATISTICAL SIGNIFICANCE; STATISTICAL SIGNIFICANCE TEST; SYSTEMATIC BIAS;

INFORMATION RETRIEVAL; INFORMATION SERVICES; MULTIVARIABLE CONTROL SYSTEMS; RESEARCH;

STATISTICAL TESTS;

EID: 72449159192     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1571941.1572050     Document Type: Conference Paper

References (2)

1. B. Carterette, V. Pavlu, E. Kanoulas, J. A. Aslam, and J. Allan. Evaluation over thousands of queries. In SIGIR '08, pages 651-658. ACM Press, 2008.
2. M. D. Smucker, J. Allan, and B. Carterette. A comparison of statistical significance tests for information retrieval evaluation. In CIKM '07, pages 623-632. ACM Press, 2007.