Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement

Journal of Educational and Behavioral Statistics

Volumn 24, Issue 1, 1999, Pages 42-69

  Williams, Valerie S L ^a   Jones, Lyle V ^b   Tukey, John W ^c  

^a NORTH CAROLINA CENTRAL UNIVERSITY   (United States)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

^c LUCENT TECHNOLOGIES   (United States)

Author keywords

Educational assessment; Hpothesis testing; Multiple comparisons; National Assessment of Educational Progress (NAEP)

Indexed keywords

EID: 0033466163     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986024001042     Document Type: Article

References (12)

1. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society B, 57(1), 289-300.
2. Benjamini, Y., Hochberg, Y., & Kling, Y. (1994) False discovery rate controlling procedures for pairwise comparisons. Unpublished manuscript.
3. Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75. 800-803.
4. Hochberg, Y., & Tamhane, A. C. (1987). Multiple comparison procedures. New York: Wiley.
5. Johnson, E. G., Mazzeo, J., & Kline, D. L. (1993). Technical report of the NAEP 1992 Trial State Assessment program in mathematics. Report 23-ST05. Washington, DC: National Center for Education Statistics.
6. Mullis, I., Dossey, J., Owen, E., & Phillips, G. (1993). NAEP 1992 mathematics report card for the nation and the states. Washington, DC: National Center for Education Statistics.
7. Shaffer, J. P. (1994). Multiple hypothesis testing: A review (Technical Report #23.) Research Triangle Park, NC: National Institute of Statistical Sciences.
8. Tukey, J.W. (1991). The philosophy of multiple comparisons. Statistical Science, 6. 100-116.
9. Tukey, J. W. (1993). Where should multiple comparisons go next? In Fred M. Hoppe (Ed.), Multiple comparisons, selection, and applications in biometry (pp. 187-207). New York: Marcel Dekker, Inc.
10. Tukey, J. W., & Hoaglin, D. C. (1991). Qualitative and quantitative inference. In Hoaglin, D. C., Mosteller, F., & Tukey, J. W., Fundamentals of exploratory analysis of variance. New York: Wiley.
11. Tukey, J. W., Mosteller, F., & Hoaglin, D. C. (1991). Concepts and examples in analysis of variance. In Hoaglin, D. C., Mosteller, F., & Tukey, J. W., Fundamentals of exploratory analysis of variance. New York: Wiley.
12. Williams, V. S. L., Jones, L. V., & Tukey, J. W. (1994). Controlling error in multiple comparisons, with special attention to the National Assessment of Educational Progress (Technical Report #33). Research Triangle Park, NC: National Institute of Statistical Sciences.