Controlling the rate of Type I error over a large set of statistical tests

British Journal of Mathematical and Statistical Psychology

Volumn 55, Issue 1, 2002, Pages 27-39

  Keselman, H J ^a   Cribbie, Robert ^a   Holland, Burt ^b  

^a UNIVERSITY OF MANITOBA   (Canada)

^b TEMPLE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACHIEVEMENT; ARTICLE; HUMAN; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL;

ACHIEVEMENT; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL TESTS;

EID: 0036580893     PISSN: 00071102     EISSN: None     Source Type: Journal    
DOI: 10.1348/000711002159680     Document Type: Article

References (33)

1. Barton, R. M., Huberty, C. J. (1989, April). Multiple testing and correlation matrices: An application of three procedures. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco.
2. Benjamini, Y., Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society B, 57, 289-300.
3. Benjamini, Y., Hochberg, Y. (2000). On the adaptive control of the false discovery rate in multiple testing with independent statistics. Journal of Educational and Behavioral Statistics, 25, 60-83.
4. Benjamini, Y., Hochberg, Y., Kling, Y. (1994). False discovery rate controlling procedures for pairwise comparisons. Unpublished manuscript.
5. Benjamini, Y., Liu, W. (1999). A step-down multiple hypothesis testing procedure that controls the false discovery rate under independence. Journal of Statistical Planning and Inference, 82, 163-170.
6. Benjamini, Y., Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 29, 1152-1175.
7. Drigalenko, E. I., Elston, R. C. (1997). False discoveries in genome scanning. Genetic Epidemiology, 14, 779-784.
8. Einot, I., Gabriel, K. R. (1975). A study of the powers of several methods of multiple comparisons. Journal of the American Statistical Association, 70, 574-583.
9. Halperin, M., Lan, K. K. G., Hamdy, M. I. (1988). Some implications of an alternative definition of the multiple comparison problem. Biometrika, 75, 773-778.
10. Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.
11. Hochberg, Y., Benjamini, Y. (1990). More powerful procedures for multiple significance testing. Statistics in Medicine, 9, 811-818.
12. Holland, B., Cheung, S. H. (2002). Family size robustness criteria for multiple comparison procedures. Journal of the Royal Statistical Society, B, 54, 63-77.
13. Hommel, G. (1988). A comparison of two modified Bonferroni procedures. Biometrika, 75, 383-386.
14. Kaiser, H. F., Dickman, K. (1962). Sample and population score matrices and sample correlation matrices from an arbitrary population correlation matrix. Psychometrika, 27, 179-182.
15. Keselman, H. J., Cribbie, R., Holland, B. (1999). The pairwise multiple comparison multiplicity problem: An alternative approach to familywise/comparisonwise Type I error control. Psychological Methods, 4, 58-69.
16. Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., Levin, J. R. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA and ANCOVA analyses. Review of Educational Research, 68, 350-386.
17. Knoop, R. (1986). Job involvement: An elusive concept. Psychological Reports, 59, 451-456.
18. Mallet, L., Mayozer, B., Martinet, J. L. (1998). Functional connectivity in depressive, obsessive-compulsive, and schizophrenic disorders: An explorative correlational analysis of regional cerebral metabolism. Psychiatry Research: Neuroimaging Section, 82, 83-93.
19. Miller, R. G., Jr (1981). Simultaneous statistical inference, 2nd ed. New York: Springer-Verlag.
20. Olejnik, S., Li, J., Supattathum, S., Huberty, C. J. (1997). Multiple testing and statistical power with modified Bonferroni procedures. Journal of Educational and Behavioral Statistics, 22, 389-406.
21. Rom, D. M. (1990). A sequentially rejective test procedure based on a modified Bonferroni inequality. Biometrika, 77, 663-665.
22. Rothman, K. J. (1990). No adjustments are needed for multiple comparisons. Epidemiology, 1, 43-46.
23. 2 random variables: A proof of the Simes conjecture. Annals of Statistics, 26, 494-504.
24. Sarkar, S. K., Chang, C.-K. (1997). The Simes method for multiple hypothesis testing with positively dependent test statistics. Journal of the American Statistical Association, 92, 1601-1608.
25. SAS Institute (1989). SAS/IML software: Usage and reference, Version 6. Cary, NC: SAS Institute, Inc.
26. SAS Institute (1999). SAS/STAT user's guide, Version 7-1. Cary, NC: SAS Institute, Inc.
27. Saville, D. J. (1990). Multiple comparison procedures: The practical solution. American Statistician, 44, 174-180.
28. Schippman, J. S., Prien, E. P. (1986). Psychometric evaluation of an integrated assessment procedure. Psychological Reports, 59, 111-122.
29. Shaffer, J. P. (1995). Multiple hypothesis testing: A review. Annual Review of Psychology, 46, 561-584.
30. Westfall, P. H., Tobias, R. D., Rom, D., Wolfinger, R. D., Hochberg, Y. (1999). Multiple comparisons and multiple tests. Cary, NC: SAS Institute, Inc.
31. Williams, V. S. L., Jones, L. V., Tukey, J. W. (1999). Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. Journal of Educational and Behavioral Statistics, 24, 42-69.
32. Wilson, W. (1962). A note on the inconsistency inherent in the necessity to perform multiple comparisons. Psychological Bulletin, 59, 296-300.
33. Yekutieli, D., Benjamini, Y. (1999) Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics. Journal of Statistical Planning and Inference, 82, 171-196.