Multiplicity, directional (type III) errors, and the null hypothesis

Psychological Methods

Volumn 7, Issue 3, 2002, Pages 356-369

  Shaffer, Juliet Popper ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGY;

HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY; RESEARCH DESIGN;

EID: 85047670463     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.7.3.356     Document Type: Article

References (33)

1. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate. Journal of the Royal Statistical Society, 57, 289-300.
2. Bofinger, E. (1985). Multiple comparisons and Type III errors. Journal of the American Statistical Association, 80, 433-437.
3. Bohrer, R. (1979). Multiple three-decision rules for parametric signs. Journal of the American Statistical Association, 74, 432-437.
4. Bohrer, R. (1982). Optimal multiple decision problems: Some principles and procedures applicable in cancer drug screening. In L. LeCam & J. Neyman (Eds.), Probability models for cancer (pp. 287-301). Amsterdam: North-Holland.
5. Bohrer, R., & Schervish, M. (1980). An optimal multiple decision rule about signs. Proceedings of the National Academy of Sciences, USA, 77, 52-56.
6. Duncan, D. B. (1965). A Bayesian approach to multiple comparisons. Technometrics, 7, 171-222.
7. Dunnett, C. W. (1955). A multiple comparison procedure for comparing several treatments with a control. Journal of the American Statistical Association, 50, 1096-1121.
8. Dunnett, C. W., & Tamhane, A. C. (1992). A step-up multiple test procedure. Journal of the American Statistical Association, 87, 162-170.
9. Finner, H. (1999). Stepwise multiple test procedures and control of directional errors. Annals of Statistics, 27, 274-289.
10. Finner, H., & Roters, M. (2002). Multiple hypotheses testing and expected number of Type I errors. Annals of Statistics, 30, 220-238.
11. Hochberg, Y. (1987). Multiple classification rules for signs of parameters. Journal of Statistical Planning and Inference. 15, 177-188.
12. Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.
13. Hochberg, Y., & Posner, M. E. (1986). On optimal decision rules for signs of parameters. Annals of Statistics, 14, 733-742.
14. Hochberg, Y., & Tamhane, A. C. (1987). Multiple comparison procedures. New York: Wiley.
15. Holm, S. (1979a). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
16. Holm, S. (1979b). A stagewise directional test based on t statistics (Statistical Research Report No. 1979-3). Gothenburg, Sweden: Chalmers University of Technology, Institute of Mathematics.
17. Holm, S. (1981). A stagewise directional test for the normal regression situation. In B. Bereanu, S. Grigorescu, M. Josifescu, & T. Postelnicu (Eds.), Proceedings of the Sixth Conference on Probability Theory (pp. 103-106). Bucharest, Romania: National Institute of Metrology.
18. Jones, L. V., & Tukey, J. W. (2000). A sensible formulation of the significance test. Psychological Methods, 5, 411-414.
19. Klockars, A. J., & Hancock, G. R. (1994). Per-experiment error rates: The hidden costs of several multiple comparison procedures. Educational and Psychological Measurement, 54, 292-298.
20. Lewis, C., & Thayer, D. (2002, August). Multiple inferences for random effects. Paper presented at the third International Conference on Multiple Comparisons, Bethesda, MD.
21. Rom, D. M. (1990). A sequentially rejective test procedure based on a modified Bonferroni inequality. Biometrika, 77, 663-665.
22. Scheffé, H. (1970). Multiple testing versus multiple estimation. Improper confidence sets: Estimation of directions and ratios. Annals of Mathematical Statistics, 41, 1-29.
23. Seeger, P. (1968). A note on a method for the analysis of significances en masse. Technometrics, 10, 586-593.
24. Shaffer, J. P. (1980). Control of directional errors with stagewise multiple test procedures. Annals of Statistics, 8, 1342-1347.
25. Shaffer, J. P. (1999). A semi-Bayesian study of Duncan's Bayesian multiple comparison procedure. Journal of Statistical Planning and Inference, 82, 197-213.
26. Sorić, B. (1989). Statistical "discoveries" and effect-size estimation. Journal of the American Statistical Assocation, 84, 608-610.
27. Spjøtvoll, E. (1972). On the optimality of some multiple comparison procedures. Annals of Mathematical Statistics, 43, 398-411.
28. Tukey, J. W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
29. Tukey, J. W. (1993). Where should multiple comparisons go next? In F. M. Hoppe (Ed.), Multiple comparisons, selection, and applications in biometry (pp. 187-207). New York: Marcel Dekker.
30. Waller, R. A., & Duncan, D. B. (1969). A Bayes rule for the symmetric multiple comparisons problem. Journal of the American Statistical Association, 64, 1484-1503.
31. Westfall, P. H., & Young, S. S. (1993). Resampling-based multiple testing. New York: Wiley.
32. Williams, V. S. L., Jones, L. V., & Tukey, J. W. (1999). Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. Journal of Educational and Behavioral Statistics, 24, 42-69.
33. Yekutieli, D. (2002). Theoretical results needed for applying the false discovery rate in statistical problems. Unpublished doctoral dissertation, Tel Aviv University, Tel Aviv, Israel.