Examining multiple comparison procedures according to error rate, power type and false discovery rate

Journal of Modern Applied Statistical Methods

Volumn 11, Issue 2, 2012, Pages 348-360

  Ozkaya, Guven ^a   Ercan, Ilker ^a  

^a ULUDAG UNIVERSITY   (Turkey)

Author keywords

Error rates; False discovery rate; Multiple comparison procedures; Pairwise comparison; Power

Indexed keywords

EID: 84875261819     PISSN: 15389472     EISSN: None     Source Type: Journal    
DOI: 10.22237/jmasm/1351742760     Document Type: Article

References (35)

1. Bender, R., & Lange, S. (2001). Adjusting for multiple testing-when and how. Journal of Clinical Epidemiology, 54(4), 343-349.
2. Benjamini, Y., & Hochberg Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289-300.
3. Bernhardson, C. (1975). Type I error rates when multiple comparison procedures follow a significant F test of ANOVA. Biometrics, 31, 229-232.
4. Cabral, H. J. (2008). Multiple comparisons procedures. Circulation, 117(5), 698-701.
5. Curran-Everett, D. (2000). Multiple comparisons: philosophies and illustrations. American Journal of Physiology-Regulatory, Integrative and Comparative Physiology, 279(1), R1-R8.
6. Dayton, C. M. (1998). Information criteria for the paired-comparisons problem. The American Statistician, 52(2), 144-151.
7. Demirhan, H., Dolgun, N. A., Demirhan, Y. P., & Dolgun, M. O. (2010). Performance of some multiple comparison tests under heteroscedasticity and dependency. Journal of Statistical Computation and Simulation, 80(10), 1083-1100.
8. Einot, I., & Gabriel, K. R. (1975). A study of the powers of several methods of multiple comparisons. Journal of the American Statistical Association, 70(351), 574-583.
9. Ekenstierna, M. (2004). Multiple comparison procedures based on marginal pvalues. Uppsala University Department of Mathematics Project Report No: 2004(12), 1-26. http://www2.math.uu.se/research/pub/Ekenstiern a.pdf.
10. Horn, M., & Vollandt, R. (2000). A survey of sample size formulas for pairwise and many one multiple comparisons in the parametric, nonparametric and binomial Case. Biometrical Journal, 42(1), 27-44.
11. Hsu, J. C. (1996). Multiple comparisons: theory and methods. London, England: Chapman & Hall/CRC.
12. Jaccard, J., & Guilamo-Ramos, V. (2002a). Analysis of variance frameworks in clinical child and adolescent psychology: Issues and recommendations. Journal of Clinical Child and Adolescent Psychology, 31, 130-146.
13. Jaccard, J., & Guilamo-Ramos V. (2002b). Analysis of variance frameworks in clinical chíld and adolescent psychology: Advanced issues and recommendations. Journal of Clinical Child and Adolescent Psychology, 31, 278-294.
14. Kemp, K. (1975). Multiple comparisons: Comparisonwise versuse experimentwise type I error rates and their relationship to power. Journal of Dairy Science, 58(9), 1374-1378.
15. Keselman, H., Cribbie, R., & Holland, B. (1999). The pairwise multiple comparison multiplicity problem: An alternative approach to familywise and comparisonwise Type I error control. Psychological Methods, 4, 58-69.
16. Keselman, H., Cribbie, R. A., & Holland, B. (2004). Pairwise multiple comparison test procedures: an update for clinical child and adolescent psychologists. Journal of Clinical Child & Adolescent Psychology, 33(3), 623-645.
17. Keselman, H., et al. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68(3), 350.
18. Klockars, A. J., & Sax, G. (1986). Multiple comparisons. Newbury Park, CA: Sage Publications.
19. Lowry, S. (1992). Use and misuse of multiple comparisons in animal experiments. Journal of Animal Science, 70(6), 1971-1977.
20. Ludbrook, J. (1998). Multiple comparison procedures updated. Clinical and Experimental Pharmacology and Physiology, 25(12), 1032-1037.
21. Maxwell, S. E., & Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective. London, England: Lawrence Erlbaum Associates.
22. Menèndez De La Fuente, I., Vallejo Seco, G., & Fernández García P. (1999). Multiple comparison procedures for simple oneway ANOVA with dependent data. Spanish journal of psychology, 2(1), 55-63.
23. Montgomery, D. C.(2001). Design and analysis of experiments. New York, NY: John Wiley&Sons.
24. O'Brien, P. (1983). The appropriateness of analysis of variance and multiple-comparison procedures. Biometrics, 39(3), 787-788.
25. O'Neill, R., & Wetherill, G. (1971). The present state of multiple comparison methods. Journal of the Royal Statistical Society, Series B (Methodological), 33(2), 218-250.
26. Perry, J. (1986). Multiple-comparison procedures: a dissenting view. Journal of Economic Entomology, 79(5), 1149-1155.
27. Ramsey, P. H. (1978). Power differences between pairwise multiple comparisons. Journal of the American Statistical Association, 73(363), 479-485.
28. Ramsey, P. H. (2002). Comparison of closed testing procedures for pairwise testing of means. Psychological Methods, 7(4), 504-523.
29. Ramsey, P. H., & Ramsey P. P. (2008). Power of pairwise comparisons in the equal variance and unequal sample size case. British Journal of Mathematical and Statistical Psychology, 61(1), 115-131.
30. Roback, P. J., & Askins, R. A. (2005). Judicious use of multiple hypothesis tests. Conservation Biology, 19(1), 261-267.
31. Rothman, K. J. (1990). No adjustments are needed for multiple comparisons. Epidemiology, 1(1), 43-46.
32. Ryan, T. A. (1959). Multiple comparison in psychological research. Psychological Bulletin, 56(1), 26-47.
33. Shaffer, J. P. (1995). Multiple hypothesis testing. Annual Review of Psychology, 46, 561-584.
34. Tatlidil, H. (2002). Applied Multivariate Statistical Analysis, Ziraat Matbaacilik, Ankara.(in Turkish).
35. Toothaker, L. E. (1993). Multiple comparison procedures. Newbury Park, CA: Sage Publications.