Performance of some multiple comparison tests under heteroscedasticity and dependency

Journal of Statistical Computation and Simulation

Volumn 80, Issue 10, 2010, Pages 1083-1100

  Demirhan, Haydar ^a   Dolgun, Nimet Anil ^a   Demirhan, Yaprak Parlak ^b   Dolgun, Muhsin Özgür ^c  

^a HACETTEPE UNIVERSITY   (Turkey)

^b Undersecretariat for Defence Industries   (Turkey)

^c SPSS Turkey   (Turkey)

Author keywords

Correlated data; Statistical power; Statistical simulation; Type I error; Variance heterogeneity

Indexed keywords

EID: 77956670861     PISSN: 00949655     EISSN: 15635163     Source Type: Journal    
DOI: 10.1080/00949650902962253     Document Type: Article

References (41)

1. H.J. Keselman, R.A. Cribbie, and B. Holland, Pairwise multiple comparison test procedures: An update for clinical child and adolescent, Psychol. J. Clin. Child Adolescent Psychol. 33 (2004), pp. 623-645.
2. J. Kunert, On the power of tests for multiple comparison of three normal means, J. Am.Stat. Assoc. 85 (1990), pp. 808-812.
3. A.J. Klockars and G.R. Hancock, Power of recent multiple comparison procedures as applied to a complete set of planned orthogonal contrasts, Psychol. Bull. 111 (1992), pp. 505-510.
4. Y. Hochberg, A sharper procedure for multiple tests of significance, Biometrika 75 (1988), pp. 800-802.
5. S. Holm, A simple sequentially rejective multiple test procedure, Scand. J. Stat. 6 (1979), pp. 65-70.
6. G. Hommel, A stagewise rejective multiple test procedure based on a modified Bonferroni test, Biometrika 75 (1988), pp. 383-386.
7. J.P. Shaffer, Modified sequentially rejective multiple test procedures J. Am. Stat. Assoc. 81 (1986), pp. 826-831.
8. T.-H. Hsiung and S. Olejnik, Power of pairwise multiple comparisons in the unequal variance case, Commun. Stat. Simul. Comput. 23 (1994), pp. 691-710.
9. J.D. Kromrey and M.A. La Rocca, Power and type I error rates of new pairwise multiple comparison procedures under heterogeneous variances, J. Exper. Educ. 63 (1995), pp. 343-363.
10. A.J. Klockars, G.R. Hancock, and M.J. McAweeney, Power of unweighted and weighted versions of simultaneous and sequential multiple-comparison procedures, Psychol. Bull. 118 (1995), pp. 300-307.
11. G.V. Seco, I.A.M. de la Fuente, and J.R. Escudero, Pairwise multiple comparisons under violation of the independence assumption, Qual. Quant. 35 (2001), pp. 61-76.
12. L. Kong, G. Koch, T. Liu, and H. Wang, Performance of some multiple testing procedures to compare three doses of a test drug and placebo, Pharm. Stat. 4 (2005), pp. 25-35.
13. S.-F. Wu and B.-X. Liao, A simulation study of multiple comparisons with the average under heteroscedasticity, Commun. Stat. Simul. Comput. 33 (2004), pp. 639-659.
14. M. Hasler and L.A. Hothorn, Multiple contrast tests in the presence of heteroscedasticity, Biom. J. 50 (2008), pp. 793-800.
15. R.A. Fisher, The Design of Experiments, Oliver and Boyd, London, 1935.
16. J.C. Hsu, Multiple Comparion Theory and Methods, Chapman and Hall, London, 1996.
17. N.E. Savin, The Bonferroni and Scheffe multiple comparison procedures, Rev. Econ. Stud. XLVII (1980), pp. 255-273.
18. B. Walsh, Multiple comparisons: Bonferroni corrections and false discovery rates, Lecture notes for EEB 581, available at http://nitro.biosci.arizona.edu/workshops/Aarhus2006/pdfs/Multiple.pdf.
19. R.J. Simes, An improved Bonferroni procedure for multiple tests of significance, Biometrika 73 (1986), pp. 751-754.
20. J.W. Tukey, The Problem of Multiple Comparisons, Dittoed manuscript, Department of Statistics, Princeton University, 1953.
21. C.Y. Kramer, Extension of multiple range tests to group means with unequal numbers of replications, Biometrics 12 (1956), pp. 309-310.
22. Y. Hochberg, The distribution of the range in generalized balanced models, Am. Stat. 28 (1974), pp. 137-138.
23. P.A. Games and J.F. Howell, Pairwise multiple comparison procedures with unequal N's and and/or variances: A Monte Carlo study, J. Educ. Stat. 1 (1976), pp. 113-125.
24. D. Newman, The distribution of the range in samples from a normal population, expressed in terms of an independent estimate of standard deviation, Biometrika 35 (1939), pp. 16-31.
25. M. Keuls, The use of the 'Studentized range' in connection with an analysis of variance, Euphytica 1 (1952), pp. 112-122.
26. R.W. Day and G.P. Quinn, Comparisons of treatments after an analysis of variance in ecology, Ecological Monographs 59 (1989), pp. 433-463.
27. R.K. Gabriel, Power differences between pairwise multiple comparisons: Comment, J. Am. Stat. Assoc. 73 (1978) pp. 485-487.
28. T.A. Ryan, Significance tests for multiple comparison of proportions, variances, and other statistics, Psychol. Bull. 57 (1960), pp. 318-328.
29. I. Einot and K.R. Gabriel, A study of the powers of several methods of multiple comparisons, J. Am. Stat. Assoc. 70 (1975), pp. 574-583.
30. R.E. Welsch, A modification of the Newman-Keuls procedure for multiple comparison, MIT School of Management Working Paper, 1972, pp. 614-672.
31. R.E. Welsch, Stepwise multiple comparison procedures, J. Am. Stat. Assoc. 72 (1977), pp. 566-575.
32. SPSS Inc., SPSS 15.0 Algorithm Guide, Chicago, 2006.
33. D.B. Duncan, Multiple range and multiple F tests, Biometrics 11 (1955), pp. 1-42.
34. D.J. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures, Chapman and Hall/CRC, London, 2004.
35. Y. Benjamini and Y. Hochberg, Controlling the false discovery rate: A practical and powerful approach to multiple testing, J. R. Stat. Soc. Ser. B 57 (1995), pp. 289-300.
36. P.H. Ramsey, Power differences between pairwise multiple comparisons, J.Am. Stat. Assoc. 73 (1978), pp. 479-485.
37. J. Han and M. Kamber, Data Mining: Concepts and Techniques, Morgan Kaufmann Publishers, San Francisco, 2006.
38. Y. Hochberg and A.C. Tamhane, Multiple Comparison Procedures, Wiley, New York, 1987.
39. S.E. Clausen, Applied correspondence analysis: An introduction, Series No: 07-121, Sage University Papers Series on Quantitative Applications in the Social Sciences, Thousand Oaks, California, 1998.
40. P.H. Westfall and S.S. Young, Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment, Wiley, New York, 1993.
41. F. Bretz and L.A. Hothorn, Comparison of exact and resampling based multiple testing procedures, Commun. Stat. Simul. Comput. 32 (2003), pp. 461-473.