Performance of Monte Carlo permutation and approximate tests for multivariate means comparisons with small sample sizes when parametric assumptions are violated

Methodology

Volumn 5, Issue 2, 2009, Pages 60-70

  Finch, W Holmes ^a   Davenport, Teresa ^a  

^a BALL STATE UNIVERSITY   (United States)

Author keywords

Assumption violations; MANOVA; Permutation tests; Pillai's Trace; Roy's Greatest Root

Indexed keywords

EID: 69949085249     PISSN: 16141881     EISSN: 16142241     Source Type: Journal    
DOI: 10.1027/1614-2241.5.2.60     Document Type: Article

References (33)

1. Algina, J., Oshima, T. C., & Tang, K. L. (1991). Robustness of Yao's, James' and Johansen's tests under variance-covariance heteroscedasticity and nonnormality. Journal of Educational Statistics, 16, 125-139.
2. Anderson, M. J., & Ter Braak, C. J. F. (2003). Permutation tests for multi-factorial analysis of variance. Journal of Statistical Computation and Simulation, 73, 85-113.
3. 2 test in prescribed circumstances. Multivariate Behavioral Research, 29, 141-163.
4. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, Publishers.
5. Coombs, W. T., & Algina, J. (1996). New test statistics for MANOVA/ Descriptive discriminant analysis. Educational and Psychological Measurement, 56, 382-402.
6. Edgington, E. S., & Onghena, P. (2007). Randomization tests. Boca Raton, FL: Chapman & Hall/CRC.
7. Erdfelder, E. (1981). Multivariate Rangvarianzanalyse: Ein non-parametrisches Analogon zur ein- und mehrfaktoriellen MANOVA [Multivariate rank variance analysis: A nonparametric analogue for single and multivariate MANOVAs]. Trierer Psychologische Berichte, 8. Trier, German: Fachbereich 1-Psychologie der Universitat Trier.
8. 2 tests. Journal of the American Statistical Association, 74, 48-51.
9. Finch, H. (2005). Comparison of the performance of the nonparametric and parametric MANOVA test statistics when assumptions are violated. Methodology, 1, 27-38.
10. Finch, H., & Schneider, M. K. (2006). Misclassification rates for four methods of group classification: Impact of predictor distribution, covariance inequality, effect size, sample size and group. Educational and Psychological Measurement, 66(2), 240-257.
11. Fouladi, R. T., & Yockey, R. D. (2002). Type I error control of two-group multivariate tests on means under conditions of heterogeneous correlation structure and varied multivariate distributions. Communications in Statistics - Simulation and computation, 31, 360-378.
12. Good, P. I. (2004). Permutation, parametric, and bootstrap tests of hypotheses. New York: Springer Science and Business Media, Inc.
13. 2 procedure and the assumption for homogeneous covariance matrices. Psychological Bulletin, 86, 1255-1263.
14. Headrick, T. C., & Sawilowsky, S. S. (1999). Simulating correlated multivariate nonnormal distributions: Extending the Fleishman power method. Psychometrika, 64, 25-35.
15. 2 and homoscedasticity criterion M under unequal variance and leptokurtosis. Journal of the American Statistical Association, 58, 1048-1053.
16. James, G. S. (1954). Tests of linear hypotheses in univariate and multivariate analysis when the ratio of the population variances are unknown. Biometrika, 41, 19-43.
17. Johansen, S. (1980). The Welch-James approximation to the distribution of the residual sum of squares in a weighted linear regression. Biometrika, 67, 85-92.
18. Johnson, R. A., & Wichern, D. W. (2002). Applied multivariate statistical analysis. Upper Saddle River, NJ: Prentice Hall.
19. Katz, B. M., & McSweeney, M. (1980). A multivariate Kruskal-Wallis test with post hoc procedures. Multivariate Behavioral Research, 15, 281-297.
20. 2, W, and R. Biometrika, 59, 215-216.
21. Lee, Y.-S. (1971). Asymptotic formulae for the distribution of a multivariate test statistic: Power comparisons of certain multivariate tests. Biometrika, 58, 647-651.
22. Olson, C. L. (1974). Comparative robustness of six tests in multivariate analysis of variance. Journal of the American Statistical Association, 69, 894-908.
23. Pillai, K. C. S., & Jayachandran, K. (1967). Power comparisons of tests of two multivariate hypotheses based on four criteria. Biometrika, 54, 195-210.
24. Puri, M. L., & Sen, P. K. (1971). Nonparametric methods in multivariate analysis. Malabar, FL: Krieger Publishing Company.
25. Rao, C. R. (1952). Advanced statistical methods in biometric research. New York: Wiley.
26. SAS Institute. (2004). SAS version 9.1.3. Cary, NC: SAS Institute Inc.
27. Sheehan-Holt, J. K. (1998). MANOVA simultaneous test procedures: The power and robustness of restricted multivariate contrasts. Educational and Psychological Measurement, 58, 861-881.
28. 2. Journal of Statistical Planning and Inference, 97, 343-358.
29. Stevens, J. (1996). Applied multivariate statistics for the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
30. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston, MA: Pearson.
31. 2 statistics based on modified maximum likelihood estimators. Communications in Statistics - Theory and Methods, 17, 1789-1810.
32. Yao, Y. (1965). An approximate degrees of freedom solution to the multivariate Behrens-Fisher problem. Biometrika, 52, 139-147.
33. Zwick, R. (1985). Nonparametric one-way multivariate analysis of variance: A computational approach based on the Pillai-Bartlett Trace. Psychological Bulletin, 97, 148-152.