Robust tests for multivariate factorial designs under heteroscedasticity

Behavior Research Methods

Volumn 44, Issue 2, 2012, Pages 471-489

  Vallejo, Guillermo ^a   Ato, Manuel ^b  

^a UNIVERSITY OF OVIEDO   (Spain)

^b UNIVERSITY OF MURCIA   (Spain)

Author keywords

Assumption violations; Empirical generalized least squares; MANOVA; Moments estimators; Ordinary least squares

Indexed keywords

ALGORITHM; ARTICLE; COMPUTER PROGRAM; MONTE CARLO METHOD; MULTIVARIATE ANALYSIS; REFERENCE VALUE; REGRESSION ANALYSIS; REPRODUCIBILITY; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; LEAST-SQUARES ANALYSIS; LINEAR MODELS; MONTE CARLO METHOD; MULTIVARIATE ANALYSIS; REFERENCE VALUES; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; SOFTWARE;

EID: 84861363054     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-011-0152-2     Document Type: Article

References (52)

1. Algina, J. (1994). Some alternative approximate tests for a split-plot design. Multivariate Behavioral Research, 29, 365-384.
2. Anderson, T. W. (2003). An introduction to multivariate analysis (3rd ed.). New York: Wiley.
3. Bathke, A. C., Harrar, S. W., & Madden, L. V. (2008). How to compare small multivariate samples using nonparametric tests. Computational Statistics & Data Analysis, 52, 4951-4965.
4. Blote, A. W., van der Burg, E., & Klein, A. S. (2001). Students' flexibility in solving two-digit addition and subtraction problems: Instruction effects. Journal of Educational Psychology, 93, 627-638.
5. Box, G. E. P. (1954). Some theorems on quadratic forms applied in the study of analysis of variance problems: I. Effects of inequality of variance in the one-way classification. Annals of Mathematical Statistics, 25, 290-403.
6. Bradley, J. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31, 144-152.
7. Brunner, E., Dette, H., & Munk, A. (1997). Box-type approximations in factorial designs. Journal of the American Statistical Association, 92, 1494-1503.
8. Brunner, E., Munzel, U., & Puri, M. L. (2002). The multivariate nonparametric Behrens-Fisher problem. Journal of Statistical Planning & Inference, 108, 37-53.
9. Coombs, W. T., & Algina, J. (1996). New test statistics for MANOVA/descriptive discriminant analysis. Educational and Psychological Measurement, 56, 382-402.
10. Crowell, S. E., Beauchaine, T. P., McCauley, E., Smith, C. J., Vasilev, C. A., & Stevens, A. L. (2008). Parent-child interactions, peripheral serotonin, and self-inflicted injury in adolescents. Journal of Consulting and Clinical Psychology, 76, 15-21.
11. Farivar, S. S., Cunningham, W. E., & Hays, R. D. (2007). Correlated physical and mental health summary scores for the SF-36 and SF-12 Health Survey, V. I. Health and Quality of Life Outcomes, 5, 54.
12. Finch, W. H., & Davenport, T. (2009). Performance of Monte Carlo permutation and approximate tests for multivariate means comparisons with small sample sizes when parametric assumptions are violated. Methodology, 5, 60-70.
13. Gamage, J., Mathew, T., & Weerahandi, S. (2004). Generalized p-values and generalized confidence regions for the multivariate Behrens-Fisher problem and MANOVA. Journal of Multivariate Analysis, 88, 177-189.
14. Gathercole, S. E., Pickering, S. J., Ambridge, B., & Wearing, H. (2004). The structure of working memory from 4 to 15 years of age. Developmental Psychology, 40, 177-190.
15. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: A global perspective (7th ed.). Upper Saddle River: Pearson Prentice Hall.
16. 2 procedure and the assumption of homogeneous covariance matrices. Psychological Bulletin, 86, 1255-1263.
17. Holtzer, R., Friedman, R., Lipton, R. B., Katz, M., Xue, X., & Verghese, J. (2007). The relationship between specific cognitive functions and falls in aging. Neuropsychology, 21, 540-548.
18. Ito, P. K. (1980). Robustness of ANOVA and MANOVA test procedures. In P. R. Krishnaiah (Ed.), Handbook of statistics (Analysis of variance, Vol. 1, pp. 199-236). Amsterdam: North-Holland.
19. James, G. S. (1951). The comparison of several groups of observations when the ratios of the population variances are unknown. Biometrika, 38, 324-329.
20. Jamshidian, M., & Schott, J. R. (2007). Testing equality of covariance matrices when data are incomplete. Computational Statistics & Data Analysis, 51, 4227-4239.
21. Johansen, S. (1980). The Welch-James approximation to the distribution of the residual sum of squares in a weighted linear regression. Biometrika, 67, 85-92.
22. Johnson, R. A., & Wichern, D. W. (2008). Applied multivariate statistical analysis (6th ed.). Upper Saddle River: Pearson Prentice Hall.
23. Jonas, K., & Sassenberg, K. (2006). Knowing how to react: Automatic response priming from social categories. Journal of Personality and Social Psychology, 90, 709-721.
24. Kenward, M. G. (2001). Comments on "Parametric modelling of growth curve data: an overview", by D. L. Zimmerman & V. Núñez-Antón. TEST, 10, 1-73.
25. Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983-997.
26. Kenward, M. G., & Roger, J. H. (2009). An improved approximation to the precision of fixed effects from restricted maximum likelihood. Computational Statistics & Data Analysis, 53, 2583-2595.
27. Keselman, H. J., Algina, J., Lix, L. M., Wilcox, R. R., & Deering, K. (2008). A generally robust approach for testing hypotheses and setting confidence intervals for effect sizes. Psychological Methods, 13, 110-129.
28. Keselman, H. J., Carriere, K. C., & Lix, L. M. (1995). Robust and powerful nonorthogonal analyses. Psychometrika, 60, 395-418.
29. Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., et al. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68, 350-386.
30. Krishnamoorthy, K., & Lu, F. (2010). A parametric bootstrap solution to the MANOVA under heteroscedasticity. Journal of Statistical Computation and Simulation, 80, 873-887.
31. Lindemann, O., & Bekkering, H. (2009). Object manipulation and motion perception: Evidence of an influence of action planning on visual processing. Journal of Experimental Psychology. Human Perception and Performance, 35, 1062-1071.
32. Lix, L. M., Algina, J., & Keselman, H. J. (2003). Analysing multivariate repeated measures designs: A comparison of two approximate degrees of freedom procedures. Multivariate Behavioral Research, 38, 403-431.
33. Luh, W. M., & Guo, J. H. (2004). Improved robust test statistic based on trimmed means and Hall's transformation for two-way ANOVA models under non-normality. Journal of Applied Statistics, 31, 623-643.
34. Maas, C. J. M., & Snijders, T. B. (2003). The multilevel approach to repeated measures for complete and incomplete data. Quality & Quantity, 37, 71-89.
35. Mardia, K. V. (1971). The effect of nonnormality on some multivariate tests and robustness to nonnormality in the linear model. Biometrika, 58, 105-121.
36. Mathai, A. M., & Provost, S. B. (1992). Quadratic forms in random variables: Theory and applications. New York: Dekker.
37. Maxwell, S. E., & Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah: Erlbaum.
38. Mehrotra, D. V. (1997). Improving the Brown-Forsythe solution to the generalized Behrens-Fisher problem. Communications in Statistics-Simulation & Computation, 26, 1139-1145.
39. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 92, 778-785.
40. Naik, D. N. (2003). Diagnostic methods for univariate and multivariate normal data. In R. Khattree & C. R. Rao (Eds.), Handbook of statistics (Statistics in industry, Vol. 22, pp. 957-993). New York: Elsevier Science.
41. Nel, D. G. (1997). Tests for equality of parameter matrices in two multivariate linear models. Journal of Multivariate Analysis, 61, 29-37.
42. Olson, C. L. (1974). Comparative robustness of six tests in multivariate analysis of variance. Journal of the American Statistical Association, 69, 894-908.
43. SAS Institute Inc. (2008). SAS/STAT® 9. 2 user's guide. Cary: SAS Institute Inc.
44. Schabenberger, O. (2007). Growing Up Fast: SAS® 9. 2 Enhancements to the GLIMMIX Procedure. In Proceedings of the 2007 SAS Global Forum. Cary, NC: SAS Institute Inc.
45. Sheehan-Holt, J. K. (1998). MANOVA simultaneous test procedures: The power and robustness of restricted multivariate contrasts. Educational and Psychological Measurement, 58, 861-881.
46. Vallejo, G., Arnau, J., & Ato, M. (2007). Comparative robustness of recent methods for the analysis of multivariate repeated measures designs. Educational and Psychological Measurement, 67, 410-432.
47. Vallejo, G., & Ato, M. (2006). Modified Brown-Forsythe procedure for testing interaction effects in split-plot designs. Multivariate Behavior Research, 41, 549-578.
48. Vallejo, G., Fernández, P., & Livacic-Rojas, P. (2010a). Analysis of unbalanced factorial designs with heteroscedastic data. Journal of Statistical Computation and Simulation, 80, 75-88.
49. Vallejo, G., Ato, M., & Fernández, P. (2010b). A robust approach for analyzing unbalanced factorial designs with fixed levels. Behavior Research Methods, 42, 607-617.
50. Vallejo, G., Fernández, M. P., Livacic-Rojas, P. E., & Tuero-Herrero, E. (2011). Selecting the best unbalanced repeated measures model. Behavior Research Methods, 43, 18-36.
51. Welch, B. L. (1951). On the comparison of several mean values: An alternative approach. Biometrika, 38, 330-336.
52. Wilcox, R. R. (2005). Introduction to robust estimation and hypothesis testing (2nd ed.). New York: Elsevier.