Interval estimates of multivariate effect sizes: Coverage and interval width estimates under variance heterogeneity and nonnormality

Educational and Psychological Measurement

Volumn 67, Issue 1, 2007, Pages 21-40

  Hess, Melinda R ^a   Hogarty, Kristine Y ^a   Ferron, John M ^a   Kromrey, Jeffrey D ^a  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

Confidence intervals; Effect size; Monte Carlo; Multivariate

Indexed keywords

EID: 33846071463     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164406288159     Document Type: Article

References (33)

1. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
2. Carpenter, J., & Bithell, J. (2000). Bootstrap confidence intervals: When, which, what? A practical guide for medical statisticians. Statistics in Medicine, 19, 1141-1164.
3. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
4. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement 61, 532-574.
5. Efron, B., & Gong, G. (1983). A leisurely look at the bootstrap, the jackknife, and cross-validation. The American Statistician, 37 (1). 36-49.
6. Efron, B., & Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1 (1). 54-77.
7. Ferron, J., Yi, Q., & Kromrey, J. D. (1997). NNCORR: A SAS/IML program for generating nonnormal correlated data. Applied Psychological Measurement, 21, 64-64.
8. Fidler F., & Thompson, B. (2001). Computing correct confidence intervals for ANOVA fixed and random-effects effect sizes. Educational and Psychological Measurement, 61 (4). 575-604.
9. Fleishman, A. I. (1978). A method for simulating non-normal distributions. Psychometrika, 43 (4). 521-532.
10. Ghosh, B. K. (1979). A comparison of some approximate confidence intervals for the binomial parameter. Journal of the American Statistical Association, 74, 894-900.
11. Grissom, R. J., & Kim, J. J. (2001). Review of assumptions and problems in the appropriate conceptualization of effect size. Psychological Methods, 6 (2). 135-146.
12. Hess, M. R., & Kromrey, J. D. (2002, April). Confidence intervals for the standardized mean difference: An empirical comparison of methods for interval estimation of effect sizes. Paper presented at the American Educational Research Association, New Orleans, LA.
13. Hess, M. R., & Kromrey, J. D. (2003, April). Confidence intervals for standardized mean differences: An empirical comparison of bootstrap methods under non-normality and heterogeneous variances. Paper presented at the American Educational Research Association, Chicago.
14. Huberty, C. J. (1994). Applied discriminant analysis. New York: John Wiley.
15. Huberty, C. J., & Lowman, L. L. (2000). Group overlap as a basis for effect size. Educational and Psychological Measurement, 60, 543-563.
16. Inman, H. F., & Bradley, E. L. (1989). The overlapping coefficient as a measure of agreement between probability distributions and point estimation of the overlap of two normal densities. Communications in Statistics - Theory and Methods, 18, 3851-3874.
17. Kromrey, K. Y., & Hess, M. H. (2001, April). Interval estimates of R2: An empirical comparison of accuracy and precision under violations of the normality assumption. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
18. Krzanowski, W. J., & Marriott, F. H. C. (1995). Multivariate analysis: Classification, covariance structures and repeated measurements. London: Arnold.
19. McMillan, J. H., Snyder, A., & Lewis, K. L. (2002, April). Reporting effect size: The road less traveled. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
20. Nix, T. W., & Barnette, J. J. (1998). The data analysis dilemma: Ban or abandon. A review of null hypothesis signficance testing. Research in the Schools, 5 (2). 3-14.
21. Rao, C. R. (1973). Linear statistical inference and its applications (2nd ed.). New York: John Wiley.
22. Rao, P. S. R. S., & Dorvlo, A. S. (1985). The Jackknife procedure for the probabilities of misclassification. Communications in Statistics - Simulation and Computation, 14, 779-790.
23. Reiser, B. (2001). Confidence intervals for the Mahalanobis Distance. Communications in Statistics - Simulation and Computation, 30, 37-45.
24. Robey, R. R., & Barcikowski, R. S. (1992). Type I error and the number of iterations in Monte Carlo studies of robustness. British Journal of Mathematical and Statistical Psychology, 45, 283-288.
25. Serlin, R. C., & Lapsley, D. K. (1985). Rationality in psychological research: The good-enough principle. American Psychologist, 40, 73-83.
26. Steiger, J. H., & Fouladi, R. T. (1992). R2: A computer program for interval estimation, power calculation, and hypothesis testing for the squared multiple correlation. Behavior Research, Methods, Instruments, and Computers, 4, 581-582.
27. Steiger, J. H., & Fouladi, R. T. (1997). Noncentrality interval estimation and the evaluation of statistical models. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 221-257). Mahwah, NJ: Lawrence Erlbaum.
28. Stevens, J. P. (1980). Power of the multivariate analysis of variance tests. Psychological Bulletin, 88, 728-737.
29. Stevens, J. (2001). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
30. Stine, R. (1990). An introduction to bootstrap methods. Sociological Methods & Research, 18 (2&3). 243-291.
31. Thompson, B. (1998). Statistical significance and effect size reporting: Portrait of a possible future. Research in the Schools, 5 (2). 33-38.
32. Venables, W. (1975). Calculation of confidence intervals for noncentrality parameters. Journal of the Royal Statistical Society, Series B, 37, 406-412.
33. Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.