Summarizing Monte Carlo results in methodological research: The single-factor, fixed-effects ANCOVA case

Journal of Educational and Behavioral Statistics

Volumn 28, Issue 1, 2003, Pages 45-70

  Harwell, Michael ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Analysis of covariance; Data analysis; Meta analysis

Indexed keywords

EID: 0037595496     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986028001045     Document Type: Review

References (59)

1. Abunnaja, S. S. (1983). The robustness of parametric and nonparametric analysis of covariance against unequal regression slopes and nonnormality. Unpublished doctoral dissertation, University of Pittsburgh.
2. Akritas, M. G. (1990). The rank transform method in some two-factor designs. Journal of the American Statistical Association, 85, 73-78.
3. Alaysin, M. (1991). An empirical investigation of the behavior of some parametric and non-parametric tests for frequently encountered data in educational research. Unpublished doctoral dissertation, University of Pittsburgh.
4. Ashford, J. R., & Brown, S. (1969). Generalised covariance analysis with unequal error. Biometrics, 25, 715-724.
5. Atiqullah, M. (1962). The estimation of residual variance in quadratically balanced least squares problems and the robustness of the F-test. Biometrika, 49, 83-91.
6. Atiqullah, M. (1964). The robustness of the covariance analysis of a one-way classification. Biometrika, 51, 365-372.
7. Box, G. E. P. (1954). Some theorems on quadratic forms applied in the study of analysis of variance problems: Effects of inequality of variance in the one-way classification. Annals of Mathematical Statistics, 25, 290-302.
8. Box, G. E. P., & Watson, G. S. (1962). Robustness to non-normality of regression tests. Biometrika, 49, 93-106.
9. Bugbee, A. C. (1983). The use of analysis of covariance in quasi-experimental research. Unpublished doctoral dissertation, University of Pittsburgh.
10. Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509.
11. Cochran, W. G. (1957). Analysis of covariance: Its nature and uses. Biometrics, 13, 261-281.
12. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (2nd. ed.). New York: Academic Press.
13. Conover, W. J., & Iman, R. L. (1982). Analysis of covariance using the rank transformation. Biometrics, 38, 715-724.
14. Cooper, H. M. (1982). Scientific guidelines for conducting integrative research reviews. Review of Educational Research, 52, 291-302.
15. Cooper, H. M., & Hedges, L. V. (1994). Research synthesis as a scientific enterprise. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 3-14). New York: Russell Sage Foundation.
16. Dillon, W. R., & Goldstein, M. (1984). Multivariate analysis: Methods and applications. New York: John Wiley.
17. Elashoff, J. D. (1969). Analysis of covariance: A delicate instrument. American Educational Research Journal, 6, 383-401.
18. Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
19. Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972). Consequences of failure to meet assumptions underlying the fixed effects analysis of variance and covariance. Review of Educational Research, 42, 237-288.
20. Hamilton, B. L. (1977). An empirical investigation of the effects of heterogeneous regression slopes in analysis of covariance. Educational and Psychological Measurement, 37, 701-712.
21. Harwell, M. R. (1992). Summarizing Monte Carlo results in methodological research. Journal of Educational Statistics, 17, 297-313.
22. Harwell, M. R., Rubinstein, E., Hayes, W., & Olds, C. (1992). Summarizing Monte Carlo results in methodological research: The one- and two-factor fixed-effects ANOVA cases. Journal of Educational Statistics, 77, 315-339.
23. Harwell, M. R., & Serlin, R. C. (1988). An empirical study of a proposed test of non-parametric analysis of covariance. Psychological Bulletin, 104, 268-281.
24. Hastings, N. A. J., & Peacock, J. B. (1975). Statistical distributions. London, UK: Butterworths.
25. Hedges, L. V. (1994). Fixed effects models. In H. M. Cooper and L. V. Hedges (Eds.), The handbook of research synthesis (pp. 295-297). New York: Russell Sage Foundation.
26. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Harcourt, Brace, & Jovanovich.
27. Hendrix, L., Carter, M. W., & Scott, D. T. (1982). Covariance analyses with heterogeneity of slopes in fixed models. Biometrics, 38, 641-650.
28. Hoaglin, D. C., & Andrews, D. F. (1975). The reporting of computation-based results in statistics. The American Statistician, 29, 122-126.
29. Hollingsworth, H. H. (1980). An analytical investigation of the effects of heterogeneous slopes in analysis of covariance. Educational and Psychological Measurement, 40, 611-618.
30. Hoogland, J. J., & Boomsa, A. (1998). Robustness studies in covariance structure modeling-An overview and a meta-analysis. Sociological Methods & Research, 26, 329-367.
31. Hsu, T. (1984, April). The robustness of the analysis of covariance to the violation of various assumptions. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
32. Huitema, B. E. (1980). The analysis of covariance and alternatives. New York: John Wiley.
33. Kahneman, D. (1965). Control of spurious association and the reliability of the controlled variable. Psychological Bulletin, 64, 326-329.
34. Keselman, J. C., Lix, L. M., & Keselman, H. J. (1996). The analysis of repeated measurements: A quantitative synthesis. British Journal of Mathematical and Statistical Psychology, 49, 275-298.
35. Kirk, R. E. (1968). Experimental design: Procedures for the behavioral sciences. Belmont, CA: Wadsworth.
36. Kocher, A. T. (1973). An investigation of the effects of non-homogeneous within-group regression coefficients upon the F-test of analysis of covariance. Unpublished doctoral dissertation, University of Kansas.
37. Levy, K. J. (1980). A Monte Carlo study of analysis of covariance under violations of the assumptions of normality and equal regression slopes. Educational and Psychological Measurement, 40, 835-840.
38. Lix, L., Keselman, J. C., & Keselman, H. J. (1996). Consequences of assumption violations revisited: A quantitative review of alternatives to the one-way analysis of variance F test. Review of Educational Research, 66, 579-619.
39. Maxwell, S. E., & Delaney, H. D. (1990). Designing experiments and analyzing data: A model comparison perspective. Belmont CA: Wadsworth.
40. Micceri, T. (1989). The unicorn, the normal distribution, and other improbable creatures. Psychological Bulletin, 105, 156-166.
41. Olejnik, S. F., & Algina, J. (1984). Parametric ANCOVA and the rank transform ANCOVA when the data are conditionally non-normal and heteroscedastic. Journal of Educational Statistics, 9, 129-149.
42. Orwin, R. G. (1994). Evaluating coding decisions. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 139-162). New York: Russell Sage Foundation.
43. Peckham, P. D. (1968). An investigation of the effects of non-homogeneity of regression slopes upon the F-test of analysis of covariance. Occasional paper No. 16, Laboratory of Educational Research, University of Colorado-Boulder.
44. Porter, A. C. (1967). The effects of using fallible variables in the analysis of covariance. Unpublished doctoral dissertation, University of Wisconsin.
45. Powell, D. A., & Schafer, W. D. (2001). The robustness of the likelihood ratio chi-square test for structural equation models: A meta-analysis. Journal of Educational and Behavioral Statistics, 26, 105-132.
46. Rogosa, D. (1980). Comparing nonparallel regression lines. Psychological Bulletin, 88, 307-321.
47. SAS Institute. (1989). SAS/STAT user's guide (4th ed., Vol. 2). Cary, NC: Author.
48. Scheffe, H. (1959). The analysis of variance. New York: Wiley.
49. Shields, J. L. (1978). An empirical investigation of the effects of heteroscedasticity and heterogeneity of variance on the analysis of covariance and the Johnson-Neyman technique. Technical Paper 292, Army Research Institute for the Behavioral and Social Sciences. Arlington, VA.
50. Snedacor, G. W., & Cochran, W. G. (1967). Statistical methods (6th ed.). Ames, IA: Iowa State University Press.
51. SPSS, Inc. (1988). SPSSX user's guide (3rd ed.). [computer program] Chicago, IL: Author.
52. Stock, W. A. (1994). Systematic coding for research synthesis. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 125-138). New York: Russell Sage Foundation.
53. Tomarken, A. J., & Serlin, R. C. (1986). Comparison of ANOVA alternatives under variance heterogeneity and specific noncentrality structures. Psychological Bulletin, 99, 90-99.
54. Vinod, H. D., & Ullah, A. (1981). Recent advances in regression methods. New York: Marcel Dekker.
55. White, H. D. (1994). Scientific communication and literature retrieval. In H. M. Cooper and L. V. Hedges (Eds.), The handbook of research synthesis (pp. 41-55). New York: Russell Sage Foundation.
56. Wilcox, R. R., Charlin, V. L., & Thompson, K. L. (1986). New Monte Carlo results on the robustness of the ANOVA F, W, and F* statistics. Communications in Statistics-Simulation and Computation, 15, 933-943.
57. Wildemann, C. E. (1974). The effect of the shape and length of the covariate score scale upon the F test of the analysis of covariance. Unpublished doctoral dissertation, University of Pittsburgh.
58. Wu, Y. (1984). The effects of heterogeneous regression slopes on the robustness of two test statistics in the analysis of covariance. Educational and Psychological Measurement, 44, 647-663.
59. Zikri, L. B. (1983). The robustness of the analysis of covariance to the violation of the assumptions of normality and homogeneity of variance. Unpublished doctoral dissertation, University of Pittsburgh.