ANCOVA Versus CHANGE From Baseline in Nonrandomized Studies: The Difference

Multivariate Behavioral Research

Volumn 48, Issue 6, 2013, Pages 895-922

  van Breukelen, Gerard J P ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84890674145     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2013.831743     Document Type: Article

References (74)

1. Allison, P. D. 1990. Change scores as dependent variables in regression analysis. Sociological Methodology, 20: 93 - 114.
2. Anderson, S., Auquier, A., Hauck, W. W., Oakes, D., Vandaele, W. and Weisberg, H. I. 1980. Statistical methods for comparative studies New York, NY: Wiley.
3. Austin, P. C. 2011. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioral Research, 46: 399 - 424.
4. Bock, R. D. 1975. Multivariate statistical methods in behavioral research New York, NY: McGraw-Hill.
5. Boon, H. 2010. The challenges and needs of older people as HIV and aids caregivers in South Africa The Netherlands: Maastricht University. (Unpublished doctoral dissertation)
6. Campbell, D. T. and Kenny, D. A. 1999. Primer on regression artifacts New York, NY: Guilford Press.
7. Campbell, M. J., Donner, A. and Klar, N. 2007. Developments in cluster randomized trials and statistics in medicine. Statistics in Medicine, 26: 2 - 19.
8. Carroll, R. J. 1989. Covariance analysis in general linear measurement error models. Statistics in Medicine, 8: 1075 - 1093.
9. Chambless, L. E. and Roeback, J. R. 1993. Methods for assessing difference between groups in change when initial measurement is subject to intra-individual variation. Statistics in Medicine, 12: 1213 - 1237.
10. Cochran, W. G. 1968. Errors of measurement in statistics. Technometrics, 10: 637 - 666.
11. Cohen, J. 1992. A power primer. Psychological Bulletin, 112: 155 - 159.
12. Cohen, J., Cohen, P., West, S. G. and Aiken, L. 2003. Applied multiple regression/correlation analysis for the behavioral sciences, 3rd ed. Mahwah, NJ: Erlbaum.
13. Cook, T. D. and Steiner, P. M. 2010. Case matching and the reduction of selection bias in quasi-experiments: The relative importance of pretest measures of outcome, of unreliable measurement, and of mode of data analysis. Psychological Methods, 15: 56 - 68.
14. Culpepper, S. A. 2012. Using the criterion-predictor factor model to compute the probability of detecting prediction bias with ordinary least squares regression. Psychometrika, 77: 561 - 580.
15. Dawid, A. P. 2000. Causal inference without counterfactuals (with discussion). Journal of the American Statistical Association, 95: 407 - 448.
16. Dugard, P. and Todman, J. 1995. Analysis of pretest-posttest control group designs in educational research. Educational Psychology, 15: 181 - 198.
17. Frison, L. and Pocock, S. 1992. Repeated measures in clinical trials: Analysis using mean summary statistics and its implication for design. Statistics in Medicine, 11: 1685 - 1704.
18. Fuller, W. A. 1995. Estimation in the presence of measurement error. International Statistical Review, 63: 121 - 147.
19. Fuller, W. A. and Hidiroglou, M. A. 1978. Regression estimation after correcting for attenuation. Journal of the American Statistical Association, 73: 99 - 104.
20. Heckman, J. J. 2008. Econometric causality. International Statistical Review, 76: 1 - 27.
21. Holland, P. W. 1986. Statistics and causal inference. Journal of the American Statistical Association, 81: 945 - 970.
22. Holland, P. W. and Rubin, D. B. 1983. " On Lord's paradox. ". In Principals of modern psychological measurement Edited by: Wainer, H. and Messick, S. 3 - 25. Hillsdale, NJ: Erlbaum.
23. Huck, S. W. and McLean, R. A. 1975. Using a repeated measures ANOVA to analyze data from a pretest-posttest design: A potentially confusing task. Psychological Bulletin, 82: 511 - 518.
24. Huitema, B. E. 1980. The analysis of covariance and alternatives New York, NY: Wiley.
25. Jamieson, J. 2004. Analysis of covariance (ANCOVA) with difference scores. International Journal of Psychophysiology, 52: 277 - 283.
26. Kelley, T. L. 1947. Fundamentals of statistics Cambridge, MA: Harvard University Press.
27. Kenny, D. A. 1975. A quasi-experimental approach to assessing treatment effects in the nonequivalent control group design. Psychological Bulletin, 82: 345 - 362.
28. Laird, N. M. 1983. Further comparative analyses of pretest-posttest research designs. American Statistician, 37: 329 - 330.
29. Laird, N. M. and Wang, F. 1990. Estimating rates of change in randomized clinical trials. Controlled Clinical Trials, 11: 405 - 419.
30. Locascio, J. J. and Cordray, D. S. 1983. A reanalysis of Lord's paradox. Educational and Psychological Measurement, 43: 116 - 126.
31. Lord, F. M. 1967. A paradox in the interpretation of group comparisons. Psychological Bulletin, 68: 304 - 305.
32. Lord, F. M. 1969. Statistical adjustments when comparing preexisting groups. Psychological Bulletin, 72: 336 - 337.
33. Lord, F. M. and Novick, M. R. 1968. Statistical theories of mental test scores Reading, MA: Addison-Wesley.
34. Maris, E. 1998. Covariance adjustment versus gain scores revisited. Psychological Methods, 3: 309 - 327.
35. Maxwell, S. E. 1993. Covariate imbalance and conditional size: Dependence on model-based adjustments. Statistics in Medicine, 12: 101 - 109.
36. Maxwell, S. E. and Delaney, H. D. 1990. Designing experiments and analyzing data: A model comparison perspective Pacific Grove, CA: Brooks/Cole.
37. Maxwell, S. E., Delaney, H. D. and Manheimer, J. M. 1985. ANOVA of residuals and ANCOVA: Correcting an illusion by using model comparisons and graphs. Journal of Educational Statistics, 10: 197 - 209.
38. Millsap, R. E. 2007. Invariance in measurement and prediction revisited. Psychometrika, 72: 461 - 473.
39. Moerbeek, M., Van Breukelen, G. J. P. and Berger, M. P. F. 2000. Design issues for experiments in multilevel populations. Journal of Educational & Behavioral Statistics, 25: 271 - 284.
40. Murray, D. M. 1998. Design and analysis of group-randomized trials New York, NY: Oxford University Press.
41. Nicewander, W. A. and Price, J. M. 1978. Dependent variable reliability and the power of significance tests. Psychological Bulletin, 85: 405 - 409.
42. Nicewander, W. A. and Price, J. M. 1983. Reliability of measurement and the power of statistical tests: Some new results. Psychological Bulletin, 94: 524 - 533.
43. Overall, J. E. and Woodward, J. A. 1977. Nonrandom assignment and the analysis of covariance. Psychological Bulletin, 84: 588 - 594.
44. Porter, A. C. and Raudenbush, S. W. 1987. Analysis of covariance: Its model and use in psychological research. Journal of Counseling Psychology, 34: 383 - 392.
45. Raaijmakers, J. G. W. and Pieters, J. P. M. 1987. Measurement error and ANCOVA: Functional and structural relationship approaches. Psychometrika, 52: 521 - 538.
46. Rausch, J. R., Maxwell, S. E. and Kelley, K. 2003. Analytic methods for questions pertaining to a randomized pretest, posttest, follow-up design. Journal of Clinical Child and Adolescent Psychology, 32: 467 - 486.
47. Reichardt, C. S. 1979. " The statistical analysis of data from nonequivalent group designs. ". In Quasi-experimentation: Design and analysis issues for field settings Edited by: Cook, T. D. and Campbell, D. T. 147 - 205. Boston, MA: Houghton Mifflin.
48. Rogosa, D., Brandt, D. and Zimowski, M. 1982. A growth curve approach to the measurement of change. Psychological Bulletin, 92: 726 - 748.
49. Rosenbaum, P. R. 1995. Observational studies New York, NY: Springer.
50. Rubin, D. B. 1974. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66: 688 - 701.
51. Rubin, D. B. 1977. Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2: 1 - 26.
52. Rubin, D. B. 2004. Teaching statistical inference for causal effects in experiments and observational studies. Journal of Educational and Behavioral Statistics, 29: 343 - 367.
53. Rubin, D. B. 2005. Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100: 322 - 331.
54. Rubin, D. B. 2007. The design versus the analysis of observational studies for causal effects: Parallels with the design of randomized trials. Statistics in Medicine, 26: 20 - 36.
55. Ruiter, M. 1997. Preventie van depressie bij jongeren [Prevention of depression among adolescents] (Unpublished doctoral dissertation) The Netherlands: Nijmegen University.
56. Schafer, J. L. and Graham, J. W. 2002. Missing data: Our view of the state of the art. Psychological Methods, 7: 147 - 177.
57. Schafer, J. L. and Kang, J. 2008. Average causal effects from nonrandomized studies: A practical guide and simulated example. Psychological Methods, 13: 279 - 313.
58. Senn, S. J. 1995. In defense of analysis of covariance: A reply to Chambless and Roeback (Letter to the editor). Statistics in Medicine, 14: 2283 - 2285.
59. Senn, S. J. 2006. Change from baseline and analysis of covariance revisited. Statistics in Medicine, 25: 4334 - 4344.
60. Senn, S., Graf, E. and Caputo, A. 2007. Stratification for the propensity score compared with linear regression techniques to assess the effect of treatment or exposure. Statistics in Medicine, 26: 5529 - 5544.
61. Shadish, W. R. 2010. Campbell and Rubin: A primer and comparison of their approaches to causal inference in field settings. Psychological Methods, 15: 3 - 17.
62. Shadish, W. R. and Cook, T. D. 2009. The renaissance of field experimentation in evaluating interventions. Annual Review Psychology, 60: 607 - 629.
63. Shadish, W. R., Cook, T. D. and Campbell, D. T. 2002. Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
64. Shaffer, J. P. 1991. The Gauss-Markov theorem and random regressors. Journal of the American Statistical Association, 45: 269 - 273.
65. Stigler, S. M. 1997. Regression towards the mean, historically considered. Statistical Methods in Medical Research, 6: 103 - 114.
66. Van Breukelen, G. J. P. 2006. ANCOVA versus change from baseline: More power in randomized studies, more bias in nonrandomized studies. Journal of Clinical Epidemiology, 59: 920 - 925.
67. Verbeke, G. and Molenberghs, G. 2000. Linear mixed models for longitudinal data New York, NY: Springer.
68. Wainer, H. 1991. Adjusting for differential base rates: Lord's paradox again. Psychological Bulletin, 109: 147 - 151.
69. Wainer, H. and Brown, L. 2007. Three statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data. Handbook of Statistics, 26: 893 - 918.
70. Weisberg, H. I. 1979. Statistical adjustments and uncontrolled studies. Psychological Bulletin, 86: 1149 - 1164.
71. West, S. G. and Thoemmes, F. 2010. Campbell's and Rubin's perspectives on causal inference. Psychological Methods, 15: 18 - 37.
72. Whittemore, A. S. 1989. Errors-in-variables regression using Stein estimates. American Statistician, 43: 226 - 228.
73. Winkens, B., Van Breukelen, G. J. P., Schouten, H. J. A. and Berger, M. P. F. 2007. Randomized clinical trials with a pre- and a post-treatment measurement: Repeated measures versus ANCOVA models. Contemporary Clinical Trials, 28: 713 - 719.
74. Wright, D. B. 2006. Comparing groups in a before-after design: When t test and ANCOVA produce different results. British Journal of Educational Psychology, 76: 663 - 675.