Statistical power for nonequivalent pretest-posttest designs: The impact of change-score versus ANCOVA models

Evaluation Review

Volumn 25, Issue 1, 2001, Pages 3-28

  Oakes, J Michael ^a   Feldman, Henry A ^a  

^a NEW ENGLAND RESEARCH INSTITUTES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; EPIDEMIOLOGY; EQUIPMENT; HUMAN; METHODOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; VALIDATION STUDY;

ANALYSIS OF VARIANCE; BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; EFFECT MODIFIERS (EPIDEMIOLOGY); HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN;

EID: 0035258592     PISSN: 0193841X     EISSN: None     Source Type: Journal    
DOI: 10.1177/0193841X0102500101     Document Type: Article

References (53)

1. Allison, Paul D. 1990. Change scores as dependent variables in regression analysis. In Sociological methodology 1990. Vol. 20, edited by C. Clogg, 93-114. Oxford, UK: Blackwell.
2. _. 1994. Using panel data to estimate the effects of events. Sociological Methods and Research 23:174-99.
3. Assman, Susan F., Stuart J. Pocock, Laura E. Enos, and Linda E. Kasten. 2000. Subgroup analysis and other (mis)uses of baseline data in clinical trials. The Lancet 355:1064-69.
4. Barnett, VIC 1999. Comparative statistical inference. New York: John Wiley.
5. Berk, Richard A. 1983. An introduction to sample selection bias in sociological data. American Sociological Review 48:386-98.
6. Berk, Richard A., and S. C. Ray. 1982. Selection biases in sociological data. Social Science Research 11:351-98.
7. Bloom, Howard S. 1995. Minimum detectable effects: A simple way to report the statistical power of experimental designs. Evaluation Review 19:547-56.
8. Bohrnstedt, George W. 1983. Measurement. In Handbook of survey research, edited by P. H. Rossi, James D. Wright, and Andy B. Anderson, 69-121. Orlando, FL: Academic Press.
9. Bonate, Peter L. 2000. Analysis of pretest-posttest designs. Boca. Raton, FL: Chapman & Hall.
10. Boruch, Robert F. 1998. Randomized controlled experiments for evaluation. In Handbook of applied social research methods, edited by L. Bickman and Debra J. Rog, 161-90. Thousand Oaks, CA: Sage.
11. Burr, Jeffrey A., and John R. Nesselroade. 1990. Change measurement. In Principles and structuring change. Vol. 1, Statistical methods in longitudinal research, edited by A. von Eye, 3-35. Boston: Academic Press.
12. Cain, Kevin C., Richard A. Kronmal, and Andrzej S. Kosinski. 1992. Analysing the relationship between change in a risk factor and risk of disease. Statistics in Medicine 11:783-97.
13. Campbell, Donald T., and Julian C. Stanley. 1963. Experimental and quasi-experimental designs for research. Denver, CO: Houghton Mifflin.
14. Chambless, Lloyd E., and John R. Roeback. 1993. Methods for assessing difference between groups in change when initial measurement is subject to intra-individual variation. Statistics in Medicine 12:1213-37.
15. Cohen, Jacob. 1988. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
16. Cook, Thomas D., and Donald T. Campbell. 1979. Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin.
17. Dawson, Jeffrey D. 1998. Sample size calculations based on slopes and other summary statistics. Biometrics 54:323-30.
18. Donner, Allan. 1984. Approaches to sample size estimation in the design of clinical trials - A review. Statistics in Medicine 3:199-214.
19. Feldman, Henry A., and Sonja M. McKinlay. 1994. Cohort versus cross-sectional design in large field trials: Precision, sample size and a unifying model. Statistics in Medicine 13:61-78.
20. Feldt, Leonard S. 1957. A comparison of the precision of three experimental designs employing a concomitant variable. Psychometrica 24:335-53.
21. Foster, E. Michael, and Leonard J. Bickman. 1996. An evaluator's guide to detecting attrition problems. Evaluation Review December:695-723.
22. Frison, Lars, and Stuart J. Pocock. 1992. Repeated measures in clinical trials: Analysis using mean summary statistics and its implications for design. Statistics in Medicine 11:1685-1704.
23. Fuller, W. A. 1987. Measurement error models. New York: John Wiley.
24. Greene, William H. 1997. Econometric analysis. Upper Saddle River, NJ: Prentice Hall.
25. Heckman, James J., and V. Joseph Hotz. 1989. Choosing among alternative nonexperimental methods for estimating the impact of social programs: The case of manpower training. Journal of the American Statistical Association 84:862-77.
26. Holland, P. W. 1986. Statistics and causal inference. Journal of the American Statistical Association 91:945-60.
27. Hsieh, F. Y., Daniel A. Bloch, and Michael D. Larsen. 1998. A simple method of sample size calculation for linear and logistic regression. Statistics in Medicine 17:1623-34.
28. Kenny, D. A. 1975. A quasi-experimental approach to assessing treatment effects in the non-equivalent control group design. Psychological Bulletin 82:345-62.
29. Kenny, D. A., and S. H. Cohen. 1979. A reexamination of selection and growth processes in the nonequivalent control group design. In Sociological methodology 1980, edited by K. Schuessler, 290-313. San Francisco: Jossey-Bass.
30. Lipsey, Mark. 1990. Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage.
31. Lipsitz, Stuart R., and Michael Parzen. 1995. Sample size calculations for non-randomized trials. The Statistician 44:81-90.
32. Lord, Frederic M. 1960. Large-sample covariance analysis when the control variable is fallible. Journal of the American Statistical Association 55:307-21.
33. _. 1967. A paradox in the interpretation of group comparisons. Psychological Bulletin 68:304-5.
34. Maris, Eric. 1998. Covariance adjustment versus gain scores - Revisited. Psychological Methods 3:309-27.
35. McDowell, Ian, and Claire Newell. 1996. Measuring health: A guide to rating scales and questionnaires. New York: Oxford University Press.
36. Nunnally, Jum C., and Ira H. Bernstein. 1994. Psychometric theory. Vol. 3. New York: McGraw-Hill.
37. Pocock, Stuart J., and Diana R. Elbourne. 2000. Randomized trials or observational tribulations. New England Journal of Medicine 342:1907-9.
38. Pocock, Stuart J., Nancy L. Geller, and Anastasios A. Tsiatis. 1987. The analysis of multiple endpoints in clinical trials. Biometrics 43:487-98.
39. Reichardt, Charles S. 1979. Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin.
40. Reichardt, Charles S., and Melvin M. Mark. 1998. Quasi-experimentation. In Handbook of applied social research methods, edited by L. Bickman and Debra J. Rog, 193-228. Thousand Oaks, CA: Sage.
41. Robins, Philip, and Daniel Friedlander. 1995. Evaluating program evaluations: New evidence on commonly used nonexperimental methods. American Economic Review 85:39-52.
42. Rosenbaum, Paul R. 1995. Observational studies. New York: Springer-Verlag.
43. Rosner, Bernard. 1979. The analysis of longitudinal data in epidemiologic studies. Journal of Chronic Disease 32:163-73.
44. Rossi, Peter H., Howard E. Freeman, and Mark W. Lipsey. 1999. Evaluation: A systematic approach. 6th ed. Thousand Oaks, CA: Sage.
45. Rubin, Donald B. 1977. Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics 2:1-26.
46. Rubin, Donald B. 1991. Practical implications of modes of statistical inference for causal effects and the critical role of random assignment. Biometrics 47:1213-34.
47. Self, Steven G., and Robert H. Mauritsen. 1988. Power/sample size calculations for generalized linear models. Biometrics 44:79-86.
48. Streiner, David L., and Geoffrey R. Norman. 1999. Health measurement scales: A practical guide to their development and use. New York: Oxford.
49. Werts, Charles E., and Robert L. Linn. 1970. A general linear model for studying growth. Psychological Bulletin 73:17-22.
50. Winship, Christopher, and Robert D. Mare. 1992. Models for sample selection bias. Annual Review of Sociology 18:327-50.
51. Winship, Christopher, and Stephen L. Morgan. 1999. The estimation of causal effects from observational data. Annual Review of Sociology 25:659-707.
52. Yanez, N. David, Richard D. Kronmal, and Lynn R. Shemanski. 1998. The effects of measurement error in response variables and tests of association of explanatory variables in change models. Statistics in Medicine 17:2597-606.
53. Zar, J. H. 1984. Biostatistical analysis. Englewood Cliffs, NJ: Prentice Hall.