The principle of parallelism in the design of studies to estimate treatment effects

Psychological Methods

Volumn 11, Issue 1, 2006, Pages 1-18

  Reichardt, Charles S ^a  

^a UNIVERSITY OF DENVER   (United States)

Author keywords

Causality; Quasi experiment; Randomized experiment; Research design; Treatment effect

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; HEALTH CARE QUALITY; HUMAN; METHODOLOGY; OUTCOME ASSESSMENT; RANDOMIZED CONTROLLED TRIAL; REPRODUCIBILITY; STATISTICS;

ANALYSIS OF VARIANCE; HUMANS; OUTCOME ASSESSMENT (HEALTH CARE); PROGRAM EVALUATION; RANDOMIZED CONTROLLED TRIALS; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 33745589837     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.11.1.1     Document Type: Article

References (70)

1. Abelson, R. P. (1995). Statistics as principled argument. Hillsdale, NJ: Erlbaum.
2. Anderson, A. J. B. (1989). Interpreting data: A first course in statistics. London: Chapman & Hall.
3. Azar, B. (1994, November). Eating fat: Why does the brain say, 'Ahhh'? APA Monitor. 20.
4. Ball, S., & Bogatz, G. A. (1970). The first year of Sesame Street: An evaluation. Princeton, NJ: Educational Testing Service.
5. Bem, D. J. (1972). Self-perception theory. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 6, pp. 1-62). New York: Academic Press.
6. Bem, D. J., Wallach, M. A., & Kogan, N. (1965). Group decision making under risk of aversive consequences. Journal of Personality and Social Psychology, 1. 453-460.
7. Boruch, R. F. (1997). Randomized experiments for planning and evaluation: A practical guide. Thousand Oaks, CA: Sage.
8. Braucht, G. N., Reichardt, C. S., Geissler, L. J., Bormann, C. A., Kwiatkowski, C. F., & Kirby, M. W., Jr. (1995). Effective services for homeless substance abusers. Journal of Addictive Diseases, 14, 87-109.
9. Campbell, D. T. (1957). Factors relevant to validity of experiments in field settings. Psychological Bulletin, 54, 297-312.
10. Campbell, D. T. (1969). Prospective: Artifact and control. In R. Rosenthal & R. L. Rosnow (Eds.), Artifact in behavioral research (pp. 351-382). New York: Academic Press.
11. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 171-246). Chicago: Rand McNally.
12. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
13. Cole, D. A., & Maxwell, S. E. (2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558-577.
14. Cook, T. D. (1993). A quasi-sampling theory of the generalization of causal relationships. In L. Sechrest & A. G. Scott (Eds.), New directions for program evaluation: Understanding causes and generalizing about them (Vol. 57, pp. 39-81). San Francisco: Jossey-Bass.
15. Cook, T. D., Appleton, H., Conner, R. F., Shaffer, A., Tamkin, G., & Weber, S. J. (1975). "Sesame Street" revisited. New York: Russell Sage Foundation.
16. Cook, T. D., & Campbell, D. T. (1975). The design and conduct of quasi-experiments and true experiments in field settings. In M. D. Dunnette (Ed.), Handbook of industrial and organizational research (pp. 223-326). New York: Rand McNally.
17. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally.
18. Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.
19. Dooley, D. (1995). Social research methods (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
20. Gilligan, C. (1982). In a different voice: Psychological theory and women's development. Cambridge, MA: Harvard University Press.
21. Gollob, H. F., & Reichardt, C. S. (1987). Taking account of time lags in causal models [Special section]. Child Development, 58, 80-92.
22. Gollob, H. F., & Reichardt, C. S. (1991). Interpreting and estimating indirect effects assuming time lags really matter. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change: Recent advances, unanswered questions, future directions (pp. 243-259). Washington, DC: American Psychological Association.
23. Harris, R. J. (1997). Reforming significance testing via three-valued logic. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 145-174). Hillsdale, NJ: Erlbaum.
24. Heckman, J., & Robb, R. (1985). Alternative methods for evaluating the impact of interventions: An overview. Journal of Econometrics, 30, 239-267.
25. Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945-970.
26. Judd, C. M., & Kenny, D. A. (1981). Estimating the effects of social interventions. New York: Cambridge University Press.
27. Kasof, J. (1993). Sex bias in the naming of stimulus persons. Psychological Bulletin, 113, 140-163.
28. Kohlberg, L. (1964). Development of moral character and moral behavior. In L. W. Hoffman & M. L. Hoffman (Eds.), Review of child development (Vol. 1, pp. 381-443). New York: Sage.
29. Kruglanski, A. W., & Kroy, M. (1975). Outcome validity in experimental research: A re-conceptualization. Journal of Representative Research in Social Psychology, 7, 168-178.
30. Leibowitz, S. F., & Kim, T. (1992). Impact of a galanin antagonist on exogenous galanin and natural patterns of fat ingestion. Brain Research, 599, 148-152.
31. MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51, 201-226.
32. Marcantonio, R. J., & Cook, T. D. (1994). Convincing quasi-experiments: The interrupted time series and regression-discontinuity designs. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (pp. 133-154). San Francisco: Jossey-Bass.
33. Mark, M. M. (1986). Validity typologies and the logic and practice of quasi-experimentation. In W. M. K. Trochim (Ed.), New directions in program evaluation: Advances in quasi-experimental design and analysis (Vol. 31, pp. 47-66). San Francisco: Jossey-Bass.
34. Mark, M. M., Reichardt, C. S., & Sanna, L. J. (2000). Time-series design and analyses. In H. E. A. Tinsley & S. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 353-389). New York: Academic Press.
35. McCleary, R., & Hay, R. A., Jr. (1980). Applied time series analysis for the social sciences. Newbury Park, CA: Sage.
36. McGinley, L. (1997, October 29). Saccharin's presence on list of carcinogens may be near an end. The Wall Street Journal, pp. A1, A10.
37. Mohr, L. B. (1995). Impact analysis for program evaluation (2nd ed.). Thousand Oaks, CA: Sage.
38. Reichardt, C. S. (1979). The statistical analysis of data from nonequivalent group designs. In T. D. Cook & D. T. Campbell (Eds.), Quasi-experimentation: Design and analysis issues for field settings (pp. 147-205). Chicago: Rand McNally.
39. Reichardt, C. S. (2000). A typology of strategies for ruling out threats to validity. In L. Bickman (Ed.), Research design: Donald Campbell's legacy (Vol. 2, pp. 89-115). Thousand Oaks, CA: Sage.
40. Reichardt C. S. (2002). The priority of just-identified, recursive models. Psychological Methods, 7, 307-315.
41. Reichardt, C. S., & Cook, T. D. (1979). Beyond qualitative versus quantitative methods. In T. D. Cook & C. S. Reichardt (Eds.), Qualitative and quantitative methods in evaluation research (pp. 7-32). Newbury Park, CA: Sage.
42. Reichardt, C. S., & Gollob, H. F. (1986). Satisfying the constraints of causal modeling. In W. M. K. Trochim (Ed.), New directions in program evaluation: Advances in quasi-experimental design and analysis (Vol. 31, pp. 91-107). San Francisco: Jossey-Bass.
43. Reichardt, C. S., & Gollob, H. F. (1987). Taking uncertainty into account when estimating effects. In M. M. Mark & R. L. Shetland (Eds.), New directions in program evaluation: Multiple methods in program evaluation (Vol. 35, pp. 7-22). San Francisco: Jossey-Bass.
44. Reichardt, C. S., & Gollob, H. F. (1989). Ruling out threats to validity. Evaluation Review, 13, 3-17.
45. Reichardt, C. S., & Gollob, H. F. (1997). When confidence intervals should be used instead of statistical tests, and vice versa. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 259-284). Hillsdale, NJ: Erlbaum.
46. Reichardt, C. S., & Mark, M. M. (1998). Quasi-experimentation. In L. Bickman & D. J. Rog (Eds.), Handbook of applied social research methods (pp. 193-228). Thousand Oaks, CA: Sage.
47. Reichardt, C. S., Trochim, W. M. K., & Cappelleri, J. C. (1995). Reports of the death of regression-discontinuity analysis are greatly exaggerated. Evaluation Review, 19, 39-63.
48. Riecken, H. W., Boruch, R. F., Campbell, D. T., Caplan, N., Glennan, T. K., Jr., Pratt, J. W., et al. (1974). Social experimentation: A method for planning and evaluating social intervention. New York: Academic Press.
49. Rosenbaum, P. R. (1984). From association to causation in observational studies: The role of tests of strongly ignorable treatment assignment. Journal of the American Statistical Association, 79, 41-48.
50. Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41-55.
51. Ross, H. L., Campbell, D. T., & Glass, G. V. (1970). Determining the social effects of a legal reform: The British "Breathalyser" crackdown of 1967. American Behavioral Scientist, 13, 493-509.
52. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688-701.
53. Rubin, D. B. (1977). Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2, 1-26.
54. Rubin, D. B. (1980). Discussion of "Randomization analysis of experimental data in the Fisher randomization test" by D. Basu. Journal of the American Statistical Association, 75, 591-593.
55. Rubin, D. B. (1990). Comment on "Neyman (1923) and causal inference in experiments and observational studies." Statistical Science, 5, 472-480.
56. Schachter, S. (1982). Recidivism and self-cure of smoking and obesity. American Psychologist, 37, 436-444.
57. Sechrest, L., West, S. G., Phillips, M., Redner, R., & Yeaton, W. (1979). Some neglected problems in evaluation research: Strength and integrity of treatments. In L. Sechrest S. G. West, M. Phillips, R. Redner, & W. Yeaton (Eds.), Evaluation studies review annual (Vol. 4, pp. 15-35). Beverly Hills, CA: Sage.
58. Shadish, W. R., & Cook, T. D. (1999). Design rules: More steps toward a complete theory of quasi-experimentation. Statistical Science, 14, 294-300.
59. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
60. Shadish, W. R., Matt, G. E., Navarro, A. M., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin, 126, 512-529.
61. Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., et al. (1997). Evidence that therapy works in clinically representative conditions. Journal of Consulting and Clinical Psychology, 65, 355-365.
62. Snyder, S. H. (1974). Madness and the brain. New York: McGraw-Hill.
63. Trochim, W. M. K. (1984). Research designs for program evaluation: The regression-discontinuity approach. Newbury Park, CA: Sage.
64. Underwood, B. J. (1966). Experimental psychology (2nd ed.). New York: Appleton-Century-Crofts.
65. Wagenaar, A. C. (1981). Effects of the raised legal drinking age on motor vehicle accidents in Michigan. HSRI Research Review, 11, 1-8.
66. Wagenaar, A. C. (1986). Preventing highway crashes by raising the legal minimum age for drinking: The Michigan experience 6 years later. Journal of Safety Research, 17, 101-109.
67. Wallach, M. A., & Kogan, N. (1965). The roles of information, discussion, and consensus in group risk taking. Journal of Experimental Social Psychology, 1, 1-19.
68. Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy. American Psychologist, 47, 1578-1585.
69. West, S. G., Biesanz, J. C., & Pitts, S. C. (2000). Causal inference and generalization in field settings: Experimental and quasi-experimental designs. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social psychology (pp. 4084). New York: Cambridge University Press.
70. Winship, C., & Morgan, S. L. (1999). The estimation of causal effects from observational data. Annual Review of Sociology, 25, 659-707.