Using nonequivalent dependent variables to reduce internal validity threats in quasi-experiments: Rationale, history, and examples from practice

New Directions for Evaluation

Volumn 131, Issue 1, 2011, Pages 31-39

  Coryn, Chris L S ^a   Hobson, Kristin A ^a  

^a WESTERN MICHIGAN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859635568     PISSN: 10976736     EISSN: 1534875X     Source Type: Journal    
DOI: 10.1002/ev.375     Document Type: Article

References (24)

1. Campbell, D. T. (1986). Relabeling internal and external validity for applied social scientists. New Directions for Program Evaluation, 31, 67-77.
2. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago, IL: Rand McNally.
3. Christie, C. A., & Fleischer, D. N. (2010). Insight into evaluation practice: A content analysis of designs and methods used in evaluation studies published in North American evaluation-focused journals. American Journal of Evaluation, 31(3), 326-346. doi: 10.1177/1098214010369170
4. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis for field settings. Chicago, IL: Rand McNally.
5. Cook, T. D., Scriven, M., Coryn, C. L. S., & Evergreen, S. D. H. (2010). Contemporary thinking about causation in evaluation: A dialogue with Tom Cook and Michael Scriven. American Journal of Evaluation, 31(1), 105-117. doi: 10.1177/1098214009354918
6. Coryn, C. L. S. (2009). Modus operandi. In L. E. Sullivan (Ed.), The Sage glossary of the social and behavioral sciences (p. 328). Thousand Oaks, CA: Sage.
7. Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011). A systematic review of theory-driven evaluation practice from 1990 to 2009. American Journal of Evaluation, 32(2), 199-226. doi: 10.1177/1098214010389321
8. Gargani, J. (2010). A welcome change from debate to dialogue about causality. American Journal of Evaluation, 31(1), 131-132. doi: 10.1177/1098214009357612
9. Mackie, J. L. (1980). The cement of the universe: A study of causation. Oxford, United Kingdom: Oxford University Press.
10. McKillip, J., & Baldwin, K. (1990). Evaluation of an STD education media campaign: A control construct design. Evaluation Review, 14(4), 331-346. doi: 10.1177/0193841X9001400401
11. McSweeny, J. A. (1978). Effects of response cost on the behavior of a million persons: Charging for directory assistance in Cincinnati. Journal of Applied Behavior Analysis, 11, 47-51.
12. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York, NY: Macmillan.
13. Nimon, K., Zigarmi, D., & Allen, J. (2011). Measures of program effectiveness based on retrospective pretest data: Are all created equal? American Journal of Evaluation, 32(1), 8-28. doi: 10.1177/1098214010378354
14. Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 341-349. doi: 10.1177/109821400002100305
15. Reichardt, C. S. (2011). Evaluating methods for estimating program effects. American Journal of Evaluation, 32(2), 246-272. doi: 10.1177/1098214011398954
16. Robertson, T. S., & Rossiter, J. R. (1976, February). Short-run advertising effects on children: A field study. Journal of Marketing Research, 13, 68-70.
17. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688-701.
18. Rubin, D. B. (2005). Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100(469), 322-331. doi:0.1198/01621450400000188O
19. Scriven, M. (1968). In defense of all causes. Issues in Criminology, 4(1), 79-81.
20. Scriven, M. (1975). Causation as explanation. Nous, 9(1), 3-16.
21. Scriven, M. (1976). Maximizing the power of causal investigations: The modus operandi method. In G. V. Glass (Ed.), Evaluation studies review annual (Vol. 1, pp. 101-118). Beverly Hills, CA: Sage.
22. Scriven, M. (2009). Demythologizing causation and evidence. In S. I. Donaldson, C. A. Christie, & M. M. Mark (Eds.), What counts as credible evidence in applied research and evaluation practice? (pp. 134-152). Thousand Oaks, CA: Sage.
23. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
24. White, M. D. (2000). Assessing the impact of administrative policy on use of deadly force by on- and off-duty police. Evaluation Review, 24(3), 295-318. doi: 10.1177/0193841X0002400303