A big chapter about small theories: Theory as method: Small theories of treatments

New Directions for Evaluation

Volumn 2007, Issue 114, 2007, Pages 27-62

  Leviton, Laura C ^a   Lipsey, Mark W ^a  

^a ROBERT WOOD JOHNSON FOUNDATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85040485039     PISSN: 10976736     EISSN: 1534875X     Source Type: Journal    
DOI: 10.1002/ev.224     Document Type: Article

References (100)

1. Campbell, D. T., and Stanley, J. C., Experimental and Quasi-Experimental Designs for Research.Skokie, Ill.: Rand McNally, 1966.
2. Chen, H. T., and Rossi, P. H., Theory-Driven Evaluations.Thousand Oaks, Calif.: Sage, 1994.
3. Connell, J., Kubish, A., Schorr, L., and Weiss, C., New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts.Washington, D.C.: Aspen Institute, 1995.
4. Cook, T. D., and Campbell, D. T., Quasi-Experimentation.Boston: Houghton Mifflin, 1979.
5. Cronbach, L. J., Designing Evaluations of Educational and Social Programs.San Francisco: Jossey-Bass, 1982.
6. Lipsey, M. W., “Theory as Method: Small Theories of Treatments.” In L. B.Sechrest, and A. G.Scott (eds.), Understanding Causes and Generalizing about Them.New Directions for Program Evaluation, no. 57.San Francisco: Jossey-Bass, 1993.
7. Suchman, E. A., Evaluation Research: Principles and Practices in Public Service and Social Programs.New York: Russell Sage Foundation, 1967.
8. Wholey, J. S., “Evaluability Assessment: Developing Program Theory.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions in Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
9. Yeaton, W. H., and Sechrest, L. B., “Critical Dimensions in the Choice and Maintenance of Successful Treatments: Strength, Integrity, and Effectiveness.“Journal of Consulting and Clinical Psychology, 1981, 49, 156-167.
10. Adelman, M. S., “Intervention Theory and Evaluating Efficacy.“Evaluation Review, 1986, 10, 65-83.
11. Ashby, W. R., Introduction to Cybernetics.London: Chapman & Hall, 1956.
12. Baker, F., and Intagliata, J., “Quality of Life in the Evaluation of Community Support Systems.“Evaluation and Program Planning, 1982, 5, 69-79.
13. Bickman, L., “Improving Established Statewide Programs: A Component Theory of Evaluation.“Evaluation Review, 1985, 9, 189-208.
14. Bickman, L., “The Functions of Program Theory.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
15. Boruch, R. F., and Gomez, M., “Sensitivity, Bias, and Theory in Impact Evaluations.“Professional Psychology, 1977, 8, 411-434.
16. Bougon, M. G., “Uncovering Cognitive Maps: The Self-Q Technique.” In G.Morgan (ed.), Beyond Method: A Study of Organization of Research Strategies.Newbury Park, Calif.: Sage, 1983.
17. Brinberg, D., and McGrath, J. E., Validity and the Research Process.Newbury Park, Calif.: Sage, 1985.
18. Brownell, K. D., Marlatt, G. A., Lichtenstein, E., and Wilson, G. T., “Understanding and Preventing Relapse.“American Psychologist, 1986, 41, 765-782.
19. Campbell, D. T., “Relabeling Internal and External Validity for Applied Social Scientists.” In W.M.K.Trochim (ed.), Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986.
20. Campbell, D. T., and Stanley, J. C., Experimental and Quasi-Experimental Designs for Research.Skokie, Ill: Rand McNally, 1966.
21. Caplan, N., “Treatment Intervention and Reciprocal Interaction Effects.“Journal of Social Issues, 1968, 24, 63-88.
22. Carver, R. P., “Two Dimensions of Tests: Psychometric and Edumetric.“American Psychologist, 1974, 29, 512-518.
23. Chamberlin, T. C., “The Method of Multiple Working Hypotheses.“Science, 1965, 148(3671), 754-759.
24. Chandler, M. J., “Egocentrism and Antisocial Behavior: The Assessment and Training of Social Perspective-Taking Skills.“Developmental Psychology, 1973, 9, 326-333.
25. Chen, H. T., and Rossi, P. H., “The Multi-Goal, Theory-Driven Approach to Evaluation: A Model Linking Basic and Applied Social Science.“Social Forces, 1980, 59, 106-122.
26. Chen, H. T., and Rossi, P. H., “Evaluating with Sense: The Theory-Driven Approach.“Evaluation Review, 1983, 7, 283-302.
27. Cohen, P., “To Be or Not to Be: Control and Balancing of Type I and Type II Errors.“Evaluation and Program Planning, 1982, 5, 247-253.
28. Conrad, K. J., and Miller, T. Q., “Measuring and Testing Program Philosophy: A Framework for Implementation and Evaluation.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
29. Cook, T. D., and Campbell, D. T. (eds.).Quasi-Experimentation: Design and Analysis Issues for Field Settings.Boston: Houghton Mifflin, 1979.
30. Cook, T. J., and Poole, W. K., “Treatment Implementation and Statistical Power: A Research Note.“Evaluation Review, 1982, 6, 425-430.
31. Cordray, D. S., “Quasi-Experimental Analysis: A Mixture of Methods and Judgment.” In W.M.K.Trochim (ed.), Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986.
32. Cordray, D. S., and Lipsey, M. W., “Evaluation 1986: Program Evaluation and Program Research.” In D. S.Cordray, and M. W.Lipsey (eds.), Evaluation Studies Review Annual. Vol. 11.Newbury Park, Calif.: Sage, 1987.
33. Crano, W. D., and Messe, L. A., “Assessing and Redressing Comprehension Artifacts in Social Intervention Research.“Evaluation Review, 1985, 9, 144-172.
34. Datta, L., “Does It Work When It Has Been Tried? And Half Full or Half Empty?“Journal of Career Education, 1976, 2, 38-55.
35. Datta, L., “Interpreting Data: A Case Study from the Career Intern Program Evaluation.“Evaluation Review, 1980, 4, 481-506.
36. Dunford, F. W., and Elliott, D. S., “Identifying Career Offenders Using Self-Reported Data.“Journal of Research in Crime and Delinquency, 1984, 21, 57-86.
37. Einhorn, H. I., and Hogarth, R. M., “Judging Probable Cause.“Psychological Bulletin, 1986, 99, 3-19.
38. Elliott, D. S., Dunford, F. W., and Huizinga, D., “The Identification and Prediction of Career Offenders Utilizing Self-Reported and Official Data.” In J. D.Burchard, and S. N.Burchard (eds.), The Prevention of Delinquent Behavior.Newbury Park, Calif.: Sage, 1986.
39. Finney, J. W., and Moos, R. H., “Environmental Assessment and Evaluation Research: Examples from Mental Health and Substance Abuse Programs.“Evaluation and Program Planning, 1984, 7, 151-167.
40. Glaser, B. G., and Strauss, A. L., The Discovery of Grounded Theory: Strategies of Qualitative Research.Hawthorne, N.Y.: Aldine, 1967.
41. Gottfredson, G. D., “A Theory-Ridden Approach to Program Evaluation: A Method for Stimulating Researcher-Implementer Collaboration.“American Psychologist, 1984, 39, 1101-1112.
42. Hawkins, D. F., “Applied Research and Social Theory.“Evaluation Quarterly, 1978, 2, 141-152.
43. Holland, P. W., “Statistics and Causal Inference.“Journal of the American Statistical Association, 1986, 81, 945-960.
44. Howard, K. L., Kopta, S. M., Krause, M. S., and Orlinsky, D. E., “The Dose-Effect Relationship in Psychotherapy.“American Psychologist, 1986, 41, 159-164.
45. Johnston, I., Ettema, I., and Davidson, T., An Evaluation of Freestyle: A Television Series to Reduce Sex-Role Stereotypes.Ann Arbor: Institute for Social Research, University of Michigan, 1980.
46. Judd, C. M., and Kenny, D. A., “Process Analysis: Estimating Mediation in Treatment Evaluations.“Evaluation Review, 1981, 5, 602-619.
47. Kleinman, A., “Some Uses and Misuses of the Social Sciences in Medicine.” In D. W.Fiske, and R. A.Schweder (eds.), Meta-Theory in Social Science: Pluralisms and Subjectivities.Chicago: University of Chicago Press, 1986.
48. Kutchinsky, B., “The Effect of Easy Availability of Pornography on the Incidence of Sex Crimes: The Danish Experience.“Journal of Social Issues, 1973, 29, 163-181.
49. Lipsey, M. W., “A Scheme for Assessing Measurement Sensitivity in Program Evaluation and Other Applied Research.“Psychological Bulletin, 1983, 94, 152-165.
50. Lipsey, M. W., Design Sensitivity: Statistical Power for Experimental Research.Newbury Park, Calif.: Sage, 1990.
51. Lipsey, M. W., and Pollard, J. A., “Driving Toward Theory in Program Evaluation: More Models to Choose from.“Evaluation and Program Planning, 1989, 12, 317-328.
52. Lipsey, M. W., and others.“Evaluation: The State of the Art and the Sorry State of the Science.” In D. S.Cordray (ed.), Utilizing Prior Research in Evaluation Planning.New Directions for Program Evaluation, no. 27. San Francisco: Jossey-Bass, 1985.
53. Loeber, R., and Stouthamer-Loeber, M., “The Prediction of Delinquency.” In H. C.Quay (ed.), Handbook of Juvenile Delinquency.New York: Wiley, 1987.
54. McClintock, C., “Conceptual and Action Heuristics: Program Theory Tools for the Formative Evaluator.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
55. Mark, M. M., “Treatment Implementation, Statistical Power, and Internal Validity.“Evaluation Review, 1983, 7, 543-549.
56. Mark, M. M., “What Have We Learned About Studying Causal Process?“Paper presented at the annual meeting of the American Evaluation Association, Kansas City, Missouri, Oct. 1986.
57. Miller, W. R., “Motivation for Treatment: A Review with Special Emphasis on Alcoholism.“Psychological Bulletin, 1985, 98, 84-107.
58. O’Sullivan, E., Burleson, G. W., and Lamb, W. E., “Avoiding Evaluation Cooptation: Lessons from a Renal Dialysis Evaluation.“Evaluation and Program Planning, 1985, 8, 255-259.
59. Patterson, G. R., “Performance Models for Antisocial Boys.“American Psychologist, 1986, 41, 432-444.
60. Platt, J. R., “Strong Inference.“Science, 1964, 146(3642), 347-353.
61. Reichardt, C. S., “The Statistical Analysis of Data from Non-Equivalent Group Designs.” In T. D.Cook, and D. T.Campbell (eds.), Quasi-Experimentation: Design and Analysis Issues for Field Settings.Skokie, Ill.: Rand McNally, 1979.
62. Reichardt, C. S., “On the Logic and Practice of Assessing Cause.“Paper presented at the annual meeting of the American Educational Research Association, Montreal, Apr. 1983.
63. Reichardt, C. S., and Gollob, H. F., “Satisfying the Constraints of Causal Modeling.” In W.M.K.Trochim (ed.), Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986.
64. Rezmovic, E. L., “Assessing Treatment Implementation amid the Slings and Arrows of Reality.“Evaluation Review, 1984, 8, 187-204.
65. Rindskopf, D., “New Developments in Selection Modeling for Quasi-Experimentation.” In W.M.K.Trochim (ed.), Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986.
66. Rosen, A., and Proctor, E. K., “Specifying the Treatment Process: The Basis for Effectiveness Research.“Journal of Social Service Research, 1978, 2, 25-43.
67. Rossi, P. H., “Issues in the Evaluation of Human Services Delivery.“Evaluation Quarterly, 1978, 2, 573-599.
68. Rossi, P. H., Berk, R. A., and Lenihan, K. J., Money, Work, and Crime: Experimental Evidence.San Diego: Academic Press, 1980.
69. Rossi, P. H., and Wright, J. D., “Evaluation Research: An Assessment.“Annual Review of Sociology, 1984, 10, 331-352.
70. Rubin, D. B., “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.“Journal of Educational Psychology, 1974, 66, 688-701.
71. Runyan, W. M., “A Stage-State Analysis of the Life Course.“Journal of Personality and Social Psychology, 1980, 38, 951-962.
72. St. Pierre, R. G., and Proper, E. C., “Attrition: Identification and Exploration in the National Follow-Through Evaluation.“Evaluation Review, 1978, 2, 153-166.
73. Scheirer, M. A., “Program Theory and Implementation Theory: Implications for Evaluators.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
74. Scheirer, M. A., and Rezmovic, E. L., “Measuring the Degree of Program Implementation: A Methodological Review.“Evaluation Review, 1983, 7, 599-633.
75. Schneider, A. L., and Darcy, R. E., “Policy Implications of Using Significance Tests in Evaluation Research.“Evaluation Review, 1984, 8, 573-580.
76. Scriven, M., “Maximizing the Power of Causal Investigations: The Modus Operandi Method.” In W. J.Popham (ed.), Evaluation in Education: Current Applications.Berkeley, Calif.: McCutchan, 1974.
77. Sechrest, L. B., “Modes and Methods of Personality Research.“Journal of Personality, 1986a, 54, 318-331.
78. Sechrest, L. B., “What Have We Learned About Interpreting No-Difference Findings?" Paper presented at the annual meeting of the American Evaluation Association, Kansas City, Missouri, 1986b.
79. Sechrest, L. B., and Yeaton, W. H., “Empirical Bases for Estimating Effect Size.” In R. F.Boruch, P. M.Wortman, and D. S.Cordray (eds.), Reanalyzing Program Evaluations.San Francisco: Jossey-Bass, 1981.
80. Sechrest, L. B., and Yeaton, W. H., “Magnitudes of Experimental Effects in Social Science Research.“Evaluation Review, 1982, 6, 579-600.
81. Sechrest, L. B., and others.“Some Neglected Problems in Evaluation Research: Strength and Integrity of Treatments.” In L. B.Sechrest, and others (eds.), Evaluation Studies Review Annual. Vol. 4.Newbury Park, Calif.: Sage, 1979.
82. Shapiro, J. Z., “The Social Costs of Methodological Rigor: A Note on the Problem of Massive Attrition.“Evaluation Review, 1984a, 8, 705-712.
83. Shapiro, J. Z., “Social Justice and Educational Evaluation: Normative Implications of Alternative Criteria for Program Assessment.“Educational Theory, 1984b, 34, 137-149.
84. Sherrill, S., “Toward a Coherent View of Evaluation.“Evaluation Review, 1984, 8, 443-466.
85. Smith, A., Cardillo, J. E., and Choate, R. O., “Age-Based Transition Periods and the Outcome of Mental Health Treatment.“Evaluation and Program Planning, 1984, 7, 237-244.
86. Snowden, L. R., “Treatment Participation and Outcome in a Program for Problem Drinker-Drivers.“Evaluation and Program Planning, 1984, 7, 65-71.
87. Suchman, E. A., Evaluation Research: Principles and Practices in Public Service and Social Programs.New York: Russell Sage Foundation, 1967.
88. Taber, M. A., and Poertner, J. P., “Modeling Service Delivery as a System of Transitions.“Evaluation Review, 1981, 5, 549-566.
89. Trochim, W.M.K., “Framing the Evaluation Question: Some Useful Strategies.“Paper presented at the joint meeting of the Evaluation Research Society and Evaluation Network, Chicago, Oct. 1983.
90. Trochim, W.M.K., “Pattern Matching, Validity, and Conceptualization in Program Evaluation.“Evaluation Review, 1985, 9, 575-604.
91. Trochim, W.M.K. (ed.).Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986a.
92. Trochim, W.M.K., “Editor’s Notes.” In W.M.K.Trochim (ed.), Advances in Quasi-Experimental Design and Analysis.New Directions for Program Evaluation, no. 31. San Francisco: Jossey-Bass, 1986b.
93. Wang, M.C., and Walberg, H. J., “Evaluating Educational Programs: An Integrative, Causal-Modeling Approach.“Educational Evaluation and Policy Analysis, 1983, 5, 347-366.
94. Weinholtz, D., and Friedman, C. P., “Conducting Qualitative Studies Using Theory and Previous Research.“Evaluation and the Health Professions, 1985, 8, 149-176.
95. Weiss, C. H., Evaluation Research: Methods of Assessing Program Effectiveness.Englewood Cliffs, N.J.: Prentice Hall, 1972.
96. Wholey, J. S., “Evaluability Assessment: Developing Program Theory.” In L.Bickman (ed.), Using Program Theory in Evaluation.New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass, 1987.
97. Wilkins, W., “Placebo Problems in Psychotherapy Research: Social-Psychological Alternatives to Chemotherapy Concepts.“American Psychologist, 1986, 41, 551-556.
98. Yeaton, W. H., “Proceed With Caution: Using No-Difference Findings to Eliminate Validity Threats.“Paper presented at the annual meeting of the American Evaluation Association, Kansas City, Missouri, Oct. 1986.
99. Yeaton, W. H., and Sechrest, L. B., “Critical Dimensions in the Choice and Maintenance of Successful Treatments: Strength, Integrity, and Effectiveness.“Journal of Consulting and Clinical Psychology, 1981, 49, 156-167.
100. Yeaton, W. H., Wortman, P. M., and Langberg, N., “Differential Attrition: Estimating the Effect of Crossovers on the Evaluation of a Medical Technology.“Evaluation Review, 1983, 7, 831-840.