Program Theory-Driven Evaluation Science: Strategies and Applications

Program Theory-Driven Evaluation Science: Strategies and Applications

Volumn , Issue , 2007, Pages 1-264

  Donaldson, Stewart I ^a  

^a CLAREMONT GRADUATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85145153310     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203809730     Document Type: Book

References (137)

1. Adkins, J. A. (1999). Promoting organizational health: The evolving practice of occupational health psychology. Professional Psychology, 30(2), 129-137.
2. Adler, N. E., Marmot, M., McEwen, B. S., and Stewart, J. (1999). Socioeconomic status and health in industrial nations. New York: New York Academic Sciences.
3. Aley, J. (1995). Where the jobs are. Fortune, 132, 53-56.
4. Alkin, M. C. (Ed.) (2004). Evaluation roots. Thousand Oaks, CA: Sage.
5. Alkin, M. C, and Christie, C. A. (2004). An evaluation theory tree. In M. C. Alkin (Ed.), Evaluation roots (pp. 12-65). Thousand Oaks, CA: Sage.
6. Alkin, M. C, and Christie, C. A. (Eds.) (2005). Theorists’ models in action. San Francisco, CA: Jossey-Bass.
7. American Evaluation Association. (2004, July). Guiding principles for eυaluators.Retrieved February 24, 2004, from http://www.eval.org
8. Bamberg, S., and Schmidt, P. (1997). Theory driven evaluation of an environmental policy measure: Using the theory of planned behavior. Zeitschrift fűr Sozialpsychologie, 28(4), 280-297.
9. Baron, R. M., and Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
10. Bickman, L. (1987). The functions of program theory. New Directions for Program Evaluation, 33, 5-18.
11. Bickman, L. (1996). A continuum of care: More is not always better. American Psychologist, 57(7), 689-701.
12. Brousseau, R., and Yen, I. (2000). Reflections on connections between work and health. Thousand Oaks, CA: California Wellness Foundation.
13. Bureau of Labor Statistics. (1999, July). Unemployed persons by state, and duration of unemployment. Retrieved July 1, 1999, from http://www.bls.gov/schedule/archives/empsit_nr.htm# 1999
14. The California Work and Health Survey (1998, September). San Francisco, CA:University of California.
15. Campbell, B., and Mark, M. M. (2006). Toward more effective stakeholder dialogue:Applying theories of negotiation to policy and program evaluation. Journal of Applied Social Psychology, 36(12), 2834-2863.
16. Centers for Disease Control. (1999) Centers for Disease Control Program Evaluation Framework (1999). 48 (RR11), 1-40.
17. Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, CA: Sage.
18. Chen, H. T. (1997). Applying mixed methods under the framework of theorydriven evaluations. New Directions for Eυaluation, 74, 61-72.
19. Chen, H. T (2004). The roots of theory-driven evaluation: Current views and origins. In M. C. Alkin (Ed.), Eυaluation roots (pp. 132-152). Thousand Oaks, CA: Sage.
20. Chen, H. T. (2005). Practical program eυaluation: Assessing and improving planning, implementation, and effectiυeness. Newbury Park, CA: Sage.
21. Chen, H. T., and Rossi, P. H. (1983). Evaluating with sense: The theory-driven approach. Eυaluation Review, 7, 283-302.
22. Chen, H. T., and Rossi, P. H. (1987). The theory-driven approach to validity. Eυaluation and Program Planning, 10, 95-103.
23. Chen H. T., Wang J. C. S., and Lin, L. H. (1997). Evaluating the process and outcome of a garbage reduction program in Taiwan. Eυaluation Review, 27(1), 27-42.
24. Christie, C. A. (Ed.). (2003). The practice-theory relationship in evaluation. San Francisco, CA: Jossey-Bass.
25. Cook, T. D. (1985). Post-positivist critical multiplism. In R. L. Shotland and M. M. Mark (Eds.), Social science and social policy (pp. 21-61). Beverly Hills, CA:Sage.
26. Cook, T. D., Murphy, R. F. and Hunt, H. D. (2000). Comer’s school development program in Chicago: A theory-based evaluation. American Educational Research Journal, 37(2), 535-597.
27. Cousins, J. B., and Leithwood, K. A. (1986). Current empirical research on evaluation utilization. Reυiew of Educational Research, 56(3), 331-364.
28. Crano, W. D. (2003). Theory-driven evaluation and construct validity. In S. I. Donaldson and M. Scriven (Eds.), Evaluating social programs and problems:Visions for the new millennium (pp. 111-142). Mahwah, NJ: Lawrence Erlbaum Associates.
29. Cummings, T. G., and Worley, C. W. (2005). Organization deυelopment and change (8th ed.). Cincinnati, OH: South-Western College Publishing.
30. Davidson, E. J. (2005). Eυaluation methodology basics: The nuts and bolts of sound evaluation. Thousand Oaks, CA: Sage.
31. Donaldson, S. I. (1995a). Worksite health promotion: A theory-driven, empirically based perspective. In L. R. Murphy, J. J. Hurrel, S. L. Sauter, and G. P. Keita (Eds.), Job stress interυentions (pp. 73-90). Washington, DC: American Psychological Association.
32. Donaldson, S. I. (1995b). Peer influence on adolescent drug use: A perspective from the trenches of experimental evaluation research. American Psychologist, 50, 801-802.
33. Donaldson, S. I. (2001a). Mediator and moderator analysis in program development. In S. Sussman (Ed.), Handbook of program deυelopment for health behaυior research (pp. 470-496). Newbury Park, CA: Sage.
34. Donaldson, S. I. (2001b). Overcoming our negative reputation: Evaluation becomes known as a helping profession. American Journal of Evaluation, 22(3), 355-361.
35. Donaldson, S. I. (2003). Theory-driven program evaluation in the new millennium. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems:Visions for the new millennium (pp. 111-142). Mahwah, NJ: Lawrence Erlbaum Associates.
36. Donaldson, S. I. (2004). Using professional evaluation to improve the effectiveness of nonprofit organizations. In R. E. Riggio and S. Smith Orr (Eds.), Improυing leadership in nonprofit organizations (pp. 234-251). San Francisco:Jossey-Bass.
37. Donaldson, S. I. (2005). Using program theory-driven evaluation science to crack the Da Vinci Code. New Directions for Eυaluation, 106, 65-84.
38. Donaldson, S. I., and Bligh, M. C. (2006). Rewarding careers applying positive psychological science to improve quality of work life and organizational effectiveness. In S. I. Donaldson, D. E. Berger, and K. Pezdek (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 277-295). Mahwah, NJ: Lawrence Erlbaum Associates.
39. Donaldson, S. I., and Christie, C. A. (2005). The 2004 Claremont Debate: Lipsey versus Scriven. Determining causality in program evaluation and applied research: Should experimental evidence be the gold standard? Journal of Multidisciplinary Eυaluation, 3, 60-77.
40. Donaldson, S. I., and Christie, C. A. (2006). Emerging career opportunities in the transdiscipline of evaluation science. In S. I. Donaldson, D. E. Berger, and K. Pezdek (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 243-259). Mahwah, NJ: Erlbaum.
41. Donaldson, S. I., Christie, C. A., and Mark, M. M. (in press). What counts as credible evidence in evaluation and evidence-based practice? Thousand Oaks, CA: Sage.
42. Donaldson, S. I., and Gooler, L. E. (2001). Summary of the eυaluation of The California Wellness Foundation’s Work and Health Initiatiυe. Institute for Organizational and Program Evaluation Research, Claremont Graduate University, Claremant, CA.
43. Donaldson, S. L, and Gooler, L. E. (2002). Theory-driven evaluation of the work and health initiative: A focus on winning new jobs. American Journal of Eυaluation, 23(3), 341-346.
44. Donaldson, S. I., and Gooler, L. E. (2003). Theory-driven evaluation in action:Lessons from a $20 million statewide work and health initiative. Eυaluation and Program Planning, 26, 355-366.
45. Donaldson, S. I., Gooler, L. E., and Scriven, M. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Eυaluation, 23(3) 261-273.
46. Donaldson, S. I., Gooler, L. E., and Weiss, R. (1998). Promoting health and well-being through work: Science and practice. In X. B. Arriaga and S. Oskamp (Eds.), Addressing community problems: Research and intervention (pp. 160-194). Newbury Park, CA: Sage.
47. Donaldson, S. I., Graham, J. W., and Hansen, W. B. (1994). Testing the generalizability of intervening mechanism theories: Understanding the effects of school-based substance use prevention interventions. Journal of Behaυioral Medicine, 17, 195-216.
48. Donaldson, S. I., Graham, J. W., Piccinin, A. M., and Hansen, W. B. (1995). Resistanceskills training and onset of alcohol use: Evidence for beneficial and potentially harmful effects in public schools and in private Catholic schools. Health Psychology, 14, 291-300.
49. Donaldson, S. I., and Lipsey, M. W. (2006). Roles for theory in contemporary evaluation practice: Developing practical knowledge. In I. F. Shaw, J. C. Greene, and M. M. Mark (Eds.), The Sage handbook of eυaluation (pp. 56-75). London: Sage.
50. Donaldson, S. I., and Scriven, M. (2003a). Diverse visions for evaluation in the new millennium: Should we integrate or embrace diversity?. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems: Visions for the new millennium (pp. 3-16). Mahwah, NJ: Lawrence Erlbaum Associates.
51. Donaldson, S. I. and Scriven, M. (Eds.). (2003b). Eυaluating social programs and problems: Visions for the new millennium. Mahwah, NJ: Lawrence Erlbaum Associates.
52. Donaldson, S. I., Street, G., Sussman, S., andTobler, N. (2001). Using meta-analyses to improve the design of interventions. In S. Sussman (Ed.), Handbook of program deυelopment for health behaυior research and practice (pp. 449-466). Newbury Park, CA: Sage.
53. Donaldson, S. I., and Weiss, R. (1998). Health, well-being, and organizational effectiveness in the virtual workplace. In M. Igbaria and M. Tan (Eds.), The virtual workplace (pp. 24-44). Harrisburg, PA: Idea Group Publishing.
54. Dooley, D., Fielding, J., and Levi, L. (1996). Health and unemployment. Annual Reυiew of Public Health, 17, 449-465.
55. Dooley, D., and Prause, J. (1998). Underemployment and alcohol abuse in the national longitudinal survey of youth. Journal of Studies on Alcohol, 59, 669-680.
56. Eisenberg, L., Winters, L., and Alkin, M. C. (2005). The case: Bunche-Da Vinci Learning Partnership Academy. In M. C. Alkin and C. A. Christie (Eds.), Theorists’ models in action: New directions for evaluation (Vol. 106, pp. 5-13). San Francisco: Jossey-Bass.
57. Employment Development Department. (2000, September). Unemployment rates. Retrieved September 1, 2000, from htt://www.labormarketinfo.edd.ca.gov/cgi/dataanalysis/AreaSelection.asp?tableName=Labforce
58. Engle, M., and Altschuld, J. (2004). An update on university-based evaluation training. The Eυaluation Exchange, IX(4), 9-10.
59. Fetterman, D. (2003). Empowerment evaluation strikes a responsive cord. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems:Visions for the new millennium (pp. 63-76). Mahwah, NJ: Lawrence Erlbaum Associates.
60. Fitzpatrick, J. L. (2002). Dialog with Stewart Donaldson. American Journal of Evaluation, 3(3), 347-365.
61. Fitzpatrick, J. L. (2004). Exemplars as case studies: Reflections on the links between theory, practice, and context. American Journal of Eυaluation, 25(4) 541-559.
62. Fitzpatrick, J. L., Mark, M. M., and Christie, C. A. (in press). Exemplars in program evaluation practice. Thousand Oaks, CA: Sage.
63. Fitzpatrick, J. L., Sanders, J. R., and Worthen B. R. (2004). Program evaluation:Alternative approaches and practical guidelines. Boston, MA: Allyn and Bacon.
64. Freud, S. (1930). Ciυilization and its discontents. London: Hogarth.
65. Funnell, S. (1997). Program logic: An adaptable tool for designing and evaluating programs. Eυaluation News and Comment, 5-17.
66. Gargani, J. (2003, November). The history of theory-based eυaluation: 1909 to 2003. Paper presented at the American Evaluation Association annual conference, Reno, NV.
67. Ghere, G., King, J. A., Stevahn, L., and Minnema, J. (2006). A professional development unit for reflecting on program evaluator competencies. American Journal of Eυaluation, 27(1), 108-123.
68. Greene, J. C. (2005). A valued-engaged approach to evaluating the Bunche-Da Vinci Learning Academy. In M. C. Alkin and C. A. Christie (Eds.), Theorists’ models in action (pp. 27-46). San Francisco, CA: Jossey-Bass.
69. Guiding Principles for Evaluators (1994). New Directions for Program Evaluation, 66. San Francisco: Jossey-Bass.
70. Hansen, W. B. (1993). School-based alcohol prevention programs. Alcohol Health and Research World, 17, 54-60.
71. Hansen, W. B., and McNeal, Jr., R. B. (1996). The law of maximum expected potential effect: Constraints placed on program effectiveness by mediator relationships. Health Education Research, 11, 501-507.
72. Hasenfeld, Y. (1983). Human service organizations. Englewood Cliffs, NJ:Prentice-Hall.
73. Henry, G. T. (2005). In pursuit of social betterment: A proposal to evaluate the Da Vinci Learning Model. In M. C. Alkin and C. A. Christie (Eds.), Theorists’ models in action, (pp. 47-64). San Francisco, CA: Jossey-Bass.
74. Henry, G. T., and Mark, M. M. (2003). Toward an agenda for research on evaluation. In C. A. Christie (Ed.), The practice-theory relationship in evaluation (pp. 69-80). San Francisco, CA: Jossey-Bass.
75. House, E. R. (2003). Stakeholder bias. In C. A. Christie (Ed.), New directions for evaluation, No. 97 (pp. 53-56). San Franciso: Jossey-Bass.
76. Howard, A. (1995). A framework for work change (pp. 1-44). In A. Howard (Ed.), The changing nature of work (pp. 1-44). San Francisco, CA: Jossey-Bass.
77. Jin, R. L., Shah, C. P., and Svoboda, T. J. (1999). The impact of unemployment on health: A review of the evidence. Journal of Public Health Policy, 18, 275-301.
78. Joint Committee on Standards for Education Evaluation (1994). The program evaluation standards: How to assess evaluations of educational programs. Thousand, Oaks, CA: Sage.
79. Karasek, R., and Theorell, T. (1990). Healthy work: Stress, productivity, and the reconstruction of working life. New York: Basic Books.
80. King, J. A. (2005). A proposal to build evaluation capacity at the Bunch-Da Vinci Learning Partnership Academy. In M. C. Alkin and C. A. Christie (Eds.), Theorists’ models in action (pp. 85-98). San Francisco, CA: Jossey-Bass.
81. Levin, H. M., and McEwan, P. J. (2001). Cost-effectiveness analysis: Methods and applications. Thousand Oaks, CA: Sage.
82. Levy, S. (March 2001). Five years of strong economic growth: The impact on poverty, inequality, and work arrangements in California. The Future of Work and Health Program. The California Wellness Foundation, San Francisco, CA.
83. Lincoln, Y. S. (2003). Fourth generation evaluation in the new millennium. In S. I. Donaldson and M. Scriven (Eds.), Evaluating social programs and problems:Visions for the new millennium (pp. 77-90). Mahwah, NJ: Lawrence Erlbaum Associates.
84. Lipsey, M. W. (1988). Practice and malpractice in evaluation research. Evaluation Practice, 9, 5-24.
85. Lipsey, M. W. (1990). Design sensitivity. Newbury Park, CA: Sage.
86. Lipsey, M. W. (1993). Theory as method: Small theories of treatments. New Directions For Program Eυaluation, 57, 5-38.
87. Lipsey, M. W., and Cordray, D. (2000). Evaluation methods for social intervention. Annual Review of Psychology, 51, 345-375.
88. Lipsey, M. W., Crosse, S., Dunkel, J., Pollard, J., andStobart, G. (1985). Evaluation:The state of the art and the sorry state of the science. New Directions for Program Evaluation, 27, 7-28.
89. Lipsey, M. W., and Pollard, J. A. (1989). Driving toward theory in program evaluation:More models to choose from. Eυaluation and Program Planning, 12, 317-328.
90. Lipsey, M. W., and Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
91. London, M., and Greller, M. M. (1991). Invited contribution: Demographic trends and vocational behavior: A twenty year retrospective and agenda for the 1990s. Journal of Vocational Behavior, 28, 125-164.
92. Mark, M. M. (2003). Toward an integrative view of the theory and practice of program and policy evaluation. In S. I. Donaldson and M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 183-204). Mahwah, NJ: Lawrence Erlbaum Associates.
93. Mark, M. M., Henry, G. T, and Julnes, G. (2000). Evaluation: An integrative framework for understanding guiding, and improving policies and programs. San Francisco, CA: Jossey-Bass.
94. Marmot, M. G. (1998). Social differentials in health within and between populations. Daedelus: Proceedings of the American Academy of Arts, 123, 197-216.
95. McLaughlin, J. A., and Jordon, G. B. (1999). Logic models: A tool for telling your program’s performance story. Evaluation and Program Planning, 22(1) 65-72.
96. Mercier, C, Piat, M., Peladeau, N., and Dagenais, C. (2000). An application of theorydriven evaluation to a drop-in youth center. Evaluation Reυiew, 24, 73-91.
97. Mertens, D. M. (2003). The inclusive view of evaluation: Visions for the new millennium. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems: Visions for the new millennium (pp. 91-108). Mahwah, NJ:Lawrence Erlbaum Associates.
98. Mertens, D. M. (2005). The inauguration of the international organization for cooperation in evaluation. American Journal of Eυaluation, 26(1), 124-130.
99. Mouton, J., and Wildschut, L. (2006). Theory driven realist evaluation. In R. Basson, C. Potter, and M. Mark (Eds.), Internationalizing eυaluation: Reflections on evaluation approaches and their use globally using South Africa as a case example. Manuscript in preparation.
100. Patton, M. Q. (1997). Utilization-focused evaluation: The new century text (3rd ed.).Thousand Oaks, CA: Sage.
101. Patton, M. Q. (2001). Evaluation, knowledge management, best practices, and high quality lessons learned. American Journal of Eυaluation, 22, 329-336.
102. Pawson, R. and Tilley, N. (1997). Realist eυaluation. Thousand Oaks, CA: Sage.
103. Pelletier, K. (1993). A review and analysis of the health and cost-effective outcome studies of comprehensive health promotion and disease prevention programs at the worksite, 1991-1995 update. American Journal of Health Promotion, 8, 380-388.
104. Quick, J., Murphy, L. R., Hurrell, J., and Orman, D. (1992). The value of work, the risk of distress, and the power of prevention. In J. Quick, L. Murphy, and J. Hurrell, Jr. (Eds.), Stress and well-being at work. Washington, DC: American Psychological Association.
105. Reichhart, C, and Rallis, C. S. (Eds.). (1994). The qualitative-quantitative debate:New perspectives. New Directions for Program Evaluation, p. 61
106. Renger, R., and Titcomb, A. (2002). A three-step approach to teaching logic models. American Journal of Evaluation, 23(4), 493-503.
107. Reynolds, A. J. (1998). Confirmatory program evaluation: A method for strengthening causal inference. American Journal of Evaluation, 19, 203-221.
108. Rossi, R H. (2004). My views of evaluation and their origins. In M. C. Alkin (Ed.), Eυaluation roots (pp. 122-131). Thousand Oaks, CA: Sage.
109. Rossi, R H., Lipsey, M. W., and Freeman, H. E. (2004). Eυaluation: A systematic approach (7th ed.). Thousand Oaks, CA: Sage.
110. Rousseau, D. M. (1996). Changing the deal while keeping people. Academy of Management Executive, 70, 50-59.
111. Russon, C. (2004). Cross-cutting issues in international standards development. New Directions for Eυaluation, 104, 89-93.
112. Sanders, J. R. (2001). A vision for evaluation. American Journal of Eυaluation, 22, 363-366.
113. Schauffler, H., and Brown, R. (2000). The state of health insurance in California, 1999. Berkeley, CA: Regents of University of California.
114. Scriven, M. (1991). Eυaluation thesaurus (4th ed.). Thousand Oaks, CA: Sage.
115. Scriven, M. (1998). Minimalist theory: The least theory that practice requires. American Journal of Evaluation, 19, 57-70.
116. Scriven, M. (2003). Evaluation in the new millennium: The transdisciplinary vision. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems:Visions for the new millennium (pp. 19-42). Mahwah, NJ: Lawrence Erlbaum Associates.
117. Seigart, D., and Brisolara, S. (2002). Feminist evaluation: Explorations and experiences. San Francisco, CA: Jossey-Bass.
118. Shadish, W. R. (1993). Critical multiplism: A research strategy and its attendant tactics. New Directions for Program Evaluation, 60, 13-57.
119. Shadish, W. R. (1998). Presidential address: Evaluation theory is who we are. American Journal of Evaluation, 19(1), 1-19.
120. Shadish, W. R., Cook, T. D., and Campbell, D. T. (2002). Experimental and quasiexperimental designs for generalized causal inference. Boston: Houghton-Mifflin.
121. Shadish, W. R., Cook, T. D., and Leviton, L. C. (1991). Foundations of program eυaluation:Theories of practice. Newbury Park, CA: Sage.
122. Slater, J. K. (2006). Book review: Evaluating social programs and problems: Visions for the new millennium. American Journal of Eυaluation, 27(1), 128-129.
123. Stame, N. (2004). Theory-based evaluation and types of complexity. Evaluation:The International Journal of Theory, Research and Practice, 10(1), 58-76.
124. Stern, E. (2004). What shapes European evaluation? A personal reflection. Eυaluation: The International Journal of Theory, Research and Practice, 10(1) 7-15.
125. Stufflebeam, D. L. (Ed.). (2001). Evaluation models. New Directions for Evaluation, 89. San Francisco, Jossey-Bass.
126. Thompson-Robinson, M., Hopson, R., and SenGupta, S. (Eds.). (2004). In search of cultural competence in evaluation: Toward principles and practice. San Francisco, CA: Jossey-Bass.
127. Tilley, N. (2004). Applying theory-driven evaluation to the British Crime Reduction Programme: The theories of the programme and of its evaluations. Criminal Justice: International Journal of Policy and Practice, 4(3), 255-276.
128. Triolli, T. (2004). Review of “Evaluating social program and problems: Visions for the new millennium.” Evaluation and Program Planning, 26(3), 82-88.
129. U.S. Department of Health and Human Services. (1993). 1992 national survey of worksite health promotion activities: Summary. American Journal of Health Promotion, 7 452-464
130. van der Knaap, P. (2004). Theory-based evaluation and learning: Possibilities and challenges. Eυaluation: The International Journal of Theory, Research and Practice, 70(1), 16-34.
131. Vinokur, A. D., van Ryn, M., Gramlich, E., and Price, R. H. (1991). Long-term followup and benefit-cost analysis of the JOBS program: A preventive intervention for the unemployed. Journal of Applied Psychology, 76, 213-219.
132. Weiss, C. H. (1997). How can theory-based evaluation make greater headway? Eυaluation Review, 21, 501-524.
133. Weiss, C. H. (1998). Evaluation: Methods for studying programs and policies (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
134. Weiss, C. H. (2004a). On theory-based evaluation: Winning friends and influencing people. The Eυaluation Exchange, IX, 4, 1-5.
135. Weiss, C. H. (2004b). Rooting for evaluation: A cliff notes version of my work. In M. C. Alkin (Ed.), Evaluation roots (pp. 153-168). Thousand Oaks, CA: Sage.
136. West, S. G., and Aiken, L. S. (1997). Toward understanding individual effects in multicomponent prevention programs: Design and analysis strategies. In K. J. Bryant, M. Windle, and S. G. West (Eds.), The science of preυention: Methodological adυances from alcohol and substance abuse research (pp. 167-209). Washington, DC:American Psychological Association.
137. Wholey, J. S. (2003). Improving performance and accountability: Responding to emerging management challenges. In S. I. Donaldson and M. Scriven (Eds.), Eυaluating social programs and problems: Visions for the new millennium (pp. 43-62). Mahwah, NJ: Lawrence Erlbaum Associates.