Planning evaluation through the program life cycle

American Journal of Evaluation

Volumn 33, Issue 2, 2012, Pages 263-294

  Scheirer, Mary Ann ^f   Mark, Melvin M ^a   Brooks, Ariana ^b   Grob, George F ^c   Chapel, Thomas J ^d   Geisz, Mary ^e   McKaughan, Molly ^e   Leviton, Laura ^e  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b HeartShare Human Services of New York   (United States)

^c Center for Public Program Evaluation   (United States)

^d CENTERS FOR DISEASE CONTROL AND PREVENTION   (United States)

^e ROBERT WOOD JOHNSON FOUNDATION   (United States)

^f NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84860135456     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214011434609     Document Type: Article

References (76)

1. Comments on "what constitutes strong evidence of a program's effectiveness?". AEA, Response of the Evaluation Policy Task Force to the U.S: Office of Management and Budget; 2008:.
2. An evaluation roadmap for a more effective government. 2010:.
3. Andreasen A.R.Marketing social change: Changing behavior to promote health, social development, and the environment. San Francisco, CA: Jossey-Bass; 1995:.
4. Boruch R.F.Randomized experiments for planning and evaluation. Thousand Oaks, CA: Sage; 1997:.
5. Boruch R.F.Place randomized trials: Experimental tests of public policy The Annals of the American Academy of Political and Social Science. Thousand Oaks, CA: Sage; 2005:.
6. Chatterjee S.,Chowdhary N.,Pednekar S.,Cohen A.,Andrew G.,Andrew G.,Patel VWorld Psychiatry. 2008:39-46.
7. Chelimsky E.On the social science contribution to governmental decision-making.Science. 1991;254:226-231.
8. Chelimsky E.Evaluation for the 21st century. Chelimsky E.Shadish W., ed. Thousand Oaks, CA: Sage; 1997:.
9. Chen H. TTheory-driven evaluations. Newbury Park, CA: Sage; 1990:.
10. Chinman M.,Imm P.,Wandersman AGetting to outcomes 2004: Promoting accountability through methods and tools for planning, implementation and evaluation (Technical Report, Rand Corp.). 2004:.
11. Chronbach L.J.Toward the reform of program evaluation. San Francisco, CA: Jossey-Bass; 1980:.
12. Cook T.D.,Campbell D.T.Quasi-experimentation: Design and analysis issues for field settings. Chicago, IL: Rand McNally; 1979:.
13. The evaluation facilitator's guide to: Systems evaluation protocol. Ithaca, NY: Cornell Digital Print Services; 2009:.
14. Donaldson S.I.Program theory-driven evaluation science: Strategies and applications. Mahwah, NJ: Erlbaum; 2007:.
15. Donaldson S.I.,Gooler L.E.Theory-driven evaluation of the Work and Health Initiative: A focus on winning new jobs.American Journal of Evaluation. 2002;23:341-346.
16. Edna McConnell Clark Foundation. (2011). How we work. Retrieved fromwww.emcf.org/how-we-work/.
17. Eoyang G.L.,Berkas T.H.Managing complexity in organizations. Lissack M.Gunz H., ed. Westport, CN: Greenwood; 1999:.
18. Fetterman D.M.Empowerment evaluation. Thousand Oaks, CA: Sage; 1996:.
19. Fetterman D.M.,Kaftarian S.J.,Wandersman S.Empowerman evaluation: Knowledge and tools for self-assessment & accountability. Thousand Oaks, CA: Sage; 1996:.
20. Fetterman D.M.,Wandersman A.Empowerment evaluation principles in practice. New York, NY: The Guilford Press; 2005:.
21. Frechtling J.A.Logic modeling methods in program evaluation. San Francisco, CA: Jossey Bass; 2007:.
22. Glasgow R.E.,Vogt T.M.,Boles S.M.Evaluating the public health impact of health promotion interventions: The RE-AIM framework.American Journal of Public Health. 1999;89:1322-1327.
23. Greenhalgh T.,Robert G.,Macfarlane F.,Bate P.,Kyriakidou O.Diffusion of innovations in service organizations: Systematic review and recommendations.The Millbank Quarterly. 2004;82:581-630.
24. Hatry H.P.Performance measurement: Getting results. Washington, DC: The Urban Institute Press; 1999:.
25. Putting evidence into practice (entire issue).Health Affairs. 2005;24:8-185.
26. Hendricks MFrom measuring outcomes to managing them: The United Way of greater Houston. 2010:.
27. Hwalek M.,Williams M.G.The real-time evaluation memo: A tool for enabling evaluative thinking and learning in foundations and nonprofits.Foundation Review. 2011;2:25-35.
28. Johnson K.,Hays C.,Center H.,Daley C.Building capacity and sustainable prevention innovations: A sustainability planning model.Evaluation & Program Planning. 2004;27:135-149.
29. Logic Model Development Guide. 2004:.
30. Labin S.N.Fundamental issues in evaluation. Smith N.L.Brandon P.R., ed. New York, NY: The Guilford Press; 2008:89-110.
31. Leischow S.J.,Milstein B.Systems thinking and modeling for public health practice.American Journal of Public Health. 2006;96:403-405.
32. Leviton L.C.,Khan L.K.,Dawkins N.The systematic screening and assessment method: Finding innovations worth evaluating.New Directions for Evaluation. 2010;125:.
33. Marquart J.M. New Directions for Program Evaluation, no. 47. Bickman L., ed. San Francisco, CA: Jossey-Bass; 1990:93-107.
34. McDavid J.C.,Hawthorn L.R. L.Program evaluation & performance measurement. CA, Sage: Thousand Oaks; 2006:.
35. McLaughlin J.A.,Jordan G.B.Logic models: A tool for telling your program's performance story.Evaluation and Program Planning. 1999;22:65-72.
36. McLeroy K.R.,Bibeau D.,Steckler A.,Glanz K.An ecological perspective on health promotion programs.Health Education Quarterly. 1988;154:351-377.
37. Proceedings from the 4th Annual NIH conference on the Science of Dissemination and Implementation: Policy and Practice, March 21-22, 2011. 2011:.
38. Newcomer K.E.,Hatry H.P.,Wholey J. SHandbook of practical program evaluation. Wholey J.S.Hatry H.P.Newcomer K.E., ed. San Francisco, CA: Jossey-Bass; 1994:.
39. Olsen L. A,Aisner D.,McGinnis J. MThe learning healthcare system: workshop summary of IOM roundtable on evidence-based medicine. Washington, DC: The National Academies Press; 2007:.
40. Orwin R.G.Evaluation for the 21st century. Chelimsky E.Shadish W., ed. Thousand Oaks, CA: Sage; 1997:443-465.
41. Patel V.,Weiss H.A.,Chowdhary N.,Naik S.,Pednekar S.,Chatterjee S.,Kirkwood B.R.Effectiveness of an intervention led by lay health counsellors for depressive and anxiety disorders in primary care in Goa, India (MANAS): A cluster randomised controlled trial.Lancet. 2010;376:2086-2095.
42. Patton M.Q.Utilization-focused evaluation. 1997). Utilization-focused evaluation (3rd ed). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 1997:.
43. Pluye P.,Potvin L.,Denis J.L.Making public health programs last: conceptualizing sustainability.Evaluation & Program Planning. 2004;27:121-133.
44. Reichardt C.S.Evaluating methods for estimating program effects.American Journal of Evaluation. 2011;32:246-272.
45. Rogers E.M.Diffusion of innovations. New York, NY: The Free Press; 1995:.
46. Scheirer M.A.Program implementation: The organizational context. Beverly Hills, CA: Sage; 1981:.
47. Scheirer M. ANew Directions for Program Evaluation, No. 33. Bickman L., ed. San Francisco, CA: Jossey-Bass; 1987:.
48. Scheirer M.A.Handbook of practical program evaluation. Wholey J.S.Hatry H.P.Newcomer K.E., ed. San Francisco, CA: Jossey-Bass; 1994:40-68.
49. Scheirer M.A.Is sustainability possible? A review and commentary on empirical studies of program sustainability.American Journal of Evaluation. 2005;26:320-347.
50. Scheirer M. AWhat does "evidence-based practice" mean? A framework for evaluation. Presentation at the Annual Meeting of the Eastern Evaluation Research Society Absecom, NJ; 2008:.
51. Scheirer M.A.,Dearing J.An agenda for research on the sustainability of public health programs.American Journal of Public Health. 2011;101:2059-2067.
52. Scheirer M.A.,Roberts-Gray C New Directions for Program Evaluation, 40. Conrad K.J.Roberts-Gray C., ed. San Francisco, CA: Jossey-Bass; 1988:63-82.
53. Scriven M.Evaluation thesaurus. 1991). Evaluation thesaurus (4th ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 1991:.
54. Shadish W.R.,Cook T.D.,Campbell D.T.Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin; 2002:.
55. Sonnichsen R.C.High impact internal evaluation. Thousand Oaks, CA: Sage; 2000:.
56. Trochim W.M. K.Pattern matching, validity, and conceptualization in program evaluation.Evaluation Review. 1985;9:575-604.
57. Trochim W.M. KEvidence and evaluation. 2009:.
58. Victoria C.G.,Black R.E.,Boerma J.T.,Byce J.Measuring impact in the millennium development goal era and beyond: A new approach to large-scale effectiveness evaluations.Lancet. 2011;377:85-95.
59. Whitmore ENew Directions for Evaluation, No. 80. San Francisco, CA: Jossey-Bass; 1998:.
60. Wholey J.S.Evaluation and effective public management. Boston, MA: Little, Brown; 1983:.
61. Wholey J.S.New Directions for Program Evaluation, no. 33. Bickman L., ed. San Francisco, CA: Jossey-Bass; 1987:77-92.
62. Wholey J. SEvaluation for the 21st century. Chelimsky E.Shadish W., ed. Thousand Oaks, CA: Sage; 1997:.
63. Williams B.,Imam I.Systems concepts in evaluation: An expert anthology. Point Reyes, CA: Edge Press of Inverness; 2007:.
64. Alkin M.Evaluation roots: Tracing theorists' views and influences. Alkin M., ed. Thousand Oaks, CA: Sage; 2004:3-11.
65. Chen H.T.Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA: Sage; 2005:.
66. Mark M.M.,Greene J.,Shaw I.The SAGE handbook of evaluation. Shaw I.F.Greene J.Mark M.M., ed. London, England: Sage; 2006:1-30.
67. Mark M.M.,Henry G.T.,Julnes G.Evaluation: An integrated framework for understanding, guiding, and improving policies and programs. San Francisco, CA: Jossey-Bass; 2000:.
68. Patton M.Q.Utilization-focused evaluation. 2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2008:.
69. Scheirer M.A.Expanding evaluative thinking: Evaluation through the program life cycle. American Journal of Evaluation, (this issue). 2012;:.
70. Chelimsky E.Evaluation for the 21st century. Chelimsky E.Shadish W., ed. Thousand Oaks, CA: Sage; 1997:.
71. Dunet DFocusing an evaluation through identifying its purpose. (2011, May):.
72. MacDonald G.,Chapel TProgram evaluation meets the real world: 10 Years of the CDC evaluation framework. 2009, June:.
73. Patton M.Q.Utilization-focused evaluation. 1978). Utilization-focused evaluation (1st ed). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 1978:.
74. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA:; 2005:.
75. Framework for program evaluation in public health. Atlanta, GA: MMWR; 1999:1-40.
76. Knickman J.R.,Hunt K. AThe Robert Wood Johnson Foundation anthology: To improve health and health care. Isaacs S.L.Colby D.C., ed. 2008:199-220.