Evaluability assessment to improve public health policies, programs, and practices

Annual Review of Public Health

Volumn 31, Issue , 2010, Pages 213-233

  Leviton, Laura C ^a   Khan, Laura Kettel ^b   Rog, Debra ^c   Dawkins, Nicola ^d   Cotton, David ^d  

^a ROBERT WOOD JOHNSON FOUNDATION   (United States)

^b NATIONAL CENTER FOR CHRONIC DISEASE PREVENTION AND HEALTH PROMOTION   (United States)

^c WESTAT   (United States)

^d ICF INTERNATIONAL   (United States)

Author keywords

Exploratory evaluation; Logic model; Performance measurement; Public health programs; Stakeholders; Theory of change

Indexed keywords

CLINICAL PRACTICE; COST EFFECTIVENESS ANALYSIS; EVIDENCE BASED MEDICINE; HEALTH CARE DELIVERY; HEALTH CARE PLANNING; HEALTH CARE POLICY; HEALTH CARE SYSTEM; HEALTH PROGRAM; HUMAN; MEDICAL RESEARCH; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; PUBLIC HEALTH; REVIEW; SCREENING;

COST-BENEFIT ANALYSIS; HUMANS; MODELS, THEORETICAL; PROGRAM EVALUATION; PUBLIC HEALTH PRACTICE; PUBLIC POLICY;

EID: 77952689463     PISSN: 01637525     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.publhealth.012809.103625     Document Type: Review

References (50)

1. Carman JG, Fredericks KA. 2008. Nonprofits and evaluation: empirical evidence from the field. In Nonprofits and Evaluation, ed. JG Carman, KA Fredericks. New Dir. Eval. 2008(119):51-72
2. Framework for Program Evaluation in Public Health. MMWR 48 (No. RR-11):1-40
3. Cent. Dis. Control Prev. 2009. The Guide to Community Preventive Services. http://www. thecommunityguide. org/index. html
4. Collins CB, Sloop K, Napp D. 2004. A strategy to enhance evaluation capacity for HIV prevention providers. Presented at Int. Conf. AIDS, 15th, Bangkok, Thailand (Abstr. No. TuPeE5493)
5. Comm. Rev. NIOSH Res. Progr. 2009. Evaluating Occupational Health and Safety Programs: Framework and Next Steps. Washington, DC: Natl. Acad. Press
6. Cronbach LJ, with ShapiroK. 1982. Designing Evaluations of Educational and Social Programs. San Francisco: Jossey-Bass
7. Glasgow RE, Green LW, Klesges LW, Abrams DB, Fisher EB, et al. 2006. External validity: We need to do more. Ann. Behav. Med. 31:105-108
8. Glasgow RE, Linnan LA. 2008. Evaluation of theory-based interventions. In Health Behavior and Health Education: Theory, Research and Practice, ed. K Glanz, BK Rimer, K Viswanath, pp. 487-508. San Francisco: Jossey-Bass
9. Green LW, Kreuter M. 2004. Health Program Planning: An Educational and Ecological Approach. New York: McGraw-Hill
10. Hersey J, Williams-Peihota P, Sparling PB, Alexander J, Hill MD, et al. 2008. Promising practices in promotion of healthy weight at small and medium-sized US worksites. Prev. Chron. Dis. 5(4).
11. http://www. cdc. gov/PCD/issues/2008/oct/pdf/070172. pdf
12. Inst. Med. 1988. The Future of Public Health. Washington, DC: Natl. Acad.
13. Justice Res. Stat. Assoc. 2004. Approaches to assessing juvenile justice program performance. http://www. jrsainfo. org/pubs/juv-justice/approaches assessing. pdf
14. Koplan JP, Liverman CT, Kraak VA. 2005. Preventing Childhood Obesity: Health in the Balance. Washington, DC: Natl. Acad.
15. Leviton LC. 2001. Building evaluation's collective capacity: American Evaluation Association Presidential address. Am. J. Eval. 22:1-12
16. Leviton LC. 2001. External validity. In The International Encyclopedia of the Social and Behavioral Sciences, ed. NJ Smelser, PB Baltes, 8:5195-5200 Oxford: Elsevier
17. Leviton LC, Bass M. 2004. Using evaluation to advance a foundation's mission. In Foundations and Evaluation: Contexts and Practices for Effective Philanthropy, ed. M Braverman, N Constantine, JK Slater, pp. 3-26. San Francisco: Jossey-Bass
18. Leviton LC, Collins C, Laird B, Kratt P. 1998. Teaching evaluation using evaluability assessment. Evaluation 4:389-409
19. Leviton LC, Kettel Khan L, Dawkins N. 2010. The Systematic Screening and Assessment Method: Identifying Practices Worth Evaluating. New Dir. Eval. 2010(125)
20. Lipsey MW. 1988. Practice and malpractice in evaluation research. Eval. Pract. 9:5-25
21. Lipsey MW. 1993. Theory as method: small theories of treatments. In Understanding Causes and Generalizing About Them, ed. LB Sechrest, AG Scott. New Dir. Progr. Eval. 1993(57):1-82
22. McLaughlin JA, Jordan GB. 2004. Using logic models. See Ref. 49, pp. 7-32
23. Miller RL, Bedney BJ, Guenther-Grey C. 2003. Assessing organizational capacity to deliver HIV prevention services collaboratively: tales from the field. Health Educ. Behav. 30:582-600
24. Moran G. 2005. Assessing the effectiveness of discharge planning to prevent homelessness: an evaluability assessment. Presented at Joint Meet. Can. Eval. Soc. Am. Eval. Assoc., Toronto
25. Morell JA. 2005. Why are there unintended consequences of program action, and what are the implications for doing evaluation? Am. J. Eval. 26:444-463
26. Mulkern V. 2005. Evaluability assessment of the Community Mental Health Block Grant Program. Presented at Joint Meet. Can. Eval. Soc. Am. Eval. Assoc., Toronto
27. Natl. Assoc. County City Health Off. 1991. The Assessment Protocol for Excellence in Public Health (APEXPH). Washington, DC: Natl. Assoc. County City Health Off.
28. Natl. Prev. Inf. Netw. 2009. HIV Prevention Program Evaluation\Materials Database. http://www. cdcnpin. org/scripts/dhap/list. asp
29. Nay JN, Kay P. 1982. Government Oversight and Evaluability Assessment. Lexington, MA: Lexington
30. Assessing Program Performance. Http://www. Whitehouse. Gov/omb/part/
31. Off. Manag. Budget. 2009. Government Performance Results Act of 1993. http://www. whitehouse. gov/omb/mgmt-gpra gplaw2m/
32. OMG Cent. Collab. Learn. 2007. Brief Assessments of Community-Based Childhood Obesity Prevention Within the Injury Free Coalition for Kids Initiative Sites: Final report. Philadelphia: OMG Cent. Collab. Learn.
33. Poister TH. 2004. Performance monitoring. See Ref. 49, pp. 98-125
34. Preskill H, Jones N. 2009. A Practical Guide for Engaging Stakeholders in Developing Evaluation Questions. Boston: FSG Social Impact Advisors. http://www. fsg-impact. org/advice/Strategic Evaluation/index. htm
35. Reichert CS. 1994. Summative evaluation, formative evaluation, and tactical research. Eval. Pract. 15:275-281
36. Rhodes S. 2007. Experiences with Exploratory Evaluation: A Summary of Lessons Learned. Winston-Salem: Wake Forest Univ. Health Sci.
37. Rog DJ. 1985. A methodological analysis of evaluability assessment. PhD thesis. Vanderbilt Univ. 166 pp.
38. Rog DJ. 2005. Evaluability assessment: then and now. Presented at Joint Meet. Can. Eval. Soc. Am. Eval. Assoc., Toronto
39. Rog DJ, Gutman M. 2007. Brief Assessments of Environmental and Policy Interventions on Healthy Eating: Lessons Emerging about the Methodology. Princeton, NJ: Gutman
40. Rutman L. 1980. Planning Useful Evaluations: Evaluability Assessment. London: Sage
41. Shadish WR, Cook TD, Leviton LC. 1991. Foundations of Program Evaluation: Theorists and Their Theories. Newbury Park, CA: Sage
42. Smith MF. 1989. Evaluability Assessment: A Practical Approach. Boston: Kluwer Acad.
43. Trevisan MS. 2007. Evaluability assessment from 1986 to 2006. Am. J. Eval. 28:209-303
44. Trochim W, Milstein B, Wood B, Jackson S, Pressler V. 2004. Setting objectives for community and systems change: an application of concept mapping for planning a statewide health improvement initiative. Health Promot. Pract. 5:8-19
45. Tufte ER. 1997. The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press. 2nd ed.
46. Tufte ER. 1997. Visual and Statistical Thinking: Displays of Evidence for Decision Making. Cheshire, CT: Graphics Press
47. Wholey JS. 1979. Evaluation: Promise and Performance. Washington, DC: Urban Inst.
48. Wholey JS. 2004. Assessing the feasibility and likely usefulness of evaluation. See Ref. 49, pp. 33-62
49. Wholey JS, Hatry HP, Newcomer KE, eds. 2004. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass. 2nd ed.
50. Wilson DB, Lipsey MW. 2001. The role of method in treatment effectiveness research: evidence from meta-analysis. Psychol. Methods 6:413-429