Evidence-Based Interventions Are Necessary but Not Sufficient for Achieving Outcomes in Each Setting in a Complex World: Empowerment Evaluation, Getting To Outcomes, and Demonstrating Accountability

American Journal of Evaluation

Volumn 37, Issue 4, 2016, Pages 544-561

  Wandersman, Abraham ^a   Alia, Kassandra ^a   Cook, Brittany S ^a   Hsu, Lewis L ^b   Ramaswamy, Rohit ^c  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

accountability; empowerment evaluation; evidence based intervention; systems

Indexed keywords

EID: 84994462393     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214016660613     Document Type: Article

References (55)

1. Acosta J., Chinman M., Ebener P., Malone P. S., Paddock S., Phillips A., …Slaughter M. E., (2013). An intervention to improve program implementation: findings from a two-year cluster randomized trial of assets-getting to outcomes. Implementation Science, 8, 87.
2. Averling E., McCulloch P., Dixon-Woods M., (2013). A qualitative study comparing experiences of the surgical safety checklist in hospitals in high-income and low-income countries. BMJ Open, 3, e003039.
3. Balasubramanian B. A., Cohen D. J., Davis M. M., Gunn R., Dickinson L. M., Miller W. L., …Stange K. C., (2015). Learning evaluation: Blending quality improvement and implementation research methods to study healthcare innovations. Implementation Science: IS, 10, 31. doi:http://doi.org.libproxy.lib.unc.edu/10.1186/s13012-015-0219-z
4. ® in clinical practice: Innovation configuration map (Version B). Columbia, SC: Department of Psychology, University of South Carolina.
5. Centers of Disease Control and Prevention. (2015). Sickle Cell Disease (SCD). Retrieved from http://www.cdc.gov/ncbddd/sicklecell/data.html
6. Chin M. H., Goldmann D., (2011). Meaningful disparities reduction through research and translation programs. Journal of the American Medical Association, 305, 404–405.
7. Chinman M., Acosta J., Ebener P., Burkhart Q., Malone P. S., Paddock S. M., …Tellett-Royce N., (2013). Intervening with practitioners to improve the quality of prevention: One-year findings from a randomized trial of assets-getting to outcomes. The Journal of Primary Prevention, 34, 173–191.
8. Chinman M., Acosta J., Ebener P., Malone P. S., Slaughter M., (2015). A novel test of the GTO implementation support intervention in low resource settings: Year 1 findings and challenges. Implementation Science, 10, A34.
9. Chinman M., Acosta J., Ebener P., Malone P. S., Slaughter M., (2015, 12). Testing the getting to outcomes implementation support intervention in prevention-oriented, community-based settings. Paper presented at the 8th Annual Conference on the Science of Dissemination and Implementation, Washington, DC.
10. ®: Guide for teen pregnancy prevention (RAND, TL-199-NIDA). Santa Monica, CA: RAND Corporation. Retrieved from www.rand.org/t/TL199
11. Chinman M., Hunter S. B., Ebener P., Paddock S. M., Stillman L., Imm P., Wandersman A., (2008). The getting to outcomes demonstration and evaluation: An illustration of the prevention support system. American Journal of Community Psychology, 41, 206–224.
12. Chinman M., Imm P., Wandersman A., (2004). Getting To Outcomes™ promoting accountability through methods and tools for planning, implementation, and evaluation. Santa Monica, CA: RAND Corporation. Retrieved from http://www.rand.org/pubs/technical_reports/TR101.html
13. ®. American Journal of Orthopsychiatry, 79, 469.
14. Farb A., Margolis A., Gosling B., (2015, 11). Roundtable: Findings and Implications from the HHS Teen Pregnancy Prevention Program. Roundtable presented at the Association for Public Policy Analysis and Management in Washington, DC.
15. Fetterman D., (2001). Foundations of empowerment evaluation. Thousand Oaks, CA: Sage.
16. Fetterman D. M., Kaftarian S., Wandersman A., (2015). Empowerment evaluation: Knowledge and tools for self-assessment, evaluation capacity building and accountability (2nd ed.). Thousand Oaks, CA: Sage.
17. Fetterman D. M., Wandersman A., (Eds.). (2005). Empowerment evaluation principles in practice. New York, NY: Guilford Press.
18. Fisher D., Imm P., Chinman M., Wandersman A., (2006). Getting To Outcomes™ with developmental assets: Ten steps to measuring success in youth programs and communities. Minneapolis, MN: Search Institute.
19. Friedman M., (1997). What is results-based accountability? Retrieved from http://resultsaccountability.com/about/what-is-results-based-accountability/
20. Green L. W., (2001). From research to “best practices” in other settings and populations. American Journal of Health Behavior, 25, 165–178.
21. Hawkins J. D., Oesterle S., Brown E. C., Monahan K. C., Abbott R. D., Arthur M. W., Catalano R. F., (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the communities that care prevention system in a randomized trial. Archives of Pediatrics & Adolescent Medicine, 166, 141–148.
22. Haynes A. B., Weiser T. G., Berry W. R., Lipsitz S. R., Breizat A. H., Dellinger E. P., … Safe Surgery Saves Lives Study Group. (2011). Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Quality & Safety, 20, 102–107.
23. Haynes A. B., Weiser T. G., Berry W. R., Lipsitz S. R., Breizat A.-H.S., Dellinger E. P., …Gawande A. A., (2009). A surgical safety checklist to reduce morbidity and mortality in a global population. New England Journal of Medicine, 360, 491–499.
24. Imm P., Chinman M., Wandersman A., Rosenbloom D., Guckenburg S., Leis R., (2007). Preventing underage drinking: Using getting to outcomes™ with the SAMHSA strategic prevention framework to achieve results. Santa Monica, CA: RAND Corporation.
25. Kanter J., Kruse-Jarres R., (2013). Management of sickle cell disease from childhood through adulthood. Blood Reviews, 27, 279–287.
26. Katz J., Wandersman A., Goodman R. M., Griffin S., Wilson D. K., Schillaci M., (2013). Updating the FORECAST formative evaluation approach and some implications for ameliorating theory failure, implementation failure, and evaluation failure. Evaluation and Program Planning, 39, 42–50.
27. ® in clinical practice: Lessons learned from an initiative to enhance accountability and training for mental health services. Symposium Presentation at the Society for Community Research and Action (SCRA) Biennial Conference in Lowell, MA.
28. Lesesne C. A., Lewis K., Fisher D., House L. D., Mueller T., Fuller T. R., … Wandersman A., (2016). Promoting science-based approaches to teen pregnancy prevention using getting to outcomes for teen pregnancy prevention (PSBA-GTO). Atlanta, GA: Centers for Disease Control and Prevention.
29. ® in systems of care: 10 steps for achieving results-based accountability. Atlanta, GA: ICF Macro.
30. Leviton L. C., Trujillo M. D., (2016). Interaction of theory and practice to assess external validity. Evaluation Review. Advance online publication. doi:10.1177/0193841X15625289
31. Livet M., Richter J., Ellison L., Dease B., McClure L., Feigley C., Richter D. L., (2005). Emergency preparedness academy adds public health to readiness equation. Journal of Public Health Management and Practice, 11, S4–S10.
32. Lobb R., Colditz G. A., (2013). Implementation science and its application to population health. Annual Review of Public Health, 34, 235.
33. ® for home visiting: How to plan, implement, and evaluate a program in your community to support parents and their young children. Santa Monica, CA: RAND Corporation.
34. Maras M. A., Wandersman A., Splett J. W., Flaspohler P., Weist M., (2015). Getting to outcomes: A best practice process to help schools achieve desired outcomes. NASP Communiqué, 41. Retrieved from http://www.nasponline.org/publications/periodicals/communique/issues/volume-41-issue-4/getting-to-outcomes-a-best-practice-process-to-help-schools-achieve-desired-outcomes
35. Mittman B. S., (2015, 12). Evaluating complex interventions: Mediators, moderators and mechanisms. Paper presented at the Evaluating Complex Public Health Interventions conference convened by Academy Health in Washington, DC.
36. Monahan K. C., Hawkins J. D., Abbott R. D., (2013). The application of meta-analysis within a matched-pair randomized control trial: An illustration testing the effects of communities that care on delinquent behavior. Prevention Science, 14, 1–12.
37. National Heart, Lung, & Blood Institute. (2014). Evidenced-based management of Sickle Cell Disease: Expert panel report. Retrieved from: https://www.nhlbi.nih.gov/health-pro/guidelines/sickle-cell-disease-guidelines
38. Oyeku S. O., Wang C. J., Scoville R., Vanderkruik R., Clermont E., McPherson M. E., …Homer C. J., (2012). Hemoglobinopathy learning collaborative: Using quality improvement (QI) to achieve equity in health care quality, coordination, and outcomes for sickle cell disease. Journal of Health Care for the Poor and Underserved, 23, 34–48.
39. Patient-Centered Outcomes Research Institute [PCORI]. (2016). Topic brief—Management of sickle cell disease. Retrieved from http://www.pcori.org/events/2016/prioritizing-comparative-effectiveness-research-questions-management-sickle-cell-disease
40. Patton M. Q., (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford Press.
41. Pincus H. A., England M. J., (2015). Improving the quality of psychosocial interventions for mental and substance use disorders. Journal of the American Medical Association, 314, 1227–1228.
42. Robling M., Bekkers M., Bell K., Butler C. C., Cannings-John R., Channon S., …Torgerson D., (2016). Effectiveness of a nurse-intensive home-visitation programme for first-time teenage mothers (Building Blocks): A pragmatic randomised controlled trial. The Lancet, 387, 146–155.
43. Rossi P. H., Lipsey M. W., Freeman H. E., (2004). Evaluation: A systematic approach. London, CA: Sage.
44. Smith W. R., Jordan L. B., Hassell K. L., (2011). Frequently asked questions by hospitalists managing pain in adults with sickle cell disease. Journal of Hospital Medicine, 6, 297–303.
45. Spoth R., Guyll M., Lillehoj C. J., Redmond C., Greenberg M., (2007). Prosper study of evidence-based intervention implementation quality by community–university partnerships. Journal of Community Psychology, 35, 981–999.
46. The Psychological Services Center. (2015). PSC clinical practice and procedures manual. Columbia, SC: Knies, K.
47. Trickett E. J., (2009). Multilevel community-based culturally situated interventions and community impact: An ecological perspective. American Journal of Community Psychology, 43, 257–266.
48. Tseng V., (2016, 3). Evidence at the crossroads pt. 11: The next generation of evidence-based policy. William T. Grant Foundation. Retrieved from http://wtgrantfoundation.org/evidence-crossroads-pt-11-next-generation-evidence-based-policy
49. Urbach D. R., Govindarajan A., Saskin R., Wilton A. S., Baxter N. N., (2014). Introduction of surgical safety checklists in Ontario, Canada. New England Journal of Medicine, 370, 1029–1038.
50. Wandersman A., Alia K., Cook B. S., Ramaswamy R., (2015). Empowerment evaluation, improvement science, and evidence-based interventions: Achieving outcomes in healthcare improvement. BMJ Quality and Safety, 24, 645–652.
51. Wandersman A., Chien V. H., Katz J., (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: Tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology, 50, 445–459.
52. Wandersman A., Imm P., Chinman M., Kaftarian S., (2000). Getting to outcomes: A results-based approach to accountability. Evaluation and Program Planning, 23, 389–395.
53. Wandersman A., Snell-Johns J., Lentz L., Fetterman D. M., Keener D. C., Livet M., …Flaspohler P., (2005). The principles of empowerment evaluation. In Fetterman D. M., Wandersman A., (Eds.), Empowerment evaluation principles in practice (pp. 27–41). New York, NY: Guilford.
54. Ware R. E., (2010). How I use hydroxyurea to treat young patients with sickle cell anemia. Blood, 115, 5300–5311.
55. World Health Alliance for Patient Safety. (2008). The second global patient safety challenge: Safe surgey saves lives. Wolrd Health Orgnaziation, 14–19. Retrieved from http://www.who.int/patientsafety/safesurgery/knowledge_base/SSSL_Brochure_finalJun08.pdf