Updating the FORECAST formative evaluation approach and some implications for ameliorating theory failure, implementation failure, and evaluation failure

Evaluation and Program Planning

Volumn 39, Issue , 2013, Pages 42-50

  Katz, Jason ^a   Wandersman, Abraham ^a   Goodman, Robert M ^b   Griffin, Sarah ^c   Wilson, Dawn K ^a   Schillaci, Michael ^a  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b INDIANA UNIVERSITY   (United States)

^c CLEMSON UNIVERSITY   (United States)

Author keywords

Formative evaluation; Implementation science; Logic model

Indexed keywords

ASSESSMENT METHOD; NUMERICAL MODEL; PLANNING SYSTEM;

ARTICLE; HEALTH CARE PLANNING; HUMAN; METHODOLOGY; NONBIOLOGICAL MODEL; ORGANIZATION AND MANAGEMENT; PROGRAM EVALUATION; TREATMENT OUTCOME; UNITED STATES;

HEALTH PLAN IMPLEMENTATION; HUMANS; MODELS, ORGANIZATIONAL; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PROGRAM EVALUATION; UNITED STATES;

EID: 84877102150     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.evalprogplan.2013.03.001     Document Type: Article

References (34)

1. Anderson, A. (2005). An introduction to theory of change. Evaluation Exchange, Summer, Volume XI, 2. http://www.hfrp.org/evaluation/the-evaluation-exchange/issue-archive/evaluation-methodology/an-introduction-to-theory-of-change.
2. Booth S.L., Mayer J., Sallis J.F., Ritenbaugh C., Hill J.O., Birch L., et al. Environmental and societal factors affect food choice and physical activity: Rationale, influences and leverage points. Nutrition Reviews 2001, 59:S21-S39.
3. Centers for Disease Control and Prevention. (n.d.). Logic model magic: Using logic models for DASH program planning and evaluation. Retrieved from: http://apps.nccd.cdc.gov/dashoet/logic_model.
4. Chelimsky E. The coming transformations in evaluation. Evaluation for the 21st Century 1997, 1-26.
5. Chen H.T., Garbe P. Assessing program outcomes from the bottom-up approach: An innovative perspective to outcome evaluation. New Directions for Evaluation 2011, 130:93-106.
6. Cochrane T., Davey R.C. Increasing uptake of physical activity: A social ecological approach. Perspectives in Public Health 2008, 128(1):31-40.
7. Coie J., Watt N., West S., Haskins D., Asarnow J., Markman H., et al. The science of prevention: A conceptual framework and some directions for a national research program. American Psychologist 1993, 48:1013-1022.
8. Coulon S.M., Wilson D.K., Griffin S., St George S.M., Trumpeter N.N., Wandersman A., et al. Formative process evaluation for implementing a social marketing intervention to increase walking in African Americans in the PATH trial. American Journal of Public Health 2012, 102(12):2315-2321.
9. Durlak J.A., DuPre E.P. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology 2008, 41:689-708.
10. Fixsen D.L. Implementation research: A synthesis of the literature. National Implementation Research Network 2005.
11. Glasgow R.E., Emmons K.M. How can we increase translation of research into practice? Types of evidence needed. Annual Review of Public Health 2007, 28:413-433.
12. Goodman R.M., Noonan R.K. Empowerment evaluation for violence prevention. Health Promotion Practice 2009, 10(1):11S-18S.
13. Goodman R.M., Wandersman A. FORECAST: A formative approach to evaluating community coalitions and community-based initiatives. Journal of Community Psychology 1994, (CSAP Special Issue):6-25.
14. Kuh G.D., Kinzie J., Schuh J.H., Whitt E.J. Never let it rest lessons about student success from high-performing colleges and universities. Change: The Magazine of Higher Learning 2005, 37(4):44-51.
15. Kumanyika S.K., Whitt-Glover M.C., Gary T.L., Prewitt T.E., Odoms-Young A.M., Banks-Wallace J., et al. Expanding the obesity research paradigm to reach African American communities. Preventing Chronic Disease 2007, 4(4):A112.
16. McMillan D., Chavis D. Sense of community: A definition and theory. Journal of Community Psychology 1986, 14:6-23.
17. Merzel C., D'Afflitti J. Reconsidering community-based health promotion: Promise, performance, and potential. American Journal of Public Health 2003, 93:557-574.
18. Meyers D.C., Durlak J., Wandersman A. What are important components of quality implementation? A synthesis of implementation frameworks. American Journal of Community Psychology 2012, 50(3-4):481-496.
19. Rossi P.H., Lipsey M.W., Freeman H.E. Evaluation: A systematic approach 2004, Sage, Thousand Oaks, CA. 7th ed.
20. Scheirer M.A., Mark M.M., Brooks A., Grob G.F., Chapel T.J., Geisz M., et al. Planning Evaluation Through the Program Life Cycle. American Journal of Evaluation 2012, 33(2):263-294.
21. Scriven M. The methodology of evaluation. AERA monograph series on curriculum evaluation, No. 1 1967, 39-83. Rand McNally, Skokie, IL. R. Tyler, R. Gagne, M. Scriven (Eds.).
22. Scriven M. Beyond formative and summative evaluation. Program evaluation 1991, 16. Prentice Hall, New Jersey. M.E. Gredler (Ed.).
23. Shapiro J. Evaluation as theory testing: An example from Head Start. Educational Evaluation and Policy Analysis 1982, 4:341-353.
24. Stetler C.B., Legro M.W., Wallace C.M., Bowman C., Guihan M., Hagedorn H., et al. The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine 2006, 21:S1-S8.
25. Stewart-Brown S. What is the evidence on school health promotion in improving health or preventing disease and, specifically, what is the effectiveness of the health promoting schools approach? 2006, World Health Organization, Copenhagen.
26. Taylor-Powell, E., Steele, S., & Douglah, M. (1996). Planning a program evaluation. Program development and evaluation, Series G3658-1. University of Wisconsin-Extension.
27. Tinto V. Leaving college: Rethinking the causes and cures of student attrition 1993, University of Chicago Press, Chicago. 2nd ed.
28. Townsend B.K., Wilson K.B. A hand hold for a little bit: Factors facilitating the success of community college transfer students to a large university. Journal of College Student Development 2006, 9(4):439-456.
29. Wandersman A. Four keys to success (theory, implementation, evaluation, and system/resource support): High hopes and challenges in participation. American Journal of Community Psychology 2009, 43(1-2):3-21.
30. Wandersman A., Duffy J., Flaspohler P., Noonan R., Lubell K., Stillman L., et al. Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American journal of community psychology 2008, 41(3-4):171-181.
31. Weick K.E. Small wins: Redefining the scale of social problems. American Psychologist 1984, 39(1):40-49.
32. Wilson D.K., Ellerbe C., Lawson A.B., Alia K.A., Meyers D.C., Coulon S.M., et al. Imputational Modeling of Spatial Context and Social Environmental Predictors of Walking in an Underserved Community: The PATH Trial. Spatial and Spatio-temporal Epidemiology 2012.
33. Wilson D.K., Trumpeter N., St George S.M., Griffin S., Van Horn M.L., Wandersman A., et al. Positive Action for Today's Health Trial (PATH): A randomized controlled trial for promoting walking in underserved communities. Contemporary Clinical Trials 2010, 31:624-633.
34. W.K.Kellogg Foundation Logic model development guide: Using logic models to bring together planning, evaluation, & action 2001, W.K. Kellogg Foundation, Battle Creek, MI.