Multimethod strategy for assessing program fidelity: The national evaluation of the revised G.R.E.A.T. Program

Evaluation Review

Volumn 35, Issue 1, 2011, Pages 14-39

  Esbensen, Finn Aage ^a   Matsuda, Kristy N ^a   Taylor, Terrance J ^a   Peterson, Dana ^b  

^a UNIVERSITY OF MISSOURI ST LOUIS   (United States)

^b STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

fidelity; prevention; process evaluation; program evaluation

Indexed keywords

ARTICLE; CONSUMER; CURRICULUM; EVIDENCE BASED PRACTICE; HEALTH CARE QUALITY; HUMAN; INFORMATION PROCESSING; LAW ENFORCEMENT; LEGAL ASPECT; METHODOLOGY; PROGRAM DEVELOPMENT; SCHOOL; UNITED STATES; VIOLENCE;

CONSUMER PARTICIPATION; CURRICULUM; DATA COLLECTION; EVIDENCE-BASED PRACTICE; HUMANS; LAW ENFORCEMENT; PROGRAM DEVELOPMENT; PROGRAM EVALUATION; SCHOOLS; UNITED STATES; VIOLENCE;

EID: 79952953310     PISSN: 0193841X     EISSN: 15523926     Source Type: Journal    
DOI: 10.1177/0193841X10388126     Document Type: Article

References (56)

1. Basch, C.E., E.M. Sliepcevich, R.S. Gold, D.F. Duncan, and L.J. Kolbe. 1985. 'Avoiding Type III Errors in Health Education Program Evaluations: A Case Study.' Health Education and Behavior 12:315-31.
2. Dane, A.V., and B.H. Schneider. 1998. "Program Integrity in Primary and Early Secondary Prevention: Are Implementation Effects out of Control?' Clinical Psychology Review 18:23-4.
3. Dobson, D., and T.J. Cook. 1980. "Avoiding Type III Error in Program Evaluation: Results From a Field Experiment." Evaluation and Program Planning 3:269-76.
4. Dumas, J.E., A.M. Lynch, J.E. Laughlin, E.P. Smith, and R.J. Prinz. 2001. 'Promoting Intervention Fidelity: Conceptual Issues, Methods, and Preliminary Results From the Early Alliance Prevention Program.' American Journal of Preventive Medicine 20:38-47.
5. Durlak, J.A., and E.P. DuPre. 2008. "Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation." American Journal of Community Psychology 41:327-50.
6. Dusenbury, L., R. Brannigan, M. Falco, and W.B. Hansen. 2003. "A Review of Research on Fidelity of Implementation: Implications for Drug Abuse Prevention in School Settings." Health Education Research 18:237-56.
7. Elliott, D.S., and S. Mihalic. 2004. "Issues in Disseminating and Replicating Effective Prevention Programs." Prevention Science 5:47-53.
8. Emshoff, J.G., C. Blakely, R. Gottschalk, J. Mayer, W.S. Davidson, and S. Erickson. 1987. 'Innovation in Education and Criminal Justice: Measuring Fidelity of Implementation and Program Effectiveness.' Educational Evaluation and Policy Analysis 9:300-11.
9. Esbensen, F.A., A. Freng, T.J. Taylor, D. Peterson, and D.W. Osgood. 2002. 'Putting Research Into Practice: The National Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) Program.' In Responding to Gangs: Evaluation and Research, edited by W. L. Reed and S. H. Decker, 139-67. Washington, DC: U.S. Department of Justice, National Institute of Justice.
10. Esbensen, F.A., and D.W. Osgood. 1999. "Gang Resistance Education and Training (G.R.E.A.T.): Results From the National Evaluation. " Journal of Research in Crime and Delinquency 36:194-225.
11. Esbensen, F.A., D.W. Osgood, T.J. Taylor, D. Peterson, and A. Freng. 2001. 'How Great is G.R.E.A.T.? Results From a Quasi-Experimental Design.' Criminology and Public Policy 1:87-118.
12. Esbensen, F.A., D. Peterson, T.J. Taylor, A. Freng, D.W. Osgood, D.C. Carson, and K.N. Matsuda. 2011. 'Evaluation and Evolution of the Gang Resistance Education and Training Program.' Journal of School Violence 10:53-70.
13. Fagan, A.A., K. Hanson, J.D. Hawkins, and M.W. Arthur. 2008. 'Bridging Science to Practice: Achieving Prevention Program Fidelity in the Community Youth Development Study.' American Journal of Community Psychology 41:235-49.
14. Fagan, A.A., and S. Mihalic. 2003. "Strategies for Enhancing the Adoption of School-Based Prevention Programs: Lessons Learned From the Blueprints for Violence Prevention Replications of the Life Skills Training Program." Journal of Community Psychology 31:235-54.
15. Gottfredson, D. 2001. Schools and Delinquency. New York, NY: Cambridge University Press.
16. Heller, K. 1996. "Coming of Age in Prevention Science: Comments on the 1994 National Institute of Mental Health-Institute of Medicine Prevention Reports." American Psychologist 51:1123-7.
17. Kovaleski, J.H., E.E. Gickling, H. Morrow, and P.R. Swank. 1999. "High Versus Low Implementation of Instructional Support Teams: A Case for Maintaining Program Fidelity. " Remedial and Special Education 20:170-83.
18. Lillehoj, C.J., K.W. Griffin, and R. Spoth. 2004. "Program Provider and Observer Ratings of School-Based Preventive Intervention Implementation: Agreement and Relation to Youth Outcomes." Health Education and Behavior 31:242-57.
19. Lipsey, M. 2009. 'The Primary Factors That Characterize Effective Interventions With Juvenile Offenders: A Meta-Analytic Overview.' Victims and Offenders 4:124-47.
20. McHugo, G.J., R.E. Drake, R. Whitley, G.R. Bond, K. Campbell, C.A. Rapp, H.H. Goldman, W.J. Lutz, and M.T. Finnerty. 2007. 'Fidelity Outcomes in the National Implementing Evidence-Based Practices Project.' Psychiatric Services 58:1279-84.
21. Melde, C., F.A. Esbensen, and K. Tusinski. 2006. "Addressing Program Fidelity Using Onsite Observations and Program Provider Descriptions of Program Delivery." Evaluation Review 30:714-30.
22. Mihalic, S.F., and K. Irwin. 2003. "Blueprints for Violence Prevention: From Research to Real-World Settings-Factors Influencing the Successful Replication of Model Programs." Youth Violence and Juvenile Justice 1:307-29.
23. Moncher, F.J., and R.J. Prinz. 1991. "Treatment Fidelity in Outcome Studies." Clinical Psychology Review 11:247-66.
24. Peterson, D., and F.A. Esbensen. 2004. 'The Outlook is G.R.E.A.T.: What Educators Say About School-Based Prevention and the Gang Resistance Education and Training (G.R.E.A.T.) Program.' Evaluation Review 28:218-45.
25. Rossi, P.H., H.E. Freeman, and M.W. Lipsey. 1999. Evaluation: A Systematic Approach." 6th ed. Thousand Oaks, CA: SAGE.
26. Taylor, T.J., F.A. Esbensen, and D. Peterson. 2009. National Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) Program: G.R.E.A.T. Officer Training (G.O.T.) Report. St. Louis, MO: University of Missouri-St. Louis.
27. Teague, G.B., G.R. Bond, and R.E. Drake. 1998. "Program Fidelity in Assertive Community Treatment: Development and Use of a Measure." American Journal of Orthopsychiatry 68:216-32.
28. Winfree, L.T., Jr., D. Peterson Lynskey, and J.R. Maupin. 1999. 'Developing Local Police and Federal Law Enforcement Partnerships: G.R.E.A.T. as a Case Study of Policy Implementation.' Criminal Justice Review 24:145-68.
29. Basch, C.E., E.M. Sliepcevich, R.S. Gold, D.F. Duncan, and L.J. Kolbe. 1985. 'Avoiding Type III Errors in Health Education Program Evaluations: A Case Study.' Health Education and Behavior 12:315-31.
30. Dane, A.V., and B.H. Schneider. 1998. "Program Integrity in Primary and Early Secondary Prevention: Are Implementation Effects out of Control?'Clinical Psychology Review 18:23-4.
31. Dobson, D., and T.J. Cook. 1980. "Avoiding Type III Error in Program Evaluation: Results From a Field Experiment." Evaluation and Program Planning 3:269-76.
32. Dumas, J.E., A.M. Lynch, J.E. Laughlin, E.P. Smith, and R.J. Prinz. 2001. 'Promoting Intervention Fidelity: Conceptual Issues, Methods, and Preliminary Results From the Early Alliance Prevention Program.' American Journal of Preventive Medicine 20:38-47.
33. Durlak, J.A., and E.P. DuPre. 2008. "Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation." American Journal of Community Psychology 41:327-50.
34. Dusenbury, L., R. Brannigan, M. Falco, and W.B. Hansen. 2003. "A Review of Research on Fidelity of Implementation: Implications for Drug Abuse Prevention in School Settings." Health Education Research 18:237-56.
35. Elliott, D.S., and S. Mihalic. 2004. "Issues in Disseminating and Replicating Effective Prevention Programs." Prevention Science 5:47-53.
36. Emshoff, J.G., C. Blakely, R. Gottschalk, J. Mayer, W.S. Davidson, and S. Erickson. 1987. 'Innovation in Education and Criminal Justice: Measuring Fidelity of Implementation and Program Effectiveness.' Educational Evaluation and Policy Analysis 9:300-11.
37. Esbensen, F.A., A. Freng, T.J. Taylor, D. Peterson, and D.W. Osgood. 2002. 'Putting Research Into Practice: The National Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) Program.' In Responding to Gangs: Evaluation and Research, edited by W. L. Reed and S. H. Decker, 139-67. Washington, DC: U.S. Department of Justice, National Institute of Justice.
38. Esbensen, F.A., and D.W. Osgood. 1999. "Gang Resistance Education and Training (G.R.E.A.T.): Results From the National Evaluation. " Journal of Research in Crime and Delinquency 36:194-225.
39. Esbensen, F.A., D.W. Osgood, T.J. Taylor, D. Peterson, and A. Freng. 2001. 'How Great is G.R.E.A.T.? Results From a Quasi-Experimental Design.' Criminology and Public Policy 1:87-118.
40. Esbensen, F.A., D. Peterson, T.J. Taylor, A. Freng, D.W. Osgood, D.C. Carson, and K.N. Matsuda. 2011. 'Evaluation and Evolution of the Gang Resistance Education and Training Program.' Journal of School Violence 10:53-70.
41. Fagan, A.A., K. Hanson, J.D. Hawkins, and M.W. Arthur. 2008. 'Bridging Science to Practice: Achieving Prevention Program Fidelity in the Community Youth Development Study.' American Journal of Community Psychology 41:235-49.
42. Fagan, A.A., and S. Mihalic. 2003. "Strategies for Enhancing the Adoption of School-Based Prevention Programs: Lessons Learned From the Blueprints for Violence Prevention Replications of the Life Skills Training Program." Journal of Community Psychology 31:235-54.
43. Gottfredson, D. 2001. Schools and Delinquency. New York, NY: Cambridge University Press.
44. Heller, K. 1996. "Coming of Age in Prevention Science: Comments on the 1994 National Institute of Mental Health-Institute of Medicine Prevention Reports." American Psychologist 51:1123-7.
45. Kovaleski, J.H., E.E. Gickling, H. Morrow, and P.R. Swank. 1999. "High Versus Low Implementation of Instructional Support Teams: A Case for Maintaining Program Fidelity. " Remedial and Special Education 20:170-83.
46. Lillehoj, C.J., K.W. Griffin, and R. Spoth. 2004. "Program Provider and Observer Ratings of School-Based Preventive Intervention Implementation: Agreement and Relation to Youth Outcomes." Health Education and Behavior 31:242-57.
47. Lipsey, M. 2009. 'The Primary Factors That Characterize Effective Interventions With Juvenile Offenders: A Meta-Analytic Overview.' Victims and Offenders 4:124-47.
48. McHugo, G.J., R.E. Drake, R. Whitley, G.R. Bond, K. Campbell, C.A. Rapp, H.H. Goldman, W.J. Lutz, and M.T. Finnerty. 2007. 'Fidelity Outcomes in the National Implementing Evidence-Based Practices Project.' Psychiatric Services 58:1279-84.
49. Melde, C., F.A. Esbensen, and K. Tusinski. 2006. "Addressing Program Fidelity Using Onsite Observations and Program Provider Descriptions of Program Delivery." Evaluation Review 30:714-30.
50. Mihalic, S.F., and K. Irwin. 2003. "Blueprints for Violence Prevention: From Research to Real-World Settings-Factors Influencing the Successful Replication of Model Programs." Youth Violence and Juvenile Justice 1:307-29.
51. Moncher, F.J., and R.J. Prinz. 1991. "Treatment Fidelity in Outcome Studies." Clinical Psychology Review 11:247-66.
52. Peterson, D., and F.A. Esbensen. 2004. 'The Outlook is G.R.E.A.T.: What Educators Say About School-Based Prevention and the Gang Resistance Education and Training (G.R.E.A.T.) Program.' Evaluation Review 28:218-45.
53. Rossi, P.H., H.E. Freeman, and M.W. Lipsey. 1999. Evaluation: A Systematic Approach." 6th ed. Thousand Oaks, CA: SAGE.
54. Taylor, T.J., F.A. Esbensen, and D. Peterson. 2009. National Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) Program: G.R.E.A.T. Officer Training (G.O.T.) Report. St. Louis, MO: University of Missouri-St. Louis.
55. Teague, G.B., G.R. Bond, and R.E. Drake. 1998. "Program Fidelity in Assertive Community Treatment: Development and Use of a Measure." American Journal of Orthopsychiatry 68:216-32.
56. Winfree, L.T., Jr., D. Peterson Lynskey, and J.R. Maupin. 1999. 'Developing Local Police and Federal Law Enforcement Partnerships: G.R.E.A.T. as a Case Study of Policy Implementation.' Criminal Justice Review 24:145-68.