Measuring Fidelity and Adaptation: Reliability of a Instrument for School-Based Prevention Programs

Evaluation and the Health Professions

Volumn 37, Issue 2, 2014, Pages 231-257

  Bishop, Dana C ^a   Pankratz, Melinda M ^b   Hansen, William B ^a   Albritton, Jordan ^a   Albritton, Lauren ^a   Strack, Joann ^a  

^a Tanglewood Research Inc   (United States)

^b PACIFIC INSTITUTE FOR RESEARCH AND EVALUATION   (United States)

Author keywords

adaptation; fidelity; fidelity measurement; observers; prevention; reliability

Indexed keywords

ADOLESCENT; HUMAN; INFORMATION PROCESSING; NONBIOLOGICAL MODEL; ORGANIZATION AND MANAGEMENT; PROCEDURES; PROGRAM EVALUATION; REPRODUCIBILITY; SCHOOL HEALTH SERVICE; STANDARDS; SUBSTANCE-RELATED DISORDERS;

ADOLESCENT; DATA COLLECTION; HUMANS; MODELS, ORGANIZATIONAL; PROGRAM EVALUATION; REPRODUCIBILITY OF RESULTS; SCHOOL HEALTH SERVICES; SUBSTANCE-RELATED DISORDERS;

EID: 84900514472     PISSN: 01632787     EISSN: 15523918     Source Type: Journal    
DOI: 10.1177/0163278713476882     Document Type: Article

References (46)

1. Abbott R. D.,O'Donnell J.,Hawkins J. D.,Hill K. G.,Kosterman R.,Catalano R. F.Changing teaching practices to promote achievement and bonding to school.American Journal of Orthopsychiatry. 1998;68:542-552.
2. Aber J. L.,Brown J. L.,Jones S. M.Developmental trajectories toward violence in middle childhood: Course, demographic differences, and response to school-based intervention.Developmental Psychology. 2003;39:324-348.
3. Basen-Engquist K.,O'Hara-Tompkins N.,Lovato C. Y.,Lewis M. J.,Parcel G. S.,Gingiss P.The effect of two types of teacher training on implementation of Smart Choices: A tobacco prevention curriculum.Journal of School Health. 1994;64:334-339.
4. Botvin G. J.,Baker E.,Dusenbury L.,Tortu S.,Botvin E. M.Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: Results of a 3-year study.Journal of Consulting and Clinical Psychology. 1990;58:437-446.
5. Botvin G. J.,Dusenbury L.,Baker E.,James-Ortiz S.,Kerner J.A skills training approach to smoking prevention among Hispanic youth.Journal of Behavioral Medicine. 1989;12:279-296.
6. Burke R. V.,Oats R. G.,Ringle J. L.,Fichtner L. O. N.,DelGaudio M. B.Implementation of a classroom management program with urban elementary schools in low-income neighborhoods: Does program fidelity affect student behavior and academic outcomes?.Journal of Education for Students Placed at Risk (JESPAR). 2011;16:201-218.
7. Dane A. V.,Schneider B. H.Program integrity in primary and early secondary prevention: Are implementation effects out of control?.Clinical Psychology Review. 1998;18:23-45.
8. Dariotis J. K.,Bumbarger B. K.,Duncan L. G.,Greenberg M. T.How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors.Journal of Community Psychology. 2008;36:744-760.
9. Dent C. W.,Sussman S.,Hennesy M.,Galaif E. R.,Stacy A. W.,Moss M. A.,Craig S.Implementation and process evaluation of a school-based drug abuse prevention program: Project towards no drug use.Journal of Drug Education. 1998;28:361-375.
10. Domitrovich C. E.,Greenberg M. T.The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children.Journal of Educational and Psychological Consultation. 2000;11:293-221.
11. Donaldson S. I.,Grant-Vallone E. J.Understanding self-report bias in organizational behavior research.Journal of Business and Psychology. 2002;17:245-262.
12. Durlak J.,DuPre E.Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation.American Journal of Community Psychology. 2008;41:327-350.
13. Dusenbury L.,Brannigan R.,Falco M.,Hansen W. B.A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings.Health Education Research. 2003;18:237-256.
14. Dusenbury L.,Brannigan R.,Hansen W. B.,Walsh J.,Falco M.Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions.Health Education Research. 2005;20:308-313.
15. Fagan A. A.,Hanson K.,Hawkins J. D.,Arthur M. W.Bridging science to practice: Achieving prevention program implementation fidelity in the community youth development study.American Journal of Community Psychology. 2008;41:235-249.
16. Giles S. M.,Harrington N. G.,Fearnow-Kenney M.Evaluation of the All Stars program: Student and teacher factors that influence mediators of substance use.Journal of Drug Education. 2002;31:385-397.
17. Giles S. M.,Jackson-Newsom J.,Pankratz M. M.,Ringwalt C. L.,Hansen W. B.,Dusenbury L.Measuring quality of delivery in a substance use prevention program.Journal of Primary Prevention. 2008;28:489-501.
18. Hanley S.,Ringwalt C.,Vincus A. A.,Ennett S. T.,Bowling J. M.,Haws S. W.,Rohrbach L. A.Implementing evidence-based substance use prevention curricula with fidelity: The role of teacher training.Journal of Drug Education. 2009;39:39-58.
19. Hansen W. B.Pilot test results comparing the All Stars program with seventh grade D.A.R.E.: Program integrity and mediating variable analysis.Substance Use & Misuse. 1996;31:1359-1377.
20. Hansen W. B.,Bishop D. C.,Dusenbury L.,Pankratz M.,Albritton L.,Albritton J.,Strack J.Feeding information learned from adaptations back into program design. 2011:.
21. Hansen W. B.,Graham J. W.,Wolkenstein B. H.,Rohrbach L. A.Program integrity as a moderator of prevention program effectiveness: Results for fifth grade students in the adolescent alcohol prevention trial.Journal of Studies on Alcohol. 1991;52:568-579.
22. Hansen W. B.,McNeal R. B.Drug education practice: Results of an observational study.Health Education Research. 1999;14:85-97.
23. Hansen W. B.,Pankratz M. M.,Dusenbury L.,Giles S. M.,Bishop D. C.,Albritton J.,Albritton L. P.,Strack J.Styles of adaptation: The impact of frequency and valence of adaptation on preventing substance use.Health Education. 2013;113:345-363.
24. Harachi T. W.,Abbott R. D.,Catalano R. F.,Haggerty K. P.,Fleming C. B.Opening the black box: Using process evaluation measures to assess implementation and theory building.American Journal of Community Psychology. 1999;27:715-735.
25. Harrington N. G.,Giles S. M.,Hoyle R. H.,Feeney G. J.,Yungbluth S. C.Evaluation of the All Stars character education and problem behavior prevention program: Pretest-post-test effects on mediator and outcome variables for middle school students.Health Education Research. 2001;28:533-546.
26. Hill L. G.,Maucione K.,Hood B. K.A focused approach to assessing program fidelity.Prevention Science. 2007;8:25-34.
27. Kalafat J.,Illback R. J.,Sanders D.The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs.Evaluation and Program Planning. 2007;30:136-148.
28. Kumpfer K. S.,Alvarado R.,Smith P.,Bellamy N.Cultural sensitivity and adaptation in family-based prevention interventions.Prevention Science. 2002;3:241-246.
29. McGraw S. A.,Sellers D. E.,Johnson C. C.,Stone E. J.,Bachman K. J.,Bebchuk J.,Luepker R. V.Using process data to explain outcomes: An illustration for the child and adolescent trial for cardiovascular health (CATCH).Evaluation Review. 1996;20:291-312.
30. Melde C.,Esbensen F.,Tusinski K.Addressing program fidelity using onsite observations and program provider descriptions of program delivery.Evaluation Review. 2006;30:714-740.
31. Ozer E.,Wanis M. G.,Bazell N.Diffusion of school-based prevention programs in two urban districts: Adaptations, rationales and suggestions for change.Prevention Science. 2011;11:42-55.
32. Pankratz M. M.,Jackson-Newsom J.,Giles S. M.,Ringwalt C. L.,Bliss K.,Bell M. L.Implementation fidelity in a teacher-led alcohol use prevention curriculum.Journal of Drug Education. 2006;36:317-333.
33. Pentz M. A.,Trebow E. A.,Hansen W. B.,MacKinnon D. P.,Dwyer J. H.,Johnson C. A.,Cormack C.Effects of program implementation on adolescent drug use behavior: The midwestern prevention project.Adolescent Drug Use Behavior. 1990;14:264-289.
34. Resnicow K.,Cross D.,Wynder E.The know your body program: A review of evaluation studies.Bulletin of the New York Academy of Medicine. 1993;70:188-207.
35. Ringwalt C.,Pankratz M.,Gottfredson N.,Jackson-Newsom J.,Dusenbury L.,Giles S.,Currey D.,Hansen B.The effects of students' curriculum engagement, attitudes towards their teachers, and perception of their teachers' skills on school-based prevention outcomes.Journal of Drug Education. 2009;39:223-237.
36. Ringwalt C. L.,Ennett S.,Vincus A.,Thorne J.,Rohrbach L. A.,Simons-Rudolph A.The prevalence of effective substance use prevention curricula in U.S. middle schools.Prevention Science. 2002;3:257-265.
37. Rohrbach L. A.,Dent C. W.,Skara S.,Sun P.,Sussman S.Fidelity of implementation in project Towards No Drug Abuse (TND): A comparison of classroom teachers and program specialists.Prevention Science. 2007;8:125-132.
38. Rohrbach L. A.,Graham J. W.,Hansen W. B.Diffusion of a school-based substance abuse prevention program: Predictors of program implementation.Preventive Medicine. 1993;22:237-260.
39. Schoenwald S. K.,Garland A. F.,Chapman J. E.,Frazier S. L.,Sheidow A. J.,Southam-Gerow M. A.Toward the effective and efficient measurement of implementation fidelity.Administration and Policy in Mental Health. 2011;38:32-43.
40. Sobol D. F.,Rohrbach L. A.,Dent C. W.,Gleason L.The integrity of smoking prevention curriculum delivery.Health Education Research. 1989;4:59-67.
41. Spoth R.,Guyll M.,Trudeau L.,Goldberg-Lillehoj C.Two studies of proximal outcomes and implementation quality of universal preventive interventions in a community-university collaboration context.Journal of Community Psychology. 2002;30:499-518.
42. Spoth R.,Redmond C.,Shin C.Direct and indirect latent-variable parenting outcomes of two universal family-focused preventive interventions: Extending a public health-oriented research base.Journal of Consulting and Clinical Psychology. 1998;66:385-399.
43. Stead M.,Stradling R.,MacNeil M.,MacKintosh A. M.,Minty S.Implementation evaluation of the Blueprint multi-component drug prevention programme: Fidelity of school component delivery.Drug and Alcohol Review. 2007;26:653-664.
44. Swanson E.,Wanzek J.,Haring C.,Cuillo S.,McCulley L.Intervention fidelity in special and general education research journals.The Journal of Special Education. 2011;20:1-11.
45. Tappe M. K.,Galer-Unti R. A.,Bailey K. C.Long-term implementation of the teenage health teaching modules by trained teachers: A case study.Journal of School Health. 1995;65:411-414.
46. Tobler N. S.,Stratton H.Effectiveness of school-based drug prevention programs: A meta-analysis of the research.Journal of Primary Prevention. 1997;18:71-128.