Low effect sizes of evidence-based programs in school settings

Journal of Evidence-Based Social Work

Volumn 8, Issue 4, 2011, Pages 397-415

  Powers, Joelle D ^a   Bowen, Natasha K ^a   Webber, Kristina C ^a   Bowen, Gary L ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Effect size; Effectiveness; Evidence based practice; Programs; Schools

Indexed keywords

HEALTH CARE QUALITY; HUMAN; ORGANIZATION AND MANAGEMENT; REVIEW; SCHOOL; SOCIAL WORK;

HUMANS; PROGRAM EVALUATION; SCHOOLS; SOCIAL WORK;

EID: 79961212954     PISSN: 15433714     EISSN: 15433722     Source Type: Journal    
DOI: 10.1080/15433714.2011.534316     Document Type: Review

References (83)

1. Allen-Meares, P., & Fraser, M. W. (2004). Intervention with children & adolescents: An interdisciplinary perspective. Boston, MA: Pearson Education, Inc.
2. Barrett, P. M., & Ollendick, T. H. (2004). Handbook of interventions that work with children and adolescents: Prevention and treatment. West Sussex, England: John Wiley & Sons.
3. Battistich, V., Schaps, E., Watson, M., Solomon, D., & Lewis, C. (2000). Effects of the child development project on students' drug use and other problem behaviors. The Journal of Primary Prevention, 21, 75-99.
4. Bohman, T. M., Barker, E. D., Bell, M. L., Lewis, C. M., Holleran, L., & Pomeroy, E. (2004). Early intervention for alcohol use prevention and vehicle safety skills: Evaluating the Protecting You/Protecting Me curriculum. Journal of Child & Adolescent Substance Abuse, 14, 17-39.
5. Bosworth, K., Espelage, D., DuBay, T., & Daytner, G. (2000). Preliminary evaluation of a multimedia violence prevention program for adolescents. American Journal of Health Behavior, 24, 268-281.
6. Botvin, G. J., Griffin, K. W., Diaz, T., & Ifill-Williams, M. (2001). Drug abuse prevention among minority adolescents: Posttest and one-year follow-up of a school-based preventive intervention. Prevention Science, 2, 1-13.
7. Caplan, M., Weissberg, R. P., Grober, J. S., Sivo, P. J., Grady, K., & Jacoby, C. (1992). Social competence promotion with inner-city and suburban young adolescents: Effects on social adjustment and alcohol use. Journal of Consulting and Clinical Psychology, 60, 56-63.
8. Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, D. (2002). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. Prevention & Treatment, 5, Article 15.
9. Center for Substance Abuse Prevention (CSAP). (2000). Model and promising programs, CSAP SAMHSA National Registry of Effective Programs [website]. Retrieved from http://about.preventiondss.org
10. Center for the Study and Prevention of Violence. (2004). Blueprints model programs [website]. Retrieved from http://www.colorado.edu/cspv/blueprints/model programs. html
11. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
12. Connell, D. B., Turner, R. R., & Mason, E. F. (1985). Summary of findings of the school health education evaluation: Health promotion effectiveness, implementation, and costs. Journal of School Health, 55, 316-321.
13. Cooper, H. (1998). Synthesizing research. Thousand Oaks, CA: Sage.
14. Cowen, E. L., Orgel, A. R., Gesten, E. L., & Wilson, A. B. (1979). The evaluation of an intervention program for young schoolchildren with acting-out problems. Journal of Abnormal Clinical Psychology, 7, 381-396.
15. Dent, C. W., & Sussman, S. (1995). Two-year behavior outcomes of Project Towards No Tobacco Use. Journal of Consulting & Clinical Psychology, 63, 676-678.
16. Dunst, C. J., Hamby, D. W., & Trivette, C. M. (2004). Guidelines for calculating effect sizes for practice-based research syntheses. Centerscope, 3, 1-10.
17. Dupper, D. D. (2002). School social work: Skills and interventions for effective practice. New York, NY: John Wiley & Sons.
18. Eggert, L. L., Thompson, E. A., Herting, J. R., & Nicholas, L. J. (1995). Reducing suicide potential among high-risk youth: Tests of a school-based prevention program. Suicide and Life Threatening Behavior, 25, 276-296.
19. Eisen, M., Zellman, G. L., Massett, H. A., & Murray, D. M. (2002). Evaluating the Lions-Quest "Skills for Adolescence" drug education program: First-year behavior outcomes. Addictive Behaviors, 27, 619-632.
20. Eisen, M., Zellman, G. L., & Murray, D. M. (2002). Evaluating the Lions-Quest "Skills for Adolescence" drug education program: Second-year behavior outcomes. Addictive Behaviors, 28, 883-897.
21. Ellickson, P. L., McCaffrey, D. F., Ghosh-Dastidar, B., & Longshore, D. L. (2003). New inroads in preventing adolescent drug use: Results from a large scale trial of Project ALERT in middle schools. Adolescent Health, 93, 1830-1836.
22. Farrell, A. D., Meyer, A. L., & White, K. S. (2001). Evaluation of responding in peaceful and positive ways (RIPP): A school-based prevention program for reducing violence among urban adolescents. Journal of Clinical Child Psychology, 30, 451-463.
23. Flay, B. R., Allred, C. G., & Ordway, N. (2001). Effects of the positive action program on achievement and discipline: Two matched comparisons. Prevention Science, 2, 71-89.
24. Foshee, V. A., Bauman, K. E., Arriaga, X. B., Helms, R. W., Koch, G. G., & Linder, G. F. (1998). An evaluation of Safe Dates, an adolescent dating violence prevention program. American Journal of Public Health, 88, 45-50.
25. Foshee, V. A., Bauman, K. E., Ennett, S. T., Linder, G. F., Benefield, T., & Suchindran, C. (2004). Assessing the long-term effects of the Safe Dates program and a booster in preventing and reducing adolescent dating violence victimization and perpetration. American Journal of Public Health, 94, 619-624.
26. Foshee, V. A., Bauman, K. E., Greene, W. F., Koch, G. G., Linder, G. F., & Mac-Dougall, J. E. (2000). The Safe Dates program: 1-year follow-up results. American Journal of Public Health, 90, 1619-1622.
27. Franklin, C., & Hopson, L. M. (2007). Facilitating the use of evidence-based practice in community organizations. Journal of Social Work Education, 43, 377-404.
28. Franklin, C., & Kelly, M. S. (2009). Becoming evidence-informed in the real world of school social work practice. Children & Schools, 31, 46-56.
29. Franklin, C., Kim, J. S. & Tripodi, S. J. (2009). A meta-analysis of published school social work practice studies 1980-2007. Research on Social Work Practice, 19, 667-677.
30. Gambrill, E. (2001). Social work: An authority-based profession. Research on Social Work Practice, 11, 166-175.
31. Gambrill, E. (2006). Evidence-based practice and policy: Choices ahead. Research on Social Work Practice, 16, 338-357.
32. Ghosh-Dastidar, B., Longshore, D. L., Ellickson, P. L., & McCaffrey, D. F. (2004). Modifying pro-drug risk factors in adolescents: Results from Project ALERT. Health Education & Behavior, 31, 318-334.
33. Gibbs, L. E. (2003). Evidence-based practice for the helping professions. Canada: Thompson Brooks/Cole.
34. Giles, S. M., Harrington, N. G., & Fearnow-Kenney, M. (2001). Evaluation of the All Stars program: Student and teacher factors that influence mediators of substance use. Journal of Drug Education, 31, 385-398.
35. Goldberg, L., MacKinnon, D. P., Elliot, D. L., Moe, E. L., Clarke, G., & Cheong, J. (2000). The adolescents training and learning to avoid steroids program. Archives of Pediatric & Adolescent Medicine, 154, 332-338.
36. Golly, A. M., Stiller, B., & Walker, H. M. (1998). First steps to success: Replication and social validation of an early intervention program. Journal of Emotional & Behavioral Disorders, 6, 243-251.
37. Gorman-Smith, D. (2003). Effect of teacher training and consultation on teacher behavior toward students at high risk for aggression. Behavior Therapy, 34, 437-452.
38. Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (2001). The prevention of mental disorders in school-age children: Current state of the field. Prevention & Treatment, 4, Article 1.
39. Greenberg, M. T., Kusche, C. A., Cook, E. T., & Quamma, J. P. (1995). Promoting emotional competence in school-age children: The effects of the PATHS curriculum. Development and Psychopathology, 7, 117-136.
40. Hair, E. C., Jager, J., & Garrett, S. (2001). Background for community-level work on social competency in adolescence: Reviewing the literature on contributing factors. Retrieved from Child Trends website: http://www.childtrends.org/files/ KSocial.pdf
41. Hecht, M. L., Marsiglia, F. F., Elek, E., Wagstaff, D. A., Kulis, S., Dustman, P., et al. (2003). Culturally grounded substance use prevention: An evaluation of the Keepin' It REAL curriculum. Prevention Science, 4, 233-248.
42. Hoagwood, K. E., Olin, S. S., Kerker, B. D., Kratochwill, T. R., Crowe, M., & Saka, N. (2007). Empirically based school interventions targeted at academic and mental health functioning. Journal of Emotional and Behavioral Disorders, 15, 66-92.
43. Huesmann, L. R., Maxwell, C. D., & Eron, L. (1996). Evaluating a cognitive/ecological program for the prevention of aggression among urban children. American Journal of Preventive Medicine, 12, 120-128.
44. Ialongo, J., Poduska, J., Werthamer, L., & Kellam, S. (2001). The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders, 9, 146-160.
45. Johnson, D. W., & Johnson, R. T. (2004). Implementing the "Teaching Students to be Peacemakers" program. Theory Into Practice, 43, 68-79.
46. Kam, C., Greenberg, M. T., & Kusche, C. A. (2004). Sustained effects of the PATHS curriculum on the social and psychological adjustment of children in special education. Journal of Emotional and Behavioral Disorders, 12, 66-78.
47. Kellam, S. G., & Anthony, J. C. (1998). Targeting early antecedents to prevent tobacco smoking: Findings from an epidemiologically based randomized field trial. American Journal of Public Health, 88, 1490-1496.
48. Kirby, D., & Barth, R. (1991). Reducing the risk: Impact of a new curriculum on sexual risk-taking. Family Planning Perspectives, 23, 253-264.
49. Lagges, A. M., & Gordon, D. A. (1999). Use of an interactive laserdisc parent training program with teenage parents. Child & Family Behavior Therapy, 21, 19-37.
50. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
51. Lochman, J. E. (1992). Cognitive-behavioral intervention with aggressive boys: Three year follow-up and preventive effects. Journal of Consulting and Clinical Psychology, 60, 426-432.
52. Lynch, K. B., Geller, S. R., & Schmidt, M. G. (2004). Multi-year evaluation of the effectiveness of resilience-based prevention program for young children. The Journal of Primary Prevention, 24, 335-353.
53. McDonald, L., Trahan, M., & Beckman, R. (2002). FAST-Families and Schools Together experimental studies overview. Retrieved from http://www.wcer.wisc. edu/fast/research/research2.html.
54. McNeil, R. B., Hansen, W. B., Harrington, N. G., & Giles, S. M. (2004). How All Stars works: An examination of program effects on mediating variables. Health Education & Behavior, 31, 165-178.
55. National Institute of Drug Abuse (NIDA). (2003). Preventing drug use among children and adolescents: A research-based guide for parents, educators, and community leaders (2nd ed.). (NIH Publication No. 04-4212A). Bethesda, MD: U.S. Department of Health and Human Services.
56. Office of Juvenile Justice & Delinquency Prevention. (1999). Strengthening America's families: Effective family programs for prevention of delinquency [website]. Retrieved from http://www.strengtheningfamilies.org
57. Office of the Surgeon General. (2001). Youth violence: A report of the Surgeon General. Retrieved from U.S. Department of Health and Human Services website: http://www.surgeongeneral.gov/library/youthviolence/youvioreport.html
58. Olweus, D. (1991). Bully/victim problems among schoolchildren: Basic facts and effects of a school based intervention program. In D. Pepler & K. Rubin (Eds), The development and treatment of childhood aggression. Hillsdale, NJ: Erlbaum.
59. Olweus, D. (1994). Bullying at school: Basic facts and effects of a school based intervention program [Annotation]. Journal of Child Psychology & Psychiatry, 7, 1171-1190.
60. Olweus, D., Limber, S., & Mihalic, S. F. (1998). Book nine: Bullying prevention program. Boulder, CO: Center for the Study and Prevention of Violence.
61. Orpinas, P., Parcel, G. S., McAlister, A., Frankowski, R. (1995). Violence prevention in middle schools: A pilot evaluation. Journal of Adolescent Health, 17, 360-371.
62. Pedro-Carroll, J., & Cowen, E. L. (1985). The Children of Divorce Intervention Program: An investigation of the efficacy of a school-based prevention program. Journal of Consulting and Clinical Psychology, 53, 603-611.
63. Perry, C. L., Williams, C. L., Komro, K. A., Veblen-Mortenson, S., Stigler, M. H., Munson, K. A., Forster, J. L. (2002). Project Northland: Long-term outcomes of community action to reduce alcohol use. Health Education Research, 17, 117-132.
64. Powers, J. D., Bowen, N. K., & Bowen, G. L. (2010). Evidence-based programs in school settings: Barriers and recent advances. Journal of Evidence-Based Social Work, 7, 313-331.
65. Powers, J. D., Bowen, N. K., & Bowen, G. L. (2011). Supporting evidence-based practice in schools with an online database of best practices. Children & Schools, 33, 119-138.
66. Rogers, A. M., & Taylor, A. S. (1997). Intergenerational mentoring: A viable strategy for meeting the needs of vulnerable youth. Journal of Gerontological Social Work, 28, 125-140.
67. Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 231-244). New York, NY: Russell Sage Foundation.
68. Sackett, D. L., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (1997). Evidencebased medicine: How to practice & teach EBM. New York, NY: Churchill Livingstone.
69. Shure, M. B., & Spivack, G. (1982). Interpersonal problem-solving in young children: A cognitive approach to prevention. American Journal of Community Psychology, 10, 341-356.
70. Slavin, R. E., & Madden, N. A. (2000). Research on achievement outcomes of Success for All: A summary and response to critics. Phi Delta Kappan, 82, 38-40, 59-66.
71. Solomon, D., Battistich, V., Watson, M., Schaps, E., & Lewis, C. (2000). A sixdistrict study of educational change: Direct and mediated effects of the child development project. Social Psychology of Education, 4, 2-51.
72. Spoth, R. L., Redmond, C., & Shin, C. (2000). Reducing adolescents' aggressive and hostile behaviors. Archives of Pediatric and Adolescent Medicine, 154, 1248-1257.
73. Substance Abuse and Mental Health Services Administration [SAMHSA]. (2004). Model programs [website]. Retrieved from http://modelprograms.samhsa.gov
74. Sussman, S., Sun, P., McCuller, W. J., & Dent, C. W. (2003). Project Towards No Drug Abuse: Two-year outcomes of a trial that compares health educator delivery to self-instruction. Preventive Medicine, 37, 155-162.
75. Suter, D. P., & Kehle, T. J. (1988). Evaluation of the Primary Mental Health Project model of early identification and prevention of school adjustment problems. Special Services in the Schools, 4, 89-107.
76. Taggart, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990). A process evaluation of the District of Columbia Know Your Body Project. Journal of School Health, 60, 60-66.
77. U.S. Department of Education (2001). Safe, disciplined, and drug free schools exemplary programs [website]. Retrieved from http://www.ed.gov/offices/OERI/ ORAD/KAD/expert_panel/2001exemplary_sddfs.html
78. Van Schoiack-Edstrom, L., Frey, K. S., & Beland, K. (2002). Changing adolescents' attitudes about relational and physical aggression: An early evaluation of a school-based intervention. School Psychology Review, 31, 201-216.
79. Walter, H. J., Hofman, A., Connelly, P. A., Barrett, L. T., & Kost, K. L. (1985). Primary prevention of chronic disease in childhood: Changes in risk factors after one year of intervention. American Journal of Epidemiology, 122, 772-781.
80. Watson, M., Battistich, V., & Solomon, D. (1997). Enhancing students' social and ethical development in schools: An intervention program and its effects. International Journal of Educational Research, 27, 571-586.
81. Webster-Stratton, C., Reid, M. J., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in Head Start. Journal of Clinical Psychology, 30, 283-302.
82. Werch, C. E., Owen, D. M., Carlson, J. M., DiClemente, C. C., Edgemon, P., & Moore, M. (2003). One-year follow-up results of the STARS for Families alcohol prevention program. Health Education Research, 18, 74-87.
83. Young, M., Kersten, C., & Werch, C. (1996). Evaluation of a parent child drug education program. Journal of Drug Education, 25, 57-68.