Altering school climate through school-wide positive behavioral interventions and supports: Findings from a group-randomized effectiveness trial

Prevention Science

Volumn 10, Issue 2, 2009, Pages 100-115

  Bradshaw, Catherine P ^a   Koth, Christine W ^a   Thornton, Leslie A ^a   Leaf, Philip J ^a  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

Climate; Fidelity; Organization; Positive behavioral interventions and support; School

Indexed keywords

ARTICLE; CHILD; CHILD BEHAVIOR; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HUMAN; LONGITUDINAL STUDY; MALE; QUESTIONNAIRE; RANDOMIZED CONTROLLED TRIAL; SCHOOL; SOCIAL SUPPORT; UNITED STATES;

CHILD; CHILD BEHAVIOR; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MARYLAND; QUESTIONNAIRES; SCHOOLS; SOCIAL SUPPORT;

EID: 67349096797     PISSN: 13894986     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11121-008-0114-9     Document Type: Article

References (56)

1. G. A. Aarons A. C. Sawitzy 2006 Organizational culture and climate and mental health provider attitudes toward evidence-based practice Psychological Services 3 61 72 Aarons, G. A., and Sawitzy, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3, 61-72. doi: 10.1037/1541-1559.3.1.61 .
2. S. Barrett C. P. Bradshaw T. Lewis-Palmer 2008 Maryland state-wide PBIS initiative: Systems, evaluation, and next steps Journal of Positive Behavior Interventions 10 105 114 Barrett, S., Bradshaw, C. P., and Lewis-Palmer, T. (2008). Maryland state-wide PBIS initiative: Systems, evaluation, and next steps. Journal of Positive Behavior Interventions, 10, 105-114. doi: 10.1177/1098300707312541 .
3. V. Battistich E. Schaps E. Watson D. Solomon 1996 Prevention effects of the Child Development Project: Early findings from an ongoing multisite demonstration trial Journal of Adolescent Research 11 12 35 Battistich, V., Schaps, E., Watson, E., and Solomon, D. (1996). Prevention effects of the Child Development Project: Early findings from an ongoing multisite demonstration trial. Journal of Adolescent Research, 11, 12-35. doi: 10.1177/0743554896111003 .
4. K. B. Bevans C. P. Bradshaw R. Miech P. J. Leaf 2007 Staff- and school-level predictors of school organizational health: A multilevel analysis The Journal of School Health 77 294 302 Bevans, K. B., Bradshaw, C. P., Miech, R., and Leaf, P. J. (2007). Staff- and school-level predictors of school organizational health: A multilevel analysis. The Journal of School Health, 77, 294-302. doi: 10.1111/j.1746-1561.2007.00210.x .
5. Bradshaw, C. P., Koth, C. W., Bevans, K. B., Ialongo, N., and Leaf, P. J. (2008a). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly. in press.
6. Bradshaw, C. P., Mitchell, M. M., and Leaf, P. J. (2008b). Examining the effects of school-wide Positive Behavioral Interventions and Supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions. in press.
7. C. P. Bradshaw W. M. Reinke L. D. Brown K. B. Bevans P. J. Leaf 2008 Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial Education and Treatment of Children 31 1 26 Bradshaw, C. P., Reinke, W. M., Brown, L. D., Bevans, K. B., and Leaf, P. J. (2008). Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education and Treatment of Children, 31, 1-26. doi: 10.1353/etc.0.0025 .
8. A. V. Dane B. H. Schneider 1998 Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review 18 23 45 Dane, A. V., and Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23-45. doi: 10.1016/S0272- 7358(97)00043-3 .
9. Domitrovich, C. E., Bradshaw, C. P., Poduska, J., Hoagwood, K., Buckley, J., Olin, S., et al. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion: Training and Practice. Research Policy, 1, 6-28.
10. J. A. Durlak E. P. Dupree 2008 Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation American Journal of Community Psychology 41 327 350 Durlak, J. A., and Dupree, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327-350. doi: 10.1007/s10464-008-9165-0 .
11. L. Dusenbury R. Brannigan M. Falco W. B. Hansen 2003 A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings Health Education Research 18 237 256 Dusenbury, L., Brannigan, R., Falco, M., and Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237-256. doi: 10.1093/her/18.2.237 .
12. Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., and Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network (FMHI #231).
13. C. Glisson 2002 The organizational context of children's mental health services Clinical Child and Family Psychology Review 5 233 252 Glisson, C. (2002). The organizational context of children's mental health services. Clinical Child and Family Psychology Review, 5, 233-252. doi: 10.1023/A:1020972906177 .
14. C. Glisson A. Hemmelgarn 1998 The effects of organization climate and interorganizational coordination on the quality and outcomes of children's service systems Child Abuse and Neglect 22 401 421 Glisson, C., and Hemmelgarn, A. (1998). The effects of organization climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse and Neglect, 22, 401-421. doi: 10.1016/S0145-2134(98)00005-2 .
15. D. C. Gottfredson 1986 An empirical test of school-based environmental and individual interventions to reduce the risk of delinquent behavior Criminology 24 705 731 Gottfredson, D. C. (1986). An empirical test of school-based environmental and individual interventions to reduce the risk of delinquent behavior. Criminology, 24, 705-731. doi: 10.1111/j.1745-9125.1986. tb01508.x .
16. D. C. Gottfredson 1987 An evaluation of an organization development approach to reducing school disorder Evaluation Review 11 739 763 Gottfredson, D. C. (1987). An evaluation of an organization development approach to reducing school disorder. Evaluation Review, 11, 739-763. doi: 10.1177/0193841X8701100603 .
17. Gottfredson, D. C., and Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39, 3-35.
18. Gottfredson, D. C., Gottfredson, G. D., and Hybl, L. G. (1993). Managing adolescent behavior: A multiyear, multischool study. American Educational Research Journal, 30, 179-215.
19. G. D. Gottfredson D. C. Gottfredson A. A. Payne N. C. Gottfredson 2005 School climate predictors of school disorder: Results from a national study of delinquency prevention in schools Journal of Research in Crime and Delinquency 42 412 444 Gottfredson, G. D., Gottfredson, D. C., Payne, A. A., and Gottfredson, N. C. (2005). School climate predictors of school disorder: Results from a national study of delinquency prevention in schools. Journal of Research in Crime and Delinquency, 42, 412-444. doi: 10.1177/0022427804271931 .
20. G. D. Gottfredson E. M. Jones T. W. Gore 2002 Implementation and evaluation of a cognitive-behavioral intervention to prevent problem behavior in a disorganized school Prevention Science 3 27 38 Gottfredson, G. D., Jones, E. M., and Gore, T. W. (2002). Implementation and evaluation of a cognitive-behavioral intervention to prevent problem behavior in a disorganized school. Prevention Science, 3, 27-38. doi: 10.1023/A:1014671310038 .
21. L. V. Hedges 2007 Effect sizes in cluster-randomized designs Journal of Educational and Behavioral Statistics 32 341 370 Hedges, L. V. (2007). Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32, 341-370. doi: 10.3102/1076998606298043 .
22. A. L. Hemmelgarn G. Glisson L. R. James 2006 Organizational culture and climate: Implications for services and interventions research Clinical Psychology: Science and Practice 13 73 89 Hemmelgarn, A. L., Glisson, G., and James, L. R. (2006). Organizational culture and climate: Implications for services and interventions research. Clinical Psychology: Science and Practice, 13, 73-89. doi: 10.1111/j.1468-2850.2006.00008.x .
23. L. G. Hill K. Maucione B. K. Hood 2007 A focused approach to assessing program fidelity Prevention Science 8 25 34 Hill, L. G., Maucione, K., and Hood, B. K. (2007). A focused approach to assessing program fidelity. Prevention Science, 8, 25-34. doi: 10.1007/s11121-006-0051-4 .
24. A. A. Hohmann M. K. Shear 2002 Community-based intervention research: Coping with the "noise" of real life in study design The American Journal of Psychiatry 159 201 207 Hohmann, A. A., and Shear, M. K. (2002). Community-based intervention research: Coping with the "noise" of real life in study design. The American Journal of Psychiatry, 159, 201-207. doi: 10.1176/appi.ajp.159.2.201 .
25. Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., et al. (2008). Randomized, wait-list controlled effectiveness trial assessing school-wide Positive Behavior Support in elementary schools. Journal of Positive Behavior Interventions. in press.
26. Horner, R. H., Sugai, G., Todd, A. W., and Lewis-Palmer, T. (2005). School-wide positive behavior support. In L. Bambara and L. Kern (Eds.), Individualized supports for students with problem behaviors: Designing positive behavior plans (pp. 359-390). New York: Guilford.
27. R. Horner A. Todd T. Lewis-Palmer L. K. Irvin G. Sugai J. Boland 2004 The School-wide Evaluation Tool (SET): A research instrument for assessing school-wide positive behavior supports Journal of Positive Behavior Interventions 6 3 12 Horner, R., Todd, A., Lewis-Palmer, T., Irvin, L. K., Sugai, G., and Boland, J. (2004). The School-wide Evaluation Tool (SET): A research instrument for assessing school-wide positive behavior supports. Journal of Positive Behavior Interventions, 6, 3-12. doi: 10.1177/ 10983007040060010201 .
28. Hoy, W., and Feldman, J. (1987). Organizational health: The concept and its measure. Journal of Research and Development in Education, 20, 30-38.
29. Hoy, W. K., and Miskel, C. G. (1996). Education administration: Theory, research, and practice (5th ed.). New York: McGraw-Hill.
30. Hoy, W. K., and Tarter, C. J. (1997). The road to open and healthy schools: A handbook for change, Elementary Edition. Thousand Oaks, CA: Corwin.
31. Hoy, W. K., Tarter, C. J., and Kottkamp, R. B. (1991). Open schools/healthy schools: Measuring organizational climate. Beverly Hills, CA: Sage.
32. B. Jo 2002 Statistical power in randomized intervention studies with noncompliance Psychological Methods 7 178 193 Jo, B. (2002). Statistical power in randomized intervention studies with noncompliance. Psychological Methods, 7, 178-193. doi: 10.1037/1082-989X.7.2.178 .
33. K. J. Klein S. W. J. Kozlowski 2000 From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods 3 211 236 Klein, K. J., and Kozlowski, S. W. J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3, 211-236. doi: 10.1177/109442810033001 .
34. H. M. Knoff 2000 Organizational development and strategic planning for the millennium: A blueprint toward effective school discipline, school safety, and crisis prevention Psychology in the Schools 37 17 32 Knoff, H. M. (2000). Organizational development and strategic planning for the millennium: A blueprint toward effective school discipline, school safety, and crisis prevention. Psychology in the Schools, 37, 17-32 doi: 10.1002/(SICI)1520- 6807(200001)37:1<17::AID-PITS3>3.0.CO;2-K .
35. C. W. Koth C. P. Bradshaw P. J. Leaf 2008 Examining the relationship between classroom-level factors and students' perception of school climate Journal of Educational Psychology 100 96 104 Koth, C. W., Bradshaw, C. P., and Leaf, P. J. (2008). Examining the relationship between classroom-level factors and students' perception of school climate. Journal of Educational Psychology, 100, 96-104. doi: 10.1037/0022-0663.100.1.96 .
36. Lewis, T. J., and Sugai, G. (1999). Effective behavior support: A systems approach to proactive school-wide management. Focus on Exceptional Children, 31, 1-24.
37. O. R. Lindsley 1992 Why aren't effective teaching tools widely adopted? Journal of Applied Behavior Analysis 25 21 26 Lindsley, O. R. (1992). Why aren't effective teaching tools widely adopted? Journal of Applied Behavior Analysis, 25, 21-26. doi: 10.1901/jaba.1992.25-21 .
38. Lochman, J. E. (2003). Commentary: School contextual influences on the dissemination of interventions. School Psychology Review, 32, 174-177.
39. Luke, D. (2004). Multilevel modeling. Thousand Oaks, CA: Sage.
40. Mrazek, P. J., and Haggerty, R. J. (Eds.). (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington DC: Institute of Medicine National Academy Press.
41. Mowbray, C. T., Holter, M. C., Teague, G. B., and Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. The American Journal of Evaluation, 24, 315-340.
42. Muthén, B. O., and Muthén, L. K. (2000). The development of heavy drinking and alcohol-related problems from ages 18 to 37 in a U.S. national sample. Journal of Studies on Alcohol, 61, 290-300.
43. Muthén, L. K., and Muthén, B. O. (1998). Mplus User's Guide (5th ed.). Los Angeles, CA: Author.
44. Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford Press.
45. Olweus, D., Limber, S. P., Flerx, V. C., Mullin, N., Riese, J., and Snyder, M. (2007). Olweus Bullying Prevention Program: Schoolwide guide. Center City, MN: Hazelden.
46. A. A. Payne D. C. Gottfredson G. D. Gottfredson 2006 School predictors of the intensity of implementation of school-based prevention programs Prevention Science 7 225 237 Payne, A. A., Gottfredson, D. C., and Gottfredson, G. D. (2006). School predictors of the intensity of implementation of school-based prevention programs. Prevention Science, 7, 225-237. doi: 10.1007/s11121-006- 0029-2 .
47. Raudenbush, S. W., and Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
48. M. S. Rosenberg L. A. Jackman 2003 Development, implementation and sustainability of comprehensive school-wide behavior management systems Intervention in School and Clinic 39 10 21 Rosenberg, M. S., and Jackman, L. A. (2003). Development, implementation and sustainability of comprehensive school-wide behavior management systems. Intervention in School and Clinic, 39, 10-21. doi: 10.1177/10534512030390010201 .
49. S. K. Schoenwald K. Hoagwood 2001 Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services (Washington, D.C.) 52 1190 1197 Schoenwald, S. K., and Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services (Washington, D.C.), 52, 1190-1197. doi: 10.1176/appi.ps.52.9.1190 .
50. Sprague, J. (2008 May). Positive Behavior Support implementation in Norway. Paper presented at the Society for Prevention Research, San Francisco, CA.
51. Stuart, E., and Leaf, P. (2007 May). Moving from efficacy to effectiveness in school-based prevention research: Case study of PBIS. Poster presented at the Society for Prevention Research, Washington, DC.
52. Sugai, G. (2008 July). Update on PBIS. Paper presented at the U.S. Department of Education, Office of Special Education Programs (OSEP) Director's Meeting, Washington DC.
53. Sugai, G., and Horner, R. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review, 35, 245-259.
54. Sugai, G., Lewis-Palmer, T., Todd, A., and Horner, R. H. (2001). School-Wide Evaluation Tool. Eugene, OR: University of Oregon.
55. G. Sugai J. R. Sprague R. H. Horner H. M. Walker 2000 Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions Journal of Emotional and Behavioral Disorders 8 94 101 Sugai, G., Sprague, J. R., Horner, R. H., and Walker, H. M. (2000). Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions. Journal of Emotional and Behavioral Disorders, 8, 94-101. doi: 10.1177/106342660000800205s .
56. S. Taylor-Greene D. Brown L. Nelson J. Longton T. Gassman J. Cohen 1997 School-wide behavioral support: Starting the year off right Journal of Behavioral Education 7 99 112 Taylor-Greene, S., Brown, D., Nelson, L., Longton, J., Gassman, T., Cohen, J., et al. (1997). School-wide behavioral support: Starting the year off right. Journal of Behavioral Education, 7, 99-112. doi: 10.1023/A:1022849722465 .