A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools

Implementation Science

Volumn 11, Issue 1, 2016, Pages

  Locke, Jill ^a   Beidas, Rinad S ^b   Marcus, Steven ^b   Stahmer, Aubyn ^c   Aarons, Gregory A ^d   Lyon, Aaron R ^e   Cannuscio, Carolyn ^b   Barg, Frances ^b   Dorsey, Shannon ^a   Mandell, David S ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

Author keywords

Attitudes; Autism; Fidelity; Implementation; Organizational factors; Schools

Indexed keywords

AUTISM; CHILD; EVIDENCE BASED MEDICINE; FEMALE; HUMAN; MALE; METHODOLOGY; ORGANIZATION AND MANAGEMENT; PRESCHOOL CHILD; PROCEDURES; SCHOOL; SCHOOL HEALTH SERVICE; STUDENT;

AUTISM SPECTRUM DISORDER; CHILD; CHILD, PRESCHOOL; EVIDENCE-BASED MEDICINE; FEMALE; HUMANS; MALE; RESEARCH DESIGN; SCHOOL HEALTH SERVICES; SCHOOLS; STUDENTS;

EID: 84990874676     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/s13012-016-0501-8     Document Type: Article

References (63)

1. American Psychiatric Association. DSM - 5. Washington, DC: American Psychiatric Association; 2013.
2. Frieden TR, Jaffe HW, Cono J, et al. Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, United States, 2010. MMWR Surveill Summ. 2014;63:1-21.
3. Croen LA, Grether JK, Hoogstrate J, Selvin S. The changing prevalence of autism in California. J Autism Dev Disord. 2002;32:207-15.
4. Lester G, Kelman M. State disparities in the diagnosis and placement of pupils with learning disabilities. J Learn Disabil. 1997;30:599-607.
5. Lord C, Wagner A, Rogers S, et al. Challenges in evaluating psychosocial interventions for autistic spectrum disorders. J Autism Dev Disord. 2005;35:695-708.
6. Brookman-Frazee LI, Taylor R, Garland AF. Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. J Autism Dev Disord. 2010;40:1188-201.
7. Lyon AR, Ludwig K, Romano E, Koltracht J, Vander Stoep A, McCauley E. Using modular psychotherapy in school mental health: provider perspectives on intervention-setting fit. J Clin Child Adolesc Psychol. 2013;0:1-12.
8. Frieden TR, Jaffe HW, Cono J, et al. Evidence-based practice and autism in the schools. Randolph: National Autism Center; 2009.
9. Locke J, Kratz H, Reisinger E, Mandell D. Implementation of evidence-based practices for children with autism spectrum disorders in public schools. In: Beidas R, Kendall P, editors. Child and Adolescent Therapy: Dissemination and Implementation of Empirically Supported Treatments. New York: Oxford University Press; 2014. p. 261-276.
10. Dingfelder HE, Mandell DS. Bridging the research-to-practice gap in autism intervention: an application of diffusion of innovation theory. J Autism Dev Disord. 2010;41:597-609.
11. Iovannone R, Dunlap G, Huber H, Kincaid D. Effective educational practices for students with autism spectrum disorders. Focus Autism Other Dev Disabl. 2003;18:150-65.
12. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36:24-34.
13. Stahmer AC, Reed S, Lee E, Reisinger EM, Mandell DS, Connell JE. Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity. Psychol Sch. 2015;52:181-95.
14. Chasson GS, Harris GE, Neely WJ. Cost comparison of early intensive behavioral intervention and special education for children with autism. J Child Fam Stu. 2007;16:401-13.
15. Eikeseth S, Smith T, Jahr E, Eldevik S. Intensive behavioral treatment at school for 4- to 7-year-old children with autism. Behav Modif. 2002;26:49-68.
16. Howard J, Sparkman C, Cohen H, Green G, Stanislaw H. A comparison of intensive behavior analytic and eclectic treatments for young children with autism. Res Dev Disabil. 2005;26:359-83.
17. Glasgow R, Vogt T, Boles S. Evaluating the public health impact of health promotion interventions: The RE-AIM Framework. Am J Public Health. 1999;89:1322-7.
18. Rogers E. Diffusion of innovations. New York: Free Press; 1995.
19. Massey OT, Armstrong K, Boroughs M, Henson K, McCash L. Mental health services in schools: a qualitative analysis of challenges to implementation, operation, and sustainability. Psychol Sch. 2005;42:361-72.
20. Langley AK, Nadeem E, Kataoka SH, Stein BD, Jaycox LH. Evidence-based mental health programs in schools: barriers and facilitators of successful implementation. School Ment Health. 2010;2:105-13.
21. Forman SG, Olin SS, Hoagwood KE, Crowe M, Saka N. Evidence-based interventions in schools: developers' views of implementation barriers and facilitators. School Ment Health. 2009;1:26-36.
22. Forman SG, Shapiro ES, Codding RS, Gonzales JE, Reddy LA, Rosenfeld SA, Sanetti LMH, Stoiber KC. Implementation science and school psychology. Sch Psychol Q. 2013;28:77-100.
23. Hoagwood K, Johnson J. School psychology: a public health framework. I. From evidence-based practices to evidence based policies. J Sch Psychol. 2003;41:3-21.
24. Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, Chaffin MJ. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Imp Sci. 2012;7:1.
25. Mandell DS, Stahmer AC, Shin S, Xie M, Reisinger E, Marcus SC. The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. Autism. 2013;17:281-95.
26. Fixen DL, Naoom SF, Blasé KA, Friedman R, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network; 2005.
27. Owens JS, Lyon AR, Brandt NE, et al. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6(2):99-111. doi: 10.1007/s12310-013-9115-3.
28. Forman SG, Barakat NM. Cognitive-behavioral therapy in the schools: bringing research to practice through effective implementation. Psychol Sch. 2011;48:283-96.
29. Stahmer AC, Aarons GA. Attitudes toward adoption of evidence-based practices: a comparison of autism early intervention providers and children's mental health providers. Psychol Serv. 2009;6:223-34.
30. Glisson C, Green P. Organizational climate, services, and outcomes in child welfare systems. Child Abuse Negl. 2011;35:582-91.
31. Glisson C, Landsverk J, Schoenwald S. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health. 2008;35:98-113.
32. Glisson C, Schoenwald SK, Hemmelgarn A, et al. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol. 2010;78:537-50.
33. Klein K, Knight A. Innovation implementation: overcoming the challenge. Curr Dir Psychol Sc. 2005;14:24-36.
34. Glisson C, James LR. The cross-level effects of culture and climate in human service teams. J Organ Behav. 2002;23:767-94.
35. Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4:67.
36. Bass BM, Avolio BJ. MLQ: Multifactor leadership questionnaire (Technical Report). Binghamton University, NY: Center for Leadership Studies; 1995.
37. Michaelis B, Stegmaier R, Sonntag K. Shedding light on followers' innovation implementation behavior: the role of transformational leadership, commitment to change, and climate for initiative. J Manag Psychol. 2010;25:408-29.
38. Michaelis B, Stegmaier R, Sonntag K. Affective commitment to change and innovation implementation behavior: the role of charismatic leadership and employees' trust in top management. J Chang Manag. 2009;9:399-417.
39. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9:45-55.
40. Domitrovich CE, Bradshaw CP, Poduska JM, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv Sch Ment Health Promot. 2008;1:6-28.
41. Arick J, Loos L, Falco R, Krug D. The STAR program: strategies for teaching based on autism research. Austin: PRO-ED; 2005.
42. Arick J, Young H, Falco RA, Loos LM, Krug DA, Gense MH, et al. Designing an outcome study to monitor the progress of students with autism spectrum disorders. Focus Autism Other Dev Disabl. 2003;18:74-86.
43. Proctor E, Silmere H, Raghaven R, et al. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38:65-76.
44. Pellecchia M, Connell JE, Beidas RS, Xie M, Marcus SC, Mandell DS. Dismantling the active ingredients of an intervention for children with autism. J Autism Dev Disord. 2015;45:2917-27.
45. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;2:61-74.
46. Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and United States norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;3:701-17.
47. Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Adm Policy Ment Health. 2007;34:465-9.
48. Glisson C. Assessing and changing organizational culture and climate for effective services. Res Soc Work Pract. 2007;17:736-47.
49. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9:157-68.
50. Guest G, Bunce A, Johnson L. How many interviews are enough?: an experiment with data saturation and variability. Field Methods. 2006;18:59-82.
51. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42:1758-72.
52. DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000;22:351-72.
53. Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. 1997;25:517-72.
54. Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52:196.
55. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-74.
56. Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2011;0:1-13.
57. Creswell JW, Klassen AC, Plano Clark VL, Smith KC for the Office of Behavioral and Social Sciences Research. Best practices for mixed methods research in the health sciences. August 2011. National Institutes of Health. 16 October 2016. http://obssr.od.nih.gov/mixed_methods_research.
58. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlbert M, Landsverk J. Mixed methods designs in implementation research. Adm Policy Ment Health. 2011;38:44-53.
59. Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Thousand Oaks: Sage Publications; 2006.
60. Meyers DC, Durak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol. 2012;50:462-80.
61. Powell BP, Waltz TJ, Chinman MJ, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:1-15.
62. Curran GM, Mukherjee S, Allee E, Owen RR. A process for developing an implementation intervention: QUERI series. Implement Sci. 2008;3:17.
63. Sable J, Plotts C, Mitchell L, Chen C. Characteristics of the 100 Largest Public Elementary and Secondary School Districts in the United States: 2008-09 (NCES 2011-301). Washington, DC: U.S. Department of Education, National Center for Education Statistics; 2010.