Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 40, Issue 6, 2013, Pages 439-450

  Nadeem, Erum ^a   Gleacher, Alissa ^a   Beidas, Rinad S ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Consultation; Dissemination; Evidence based practice; Implementation

Indexed keywords

CHILD; CHILD HEALTH CARE; EVIDENCE BASED PRACTICE; HUMAN; INFORMATION DISSEMINATION; MENTAL HEALTH SERVICE; METHODOLOGY; PATIENT REFERRAL; REVIEW;

CHILD; CHILD HEALTH SERVICES; COMMUNITY MENTAL HEALTH SERVICES; EVIDENCE-BASED PRACTICE; HUMANS; INFORMATION DISSEMINATION; REFERRAL AND CONSULTATION;

EID: 84885950027     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-013-0502-8     Document Type: Article

References (93)

1. Aarons, G. A.; Glisson, C.; Green, P. D.; Hoagwood, K.; Kelleher, K. J.; & Landsverk, J. A. (2012a). The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A united states national study. Implementation Science, 7(1), 56.
2. Aarons, G. A.; Green, A. E.; Palinkas, L. A.; Self-Brown, S.; Whitaker, D. J.; Lutzker, J. R.; et al. (2012b). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7(32), 1-9.
3. Aarons, G. A.; Hurlburt, M.; & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4-23.
4. Amaya-Jackson, L.; & DeRose, R. R. (2007). Treatment considerations for clinicians in applying evidence-based practice to complex presentations of child trauma. Journal of Traumatic Stress, 20, 379-390.
5. Bearman, S. K.; Weisz, J. R.; Chorpita, B.; Hoagwood, K.; Marder, A.; Ugueto, A.; et al. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0485-5.
6. Becker, K.; Domitrovich, C.; & Ialongo, N. (2013). Supporting school-based preventive interventions: The PATHS to PAX coaching model. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0482-8.
7. Beidas, R. S.; Cross, W.; & Dorsey, S. (2013). Show me, don't tell me: Behavioral rehearsal as a training and analogue fidelity tool. Cognitive and Behavioral Practice.
8. Beidas, R.; Edmunds, J.; Cannuscio, C.; Gallagher, M.; Downey, M.; & Kendall, P. (2013). Therapists' perspectives of consultation following training: A qualitative examination. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0475-7.
9. Beidas, R. S.; Edmunds, J. E.; Marcus, S. C.; & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660-665.
10. Beidas, R. S.; & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1-30.
11. Bernal, G. (2006). Intervention development and cultural adaptation research with diverse families. Family Process, 45(2), 143-151.
12. Bernal, G.; Jiménez-Chafey, M. I.; & Domenech Rodríguez, M. M. (2009). Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Psychology: Research and Practice, 40(4), 361.
13. Berwick, D. M. (1996). A primer on leading the improvement of systems. British Medical Journal, 312(7031), 619-622.
14. California Department of Mental Health. (2010). Mental Health Services Act (Proposition 63). Retrieved from http://www.dmh.ca.gov/Prop-63/mhsa/.
15. Caplan, G.; & Caplan, R. B. (1993). Mental health consultation and collaboration. San Francisco, CA: Jossey-Bass Publishers.
16. Chinman, M.; Acosta, J.; Ebener, P.; Burkhart, Q.; Clifford, M.; Corsello, M.; et al. (2012). Establishing and evaluating the key functions of an interactive systems framework using an assets-getting to outcomes intervention. American Journal of Community Psychology, 50(3-4), 295-310.
17. Chorpita, B. F.; Daleiden, E. L.; & Weisz, J. R. (2005). Modularity in the design and application of therapeutic interventions. Applied and Preventive Psychology, 11(3), 141-156.
18. Cross, W. F.; Matthieu, M.; Cerel, J.; & Knox, K. (2007). Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide and Life-Threatening Behavior, 37(6), 659-670.
19. Cross, W. F.; Seaburn, D.; Gibbs, D.; Schmeelk-Cone, K.; White, A. M.; & Caine, E. D. (2011). Does practice make perfect? A randomized control trial of behavioral rehearsal on suicide prevention gatekeeper skills. The Journal of Primary Prevention, 32(3), 195-211.
20. Damschroder, L. J.; Aron, D. C.; Keith, R. E.; Kirsh, S. R.; Alexander, J. A.; & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50.
21. Ebert, L.; Amaya-Jackson, L.; Markiewicz, J.; Kisiel, C.; & Fairbank, J. (2012). Use of the breakthrough series collaborative to support broad and sustained use of evidence-based trauma treatment for children in community practice settings. Administration and Policy in Mental Health and Mental Health Services Research, 39(3), 187-199.
22. Edmunds, J.; Beidas, R.S.; & Kendall, P.C. (in press). Dissemination and implementation of evidence-based practices: The role of supervision in clinician training. Clinical Psychology: Science and Practice.
23. Edmunds, J. M.; Kendall, P. C.; Ringle, V.; Read, K.; Brodman, D.; Pimentel, S.; et al. (2013). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0490- 8.
24. Falender, C. A.; & Shafranske, E. P. (2004). Clinical supervision: A competency-based approach. Washington, DC: American Psychological Association.
25. Farmer, A. P.; Légaré, F.; Turcot, L.; Grimshaw, J.; Harvey, E.; McGowan, J.; et al. (2008). Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 3. doi: 10.1002/14651858.CD004398.pub2.
26. Feldstein, A. C.; & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (prism) for integrating research findings into practice. The Joint Commission Journal on Quality and Patient Safety, 34(4), 228-243.
27. Ferlie, E. B.; & Shortell, S. M. (2001). Improving the quality of health care in the United Kingdom and the United States: A framework for change. Milbank Quarterly, 79(2), 281-315.
28. Fixsen, D. L.; Naoom, S. F.; Blasé, K. A.; Friedman, R. M.; & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
29. Giguère, A.; Légaré, F.; Grimshaw, J.; Turcotte, S.; Fiander, M.; Grudniewicz, A.; et al. (2012). Printed educational materials: Effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews, 10. doi: 10.1002/14651858.CD004398.pub3.
30. Gleacher, A. A.; Nadeem, E.; Moy, A. J.; Whited, A. L.; Albano, A. M.; Radigan, M.; et al. (2011). Statewide cbt training for clinicians and supervisors treating youth: The New York state evidence based treatment dissemination center. Journal of Emotional and Behavioral Disorders, 19(3), 182-192.
31. Glisson, C.; Hemmelgarn, A.; Green, P.; Dukes, D.; Atkinson, S.; & Williams, N. J. (2012). Randomized trial of the availability, responsiveness, and continuity (arc) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51(8), 780-787.
32. Glisson, C.; Schoenwald, S. K.; Hemmelgarn, A.; Green, P.; Dukes, D.; Armstrong, K. S.; et al. (2010). Randomized trial of mst and arc in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537-550.
33. Greenhalgh, T.; Robert, G.; MacFarland, F.; Bate, P.; & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581-629.
34. Grimshaw, J. M.; Shirran, L.; Thomas, R.; Mowatt, G.; Fraser, C.; Bero, L.; et al. (2001). Changing provider behavior: An overview of systematic reviews of interventions. Medical Care, 39(8), II2-II45.
35. Grol, R.; & Grimshaw, J. (1999). Evidence-based implementation of evidence-based medicine. The Joint Commission journal on quality improvement, 25(10), 503.
36. Grol, R.; & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients' care. Lancet, 362(9391), 1225-1230.
37. Halgunseth, L. C.; Carmack, C.; Childs, S. S.; Caldwell, L.; Craig, A.; & Smith, E. P. (2012). Using the interactive systems framework in understanding the relation between general program capacity and implementation in afterschool settings. American Journal of Community Psychology, pp. 1-10.
38. Harned, M. S.; Dimeff, L. A.; Woodcock, E. A.; & Skutch, J. M. (2011). Overcoming barriers to disseminating exposure therapies for anxiety disorders: A pilot randomized controlled trial of training methods. Journal of Anxiety Disorders, 25(2), 155-163.
39. Herschell, A. D.; Kolko, D. J.; Baumann, B. L.; & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448-466.
40. Herschell, A. D.; McNeil, C. B.; & McNeil, D. (2004). Clinical child psychology's progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11(3), 267-288.
41. Hirachi, T.; Catalano, R.; & Hawkins, J. (1997). Effective recruitment for parenting programs within ethnic minority communities. Child and Adolescent Social Work Journal, 14(1), 23-29.
42. Institute for Healthcare Improvement. (2003). The breakthrough series. Boston, MA: IHI.
43. Ivers, N.; Jamtvedt, G.; Flottorp, S.; Young, J. M.; Odgaard-Jensen, J.; French, S. D.; et al. (2012). Audit and feedback: Effects on professional practice and healthcare outcomes. The Cochrane Library.
44. Jamtvedt, G.; Young, J. M.; Kristoffersen, D. T.; O'Brien, M. A.; & Oxman, A. D. (2006). Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Quality and Safety in Health Care, 15(6), 433-436.
45. Jensen-Doss, A. (2005). Evidence-based diagnosis: Incorporating diagnostic instruments into clinical practice. Journal of the Academcy of Child and Adolescent Psychiatry, 44(9), 947-952.
46. Jensen-Doss, A. (2011). Practice involves more than treatment: How can evidence-based assessment catch up to evidence-based treatment? Clinical Psychology: Science and Practice, 18(2), 173-177.
47. Joyce, B. R.; & Showers, B. (2002). Student achievement through staff development. Association for Supervision & Curriculum Development.
48. Kelley, S. D.; & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems (MFS) in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363-368.
49. Klein, K. J.; Conn, A. B.; & Sorra, J. S. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86(5), 811.
50. Kolb, D. A. (1984). Experiential learning. New Jersey: Prentice Hall.
51. Kumpfer, K.; Alvarado, R.; Tait, C.; & Turner, C. (2002). Effectiveness of school- based family and children's skills training for substance abuse prevention among 6-8-year-old rural children. Psychology of Addictive Behaviors, 16(4S), S65-S71.
52. Langley, A. K.; Nadeem, E.; Kataoka, S. H.; Stein, B. D.; & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105-113.
53. Lee, S.; Aos, S.; Drake, E.; Pennucci, A.; Miller, M.; & Anderson, L. (2012). Return on investment: Evidence-based options to improve statewide outcomes, April 2012. (Document No. 12-04-1201). Olympia: Washington State Institute for Public Policy.
54. Lesesne, C. A.; Lewis, K. M.; White, C. P.; Green, D. C.; Duffy, J. L.; & Wandersman, A. (2008). Promoting science-based approaches to teen pregnancy prevention: Proactively engaging the three systems of the interactive systems framework. American Journal of Community Psychology, 41(3), 379-392.
55. Lomas, J. (1993). Diffusion, dissemination, and implementation: Who should do what? Annals of the New York Academy of Sciences, 703(1), 226-237.
56. Lyon, A. R.; McCauley, E.; Ludwig, K.; Vander Stoep, A.; & Cosgrove, T. (2013). "If it's worth my time, I will make the time": School-based providers' decision-making about participating in an evidence-based psychotherapy consultation program. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0494-4.
57. Masia-Warner, C.; Brice, C. Esseling, P.; Stewart, C.; Mufson, L.; & Herzig, K. (2013). Supervisors' perceptions of school counselors' ability to deliver an empirically-based intervention for adolescent social anxiety disorder. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0498-0.
58. Milne, D. (2007). An empirical definition of clinical supervision. British Journal of Clinical Psychology, 46(4), 437-447.
59. Milne, D. (2009). Evidence-based clinical supervision: Principles and practice. Oxford, UK: Wiley-Blackwell.
60. Milne, D.; Aylott, H.; Fitzpatrick, H.; & Ellis, M. V. (2008). How does clinical supervision work? Using a "best evidence synthesis" approach to construct a basic model of supervision. The Clinical Supervisor, 27(2), 170-190.
61. Mitchell, R.; Stone-Wiggins, B.; Stevenson, J. F.; & Florin, P. (2004). Cultivating capacity: Outcomes of a statewide support system for prevention coalitions. Journal of Prevention and Intervention in the Community, 27, 67-87.
62. Nadeem, E.; Gleacher, A.; Pimentel, S.; Hill, L.; McHugh, M.; & Hoagwood, K. (2013a). The role of consultation calls for clinic supervisors in supporting large-scale dissemination of evidence-based treatments for children. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0491-7.
63. Nadeem, E.; Olin, S. S.; Hill, L.; Hoagwood, K. E.; & Horwitz, S. M. (2013b). Understanding the components of quality improvement collaboratives: A systematic literature review. The Milbank Quarterly.
64. National Institute of Mental Health. (2008). The national institute of mental health strategic plan. Retrieved from http://www.nimh.nih.gov/about/ strategic-planning-reports/index.shtml.
65. Ngo, V.; Langley, A.; Kataoka, S. H.; Nadeem, E.; Escudero, P.; & Stein, B. D. (2008). Providing evidence-based practice to ethnically diverse youths: Examples from the cognitive behavioral intervention for trauma in schools (CBITS) program. Journal of the American Academy of Child Adolescent Psychiatry, 47(8), 858-862.
66. Oregon Department of Human Services. (2009). Evidence based practices in oregon: An overview. Retrieved from http://www.oregon.gov/oha/amh/pages/ebp/ main.aspx#oregon.
67. Palinkas, L. A.; Schoenwald, S. K.; Hoagwood, K.; Landsverk, J.; Chorpita, B. F.; & Weisz, J. R. (2008). An ethnographic study of implementation of evidence-based treatments in child mental health: First steps. Psychiatric services, 59(7), 738-746.
68. Pappadopulous, E.; Siennick, S.; Schur, S.; & Gentry, L. (2002). Enhancing adherence to best practice guidelines: The role of behavioral change in mental health services delivery. Emotional and Behavioral Disorders in Youth, 2(3), 61-65.
69. Piacentini, J.; & Bergman, R. L. (2001). Developmental issues in cognitive therapy for childhood anxiety disorders. Journal of Cognitive Psychotherapy, 15(3), 165-182.
70. Powell, B. J.; McMillen, J. C.; Proctor, E. K.; Carpenter, C. R.; Griffey, R. T.; Bunger, A. C.; et al. (2011). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123-157.
71. Proctor, E. K.; Landsverk, J.; Aarons, G.; Chambers, D.; Glisson, C.; & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24-34.
72. Proctor, E.; Silmere, H.; Raghavan, R.; Hovmand, P.; Aarons, G.; Bunger, A.; et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65-76.
73. Rakovshik, S. G.; & McManus, F. (2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496-516.
74. Reinke, W. M.; Herman, K. C.; Stormont, M.; Newcomer, L.; & David, K. (2013). Incredible years teacher classroom management program: Examining the relation of intervention support systems on teacher fidelity of implementation. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-013-0496-2.
75. Rossello, J.; & Bernal, G. (1999). The efficacy of cognitive-behavioral and interpersonal treatments for depression in Puerto Rican adolescents. Journal of Consulting and Clinical Psychology, 67(5), 734.
76. Saldana, L.; & Chamberlain, P. (2012). Supporting implementation: The role of community development teams to build infrastructure. American Journal of Community Psychology, pp. 1-13.
77. Salyers, M. P.; McKasson, M.; Bond, G. R.; & McGrew, J. H. (2007). The role of technical assistance centers in implementing evidence-based practices: Lessons learned. American Journal of Psychiatric Rehabilitation, 10, 85-101.
78. SAMHSA (Substance Abuse and Mental Health Services Administration). (2012). Supplemental research bulletin. Retrieved from: http://www.samhsa.gov/ dtac/bulletin/SAMHSA-DTAC-Supplemental-Research-Bulletin.htm.
79. Scheeler, M. C.; Ruhl, K. L.; & McAfee, J. K. (2004). Providing performance feedback to teachers: A review. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 27(4), 396-407.
80. Schoenwald, S. K. (2011). It's a bird, it's a plane, it's. fidelity measurement in the real world. Clinical Psychology: Science and Practice, 18(2), 142-147.
81. Schoenwald, S. K.; Chapman, J. E.; Kelleher, K.; Hoagwood, K. E.; Landsverk, J.; Stevens, J.; et al. (2008). A survey of the infrastructure for children's mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 84-97.
82. Schoenwald, S. K.; Garland, A. F.; Chapman, J. E.; Frazier, S. L.; Sheidow, A. J.; & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy In Mental Health, 38(1), 32-43.
83. Schoenwald, S. K.; Henggeler, S. W.; Brondino, M. J.; & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39(1), 83-103.
84. Schoenwald, S. K.; Sheidow, A. J.; & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child & Adolescent Psychology, 33(1), 94-104.
85. Schouten, L. M.; Hulscher, M. E.; Everdingen, J. J. V.; Huijsman, R.; & Grol, R. P. (2008). Evidence for the impact of quality improvement collaboratives: Systematic review. British Medical Journal, 336(7659), 1491-1494.
86. Smythe-Leistico, K. J.; Young, C. P.; Mulvey, L. A.; McCall, R. B.; Petruska, M.; Barone-Martin, C.; et al. (2012). Blending theory with practice: Implementing kindergarten transition using the interactive systems framework. American Journal of Community Psychology, 50, 357-369.
87. Tabak, R. G.; Khoong, E. C.; Chambers, D. A.; & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337-350.
88. Taylor, L. K.; Weist, M. D.; & Deloach, K. (2012). Exploring the use of the interactive systems framework to guide school mental health services in post-disaster contexts: Building community capacity for trauma-focused interventions. American Journal of Community Psychology, 50(3-4), 530-540.
89. Wandersman, A.; Chien, V. H.; & Katz, J. (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: Tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology, 41(3-4), 171-181.
90. Wandersman, A.; Duffy, J.; Flaspohler, P.; Noonan, R.; Lubell, K.; Stillman, L.; et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3), 171-181.
91. Weisz, J. R.; Chorpita, B. F.; Frye, A.; Ng, M. Y.; Lau, N.; Bearman, S. K.; et al. (2011a). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369-380.
92. Weisz, J. R.; Ugueto, A. M.; Herren, J.; Afienko, S. R.; & Rutt, C. (2011b). Kernels vs. ears, and other questions for a science of treatment dissemination. Clinical Psychology: Science and Practice, 18(1), 41-46.
93. Whitaker, D. J.; Lutzker, J. R.; Self-Brown, S.; & Edwards, A. E. (2008). Moving evidenced-based child maltreatment programs to practice settings: The SafeCare model. Report on Emotional and Behavioral Disorders in Youth, 8, 55-62.