Odd couple? reenvisioning the relation between science and practice in the dissemination-implementation era

Clinical Psychological Science

Volumn 2, Issue 1, 2014, Pages 58-74

  Weisz, John R ^a   Ng, Mei Yi ^a   Bearman, Sarah Kate ^b  

^a HARVARD UNIVERSITY   (United States)

^b YESHIVA UNIVERSITY   (United States)

Author keywords

Dissemination; Empirically supported treatment; Implementation; Training

Indexed keywords

EID: 84901456170     PISSN: 21677026     EISSN: 21677034     Source Type: Journal    
DOI: 10.1177/2167702613501307     Document Type: Article

References (89)

1. Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., and Landsverk, J. A., and Research Network on Youth Mental Health. (2012). The organizational social context of mental services and clinician attitudes toward evidence-based practice: A United States national study. Implementation Science, 7, 56. Retrieved from http://www.implementationscience.com/content/7/1/56
2. Accurso, E. C., Taylor, R. M., and Garland, A. F. (2011). Evidence- based practices addressed in community-based children's mental health clinical supervision. Training and Education in Professional Psychology, 5, 88-96. doi:10.1037/a0023537
3. Addis, M. E. (2002). Methods for disseminating research products and increasing evidence-based practice: Promises, obstacles, and future directions. Clinical Psychology: Science and Practice, 9, 367-378. doi:10.1093/clipsy/9.4.367
4. American Psychological Association. (2006). State provincial mandatory continuing education in psychology (MCEP) requirements-2006 survey results. Retrieved from http:// www.apa.org/ed/sponsor/resources/requirements.aspx
5. Baker, T. B., McFall, R. M., and Shoham, V. (2009). Current status and future prospects of clinical psychology: Toward a scientifically principled approach to mental and behavioral health care. Psychological Science in the Public Interest, 9, 67-103.
6. Barlow, D. H., Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Allen, L. B., and Ehrenreich-May, J. (2011). The unified protocol for transdiagnostic intervention of emotional disorders: Therapist guide. New York, NY: Oxford University Press.
7. Bearman, S. K., Herren, J., Dorf-Caine, R., Michl, L., Zoloth, E., Jhe, G., and Weisz, J. R. (2011, November). Taking care (with usual care): Common elements across evidence-based interventions for youth depression and intervention as usual in school settings. In C. K. Higa-McMillan (Chair) and A. Garland (Discussant), Comparing usual care and evidence-based care for children and adolescents: Advancing dissemination in the 21st century. Symposium conducted at the annual meeting of the Association of Behavioral and Cognitive Therapies, Toronto, Ontario, Canada.
8. Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., and Ugueto, A. M., Research Network on Youth Mental Health. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research. Advance online publication. doi:10.1007/s10488-013-0485-5
9. Becker, C. B., Stice, E., Shaw, H., and Woda, S. (2009). Use of empirically supported interventions for psychopathology: Can the participatory approach move us beyond the research-to-practice gap? Behaviour Research and Therapy, 47, 265-274.
10. Beidas, R. S., Edmunds, J. M., Marcus, S. C., and Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported intervention: A randomized trial. Psychiatric Services, 63, 660-665.
11. Beidas, R. S., and Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1-30.
12. Bickman, L. (1996). A continuum of care: More is not always better. American Psychologist, 51, 689-701.
13. Bickman, L., Kelley, S. D., Breda, C., deAndrade, A., and Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62, 1423-1429.
14. Bradshaw, C. P., Pas, E. T., Bloom, J., Barrett, S., Hershfeldt, P., Alexander, A., Leaf, P. J. (2012). A state-wide partnership to promote safe and supportive schools: The PBIS Maryland initiative. Administration and Policy in Mental Health and Mental Health Services Research, 39, 225-237. doi:10.1007/s10488-011-0384-6
15. Brookman-Frazee, L., Stahmer, A. C., Lewis, K., Feder, J. D., and Reed, S. (2012). Building a research-community collaborative to improve community care for infants and toddlers at- risk for autism spectrum disorders. Journal of Community Psychology, 40, 715-734. doi:10.1002/jcop.21501
16. Buchanan, R., Chamberlain, P., Price, J. M., and Sprengelmeyer, P. (2013). Examining the equivalence of fidelity over two generations of KEEP implementation: A preliminary analysis. Children and Youth Services Review, 35, 188-193. doi:10.1016/j.childyouth.2012.10.002
17. Chamberlain, P., Roberts, R., Jones, H., Marsenich, L., Sosna, T., and Price, J. M. (2012). Three collaborative models for scaling up evidence-based practices. Administration and Policy in Mental Health and Mental Health Services Research, 39, 278-290. doi:10.1007/s10488-011-0349-9
18. Chambers, D. A., Ringeisen, H., and Hickman, E. E. (2005). Federal, state, and foundation initiatives around evidence- based practices for child and adolescent mental health. Child and Adolescent Psychiatric Clinics of North America, 14, 307-327.
19. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Woody, S. R. (1998). Update on empirically validated therapies, II. Clinical Psychologist, 51, 3-15.
20. Chorpita, B. F., Reise, S., Weisz, J. R., Grubbs, K., Becker, K. D., and Krull, J. L., and Research Network on Youth Mental Health. (2010). Evaluation of the brief problem checklist: Child and caregiver interviews to measure clinical progress. Journal of Consulting and Clinical Psychology, 78, 526-536.
21. Chorpita, B. F., and Weisz, J. R. (2009). MATCH-ADTC Modular approach to therapy for children with anxiety, depression, trauma, or conduct problems. Satellite Beach, FL: PracticeWise.
22. Clark, D. M., Layard, R., Smithies, R., Richard, D. A., Suckling, R., and Wright, B. (2009). Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy, 47, 910-920. doi:10.1016/j.brat.2009.07.010
23. Curtis, N. M., Ronan, K. R., and Borduin, C. M. (2004). Multisystemic intervention: A meta-analysis of outcome studies. Journal of Family Psychology, 18, 411-419. doi: 10.1037/08933200.18.3.411
24. Dimeff, L. A., Woodcock, E. A., Harned, M. S., and Beadnell, B. (2011). Can dialectical behavior therapy be learned in highly structured learning environments? Results from a randomized controlled dissemination trial. Behavior Therapy, 42, 263-275. doi:10.1016/j.beth.2010.06.004
25. Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Thompson-Hollands, J., Carl, J. R., Barlow, D. H. (2012). The unified protocol for the transdiagnostic intervention of emotional disorders: A randomized controlled trial. Behavior Therapy, 3, 666-678.
26. Feil, E. G., Sprengelmeyer, P. G., Davis, B., and Chamberlain, P. (2012). Development and testing of a multimedia Internet- based system for fidelity and monitoring of multidimensional intervention foster care. Journal of Medical Internet Research, 14, 239-248.
27. Foa, E. B., Hembree, E. A., Cahill, S. P., Rauch, S. A. M., Riggs, D. S., Feeny, N. C., and Yadin, E. (2005). Randomized trial of prolonged exposure for posttraumatic stress disorder with and without cognitive restructuring: Outcome at academic and community clinics. Journal of Consulting and Clinical Psychology, 73, 953-964.
28. Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine-Schlagel, R., and Ganger, B. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists' offices. Psychiatric Services, 61, 1-8.
29. Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., and Williams, N. J. (2012). Randomized trial of the Availability, Responsiveness, and Continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 780-787.
30. Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., and Green, P. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98-113. doi:10.1007/s10488- 007-0148-5
31. Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., and Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based intervention implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537-550. doi:10.1037/a0019160
32. Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., and Mayberg, S., Research Network on Youth Mental Health. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35, 124-133. doi:10.1007/s10488- 007-0152-9
33. Green, L. A., and Seifert, C. M. (2005). Translation of research into practice: Why we can't "just do it." Journal of the American Board of Family Medicine, 18, 541-545. doi:10.3122/ jabfm.18.6.541
34. Greenhalgh, T., Macfarlane, F., Bate, P., and Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82, 581-629.
35. Herschell, A. D., Kolko, D. J., Baumann, B. L., and Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial interventions: A review and critique with recommendations. Clinical Psychology Review, 30, 448-466.
36. Hoagwood, K., and Kolko, D. J. (2009). Introduction to the special section on practice contexts: A glimpse into the nether world of public mental health services for children and families. Administration and Policy in Mental Health and Mental Health Services Research, 36, 35-36.
37. Hoagwood, K., Olin, S., and Cleek, A. (2013). Beyond context to the skyline: Thinking in 3D. Administration and Policy in Mental Health and Mental Health Services Research, 40, 23-28.
38. Ignatius, A. (Ed.). (2011). The failure issue: How to understand it, learn from it, and recover from it [Special issue]. Harvard Business Review, 89(4).
39. Israel, B. A., Eng, E., Schulz, A. J., and Parker, E. A. (2005). Methods in community-based participatory research for health. San Francisco, CA: Jossey-Bass.
40. Karlin, B. E., Brown, G. K., Trockel, M., Cunning, D., Zeiss, A. M., and Taylor, C. B. (2012). National dissemination of cognitive behavioral therapy for depression in the Department of Veterans Affairs health care system: Therapist and patient-level outcomes. Journal of Consulting and Clinical Psychology, 80, 707-718. doi:10.1037/a0029328
41. Karlin, B. E., Ruzek, J. I., Chard, K. M., Eftekhari, A., Monson, C. M., Hembree, E. A., Foa, E. B. (2010). Dissemination of evidence-based psychological interventions for posttraumatic stress disorder in the Veterans Health Administration. Journal of Traumatic Stress, 23, 663-673. doi:10.1002/ jts.20588
42. Kazdin, A. E., and Blase, S. L. (2011). Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspectives on Psychological Science, 6, 21-37. doi:10.1177/1745691610393527
43. Landsverk, J., Brown, C. H., Reutz, J. R., Palinkas, L., and Horwitz, S. M. (2011). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research, 38, 54-63.
44. Leffler, J. M., Jackson, Y., West, A. E., McCarty, C. A., and Atkins, M. (2012). Training in evidence-based practice across the professional continuum. Professional Psychology: Research and Practice, 44, 20-28.
45. Lewis, B. L., Hatcher, R. L., and Pate, W. E., II. (2005). The practi- cum experience: A survey of practicum site coordinators. Professional Psychology: Research and Practice, 36, 291298. doi:10.1037/0735-7028.36.3.291
46. Manuel, J. K., Hagedorn, H. J., and Finney, J. W. (2011). Implementing evidence-based psychosocial intervention in specialty substance use disorder care. Psychology of Addictive Behaviors, 25, 225-237. doi:10.1037/a0022398
47. Margison, F., Barkham, M., Evans, C., McGrath, G., Mellor- Clark, J., Audin, K., and Connell, J. (2000). Measurement and psychotherapy: Evidence-based practice and practice-based evidence. British Journal of Psychiatry, 177, 123-130.
48. McGrew, J. H., Bond, G. R., Dietzen, L., and Salyers, M. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670-678. doi:10.1037/0022-006X.62.4.670
49. McHugh, R. K., and Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological interventions: A review of current efforts. American Psychologist, 73, 73-84.
50. McLean, C. P., and Foa, E. B. (2011). Prolonged exposure therapy for post-traumatic stress disorder: A review of evidence and dissemination. Expert Reviews, 11, 1151-1163.
51. McLeod, B. D., and Weisz, J. R. (2005). The Therapy Process Observational Coding System-Alliance Scale: Measure characteristics and prediction of outcome in usual clinical practice. Journal of Consulting and Clinical Psychology, 73, 323-333.
52. McLeod, B. D., and Weisz, J. R. (2010). Therapy Process Observational Coding System for Child Psychotherapy Strategies Scale. Journal of Clinical Child and Adolescent Psychology, 39, 436-443.
53. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., and Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, 1050-1062.
54. Nathan, P. E., and Gorman, J. M. (Eds.). (2007). A guide to interventions that work (3rd ed.). Oxford, England: Oxford University Press.
55. National Alliance on Mental Illness. (2003). An update on evidence-based practices in children's mental health. Retrieved from http://www.nami.org/Template.cfm?Section=Child_and_Adolescent_Action_Center&Template=/ContentManagement/ContentDisplay.cfm&ContentID=12717
56. National Institute of Mental Health. (2002). Dissemination and implementation research in mental health. Retrieved from http://grants.nih.gov/grants/guide/pa-files/pa-02-131.html
57. National Institute of Mental Health. (2009). Dissemination and implementation research in health (R21). Retrieved from http://grants.nih.gov/grants/guide/pa-files/par-10-040.html
58. Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., and Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44-53. doi:10.1007/s10488-010-0314-z
59. Palinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J., Chorpita, B. F., and Weisz, J. R., Research Network on Youth Mental Health. (2008). An ethnographic study of implementation of evidence-based interventions in child mental health: First steps. Psychiatric Services, 59, 738-746.
60. Perepletchikova, F., Treat, T. A., and Kazdin, A. E. (2007). Intervention integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829-841.
61. Raine, R., Sanderson, C., Hutchings, A., Carter, S., Larkin, K., and Black, N. (2004). An experimental study of determinants of group judgments in clinical guideline development. Lancet, 364, 429-437.
62. Rotheram-Borus, M. J., Swendeman, D., and Chorpita, B. F. (2012). Disruptive innovations for designing and diffusing evidence-based interventions. American Psychologist, 67, 463-476. doi:10.1037/a0028180
63. Ruzek, J. I., Karlin, B. E., and Zeiss, A. (2012). Implementation of evidence-based psychological interventions in the Veterans Health Administration. In R. K. McHugh and D. H. Barlow (Eds.), Dissemination and implementation of evidence-based psychological interventions (pp. 78-96). New York, NY: Oxford University Press.
64. Safran, J. D., Abreu, I., Ogilvie, J., and DeMaria, A. (2011). Does psychotherapy research influence the clinical practice of researcher-clinicians? Clinical Psychology: Science and Practice, 18, 357-371.
65. Schoenwald, S. K. (2010). From policy pinball to purposeful partnership: The policy contexts of multisystemic therapy transport and dissemination. In J. R. Weisz and A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 538-556). New York, NY: Guilford Press.
66. Scott, S. (2010). National dissemination of effective parenting programmes to improve child outcomes. British Journal of Psychiatry, 196, 1-3.
67. Sharkin, B. S., and Plageman, P. M. (2003). What do psychologists think about mandatory continuing education? A survey of Pennsylvania practitioners. Professional Psychology: Research and Practice, 34, 318-323. doi: 10.1037/07357028.34.3.318
68. Shimokawa, K., Lambert, M. J., and Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298-311.
69. Shoham, V., and Insel, T. R. (2011). Rebooting for whom? Portfolios, technology, and personalized intervention. Perspectives on Psychological Science, 6, 478-482.
70. Sholomskas, D. E., Syracuse-Siewart, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., and Carroll, K. M. (2005). We don't train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106-115.
71. Silverman, W. K., and Hinshaw, S. P. (2008). Evidence-based psychosocial interventions for children and adolescents: A ten-year update. Journal of Clinical Child and Adolescent Psychology, 37, 1-7. doi:10.1080/15374410701817725
72. Smith, D. K., and Chamberlain, P. (2010). Multidimensional intervention foster care for adolescents: Processes and outcomes. In J. R. Weisz and A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 243-258). New York, NY: Guilford Press.
73. Smith, J. L., Carpenter, K. M., Amrhein, P. C., Brooks, A. C., Levin, D., Schreiber, E. A., Nunes, E. V. (2012). Training substance abuse clinicians in motivational interviewing using live supervision via teleconferencing. Journal of Consulting and Clinical Psychology, 80, 450-464. doi:10.1037/a0028176
74. Stewart, R. E., and Chambless, D. L. (2007). Does psychotherapy research inform intervention decisions in private practice? Journal of Clinical Psychology, 63, 267-281. doi: 10.1002/ jclp.20347
75. Stewart, R. E., Stirman, S. W., and Chambless, D. L. (2012). A qualitative investigation of practicing psychologists' attitudes toward research-informed practice: Implications for dissemination strategies. Professional Psychology: Research and Practice, 43, 100-109. doi:10.1037/a0025694.supp
76. Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., and Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 17. Retrieved from http://www.implementationscience.com/content/7/1/17
77. Thomas Edison. (2013, July 23). In Wikiquote. Retrieved from http://en.wikiquote.org/w/index.php?title=Thomas_Edison&oldid=1605856
78. Wampold, B. E., Budge, S. L., Laska, K. M., Del Re, A. C., Baardseth, T. P., Fluckiger, C., Gunn, W. (2011). Evidence-based interventions for depression and anxiety versus intervention-as-usual: A meta-analysis of direct comparisons. Clinical Psychology Review, 31, 1304-1312. doi:10.1016/j.cpr.2011.07.012
79. Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-based interventions and case examples. New York, NY: Cambridge University Press.
80. Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., and Bearman, S. K., Research Network on Youth Mental Health. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify intervention needs and track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79, 369-380.
81. Weisz, J. R., Chorpita, B. F., Palinkas, L., Schoenwald, S. K., Miranda, J., and Bearman, S. K., Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69, 274-282.
82. Weisz, J. R., and Gray, J. S. (2008). Evidence-based psychotherapies for children and adolescents: Data from the present and a model for the future. Child and Adolescent Mental Health, 13, 54-65.
83. Weisz, J. R., Jensen-Doss, A., and Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337-363.
84. Weisz, J. R., Jensen-Doss, A., and Hawley, K. M. (2006). Evidence- based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671-689.
85. Weisz, J. R., and Kazdin, A. E. (2010). Evidence-based psychotherapies for children and adolescents (2nd ed.). New York, NY: Guilford Press.
86. Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., and Jensen-Doss, A. (2013). Performance of evidence- based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry, 70, 750-761.
87. Weisz, J. R., Ugueto, A. M., Cheron, D. M., and Herren, J. (2013). Evidence-based youth psychotherapy in the mental health ecosystem. Journal of Clinical Child and Adolescent Psychology, 42, 274-286. doi: 10.1080/15374416.2013.7648 24
88. Woody, S. R., Weisz, J., and McLean, C. (2005). Empirically supported treatments: 10 years later. Clinical Psychologist, 58, 5-11.
89. Yates, B. T. (2011). Delivery systems can determine therapy costs and effectiveness, more than type of therapy. Perspectives on Psychological Science, 6, 498-502.