A mixed methods multiple case study of implementation as usual in children's social service organizations: Study protocol

Implementation Science

Volumn 8, Issue 1, 2013, Pages

  Powell, Byron J ^a   Proctor, Enola K ^a   Glisson, Charles A ^b   Kohl, Patricia L ^a   Raghavan, Ramesh ^a,c   Brownson, Ross C ^a,d   Stoner, Bradley P ^c,e   Carpenter, Christopher R ^c   Palinkas, Lawrence A ^f  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^b UNIVERSITY OF TENNESSEE   (United States)

^c WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d Washington University in St Louis School of Medicine   (United States)

^e WASHINGTON UNIVERSITY   (United States)

^f UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Children and adolescents; Implementation strategies; Mental health; Mixed methods; Multiple case study

Indexed keywords

ADOLESCENT; CHILD; CONTROLLED STUDY; EVIDENCE BASED MEDICINE; HEALTH PERSONNEL ATTITUDE; HUMAN; MASS COMMUNICATION; MENTAL DISORDERS; ORGANIZATION; PERCEPTION; RANDOMIZED CONTROLLED TRIAL; SOCIAL WORK; STATISTICS; UNITED STATES; ARTICLE; CONTROLLED CLINICAL TRIAL; MENTAL DISEASE;

ADOLESCENT; ATTITUDE OF HEALTH PERSONNEL; CHILD; DECISION MAKING, ORGANIZATIONAL; DIFFUSION OF INNOVATION; EVIDENCE-BASED MEDICINE; HUMANS; MENTAL DISORDERS; ORGANIZATIONAL CULTURE; PERCEPTION; SOCIAL WORK; STATISTICS AS TOPIC; UNITED STATES;

EID: 84883017673     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/1748-5908-8-92     Document Type: Article

References (94)

1. Garland AF, Brookman-Frazee L, Hurlburt MS, Accurso EC, Zoffness RJ, Haine-Schlagel R, Ganger W. Mental health care for children with disruptive behavior problems: a view inside therapists' offices. Psychiatr Serv 2010, 61:788-795.
2. Kohl PL, Schurer J, Bellamy JL. The state of parent training: Program offerings and empirical support. Fam Soc 2009, 90:247-254.
3. Raghavan R, Inoue M, Ettner SL, Hamilton BH. A preliminary analysis of the receipt of mental health services consistent with national standards among children in the child welfare system. Am J Public Health 2010, 100:742-749.
4. Zima BT, Hurlburt MS, Knapp P, Ladd H, Tang L, Duan N, Wallace P, Rosenblatt A, Landsverk J, Wells KB. Quality of publicly-funded outpatient specialty mental health care for common childhood psychiatric disorders in California. J Am Acad Child Adolesc Psychiatry 2005, 44:130-144.
5. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol 2008, 41:327-350.
6. Grol R, Grimshaw JM. Evidence-based implementation of evidence-based medicine. Jt Comm J Qual Improv 1999, 25:503-513.
7. Institute of Medicine Initial National Priorities for Comparative Effectiveness Research 2009, Washington, DC: The National Academies Press, Institute of Medicine.
8. Dissemination and implementation research in health (R01) http://grants.nih.gov/grants/guide/pa-files/PAR-13-055.html.
9. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev 2012, 69:123-157.
10. Grimshaw JM, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L. Toward evidence-based quality improvement: evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med 2006, 21(2):S14-20.
11. Grol R, Wensing M, Eccles M. Improving patient care: The implementation of change in clinical practice 2005, Edinburgh: Elsevier.
12. Powell BJ, Proctor EK, Glass JE. A systematic review of implementation strategies in mental health service settings 2011, Washington: Seattle.
13. Straus S, Tetroe J, Graham ID. Knowledge translation in health care: Moving from evidence to practice 2009, Hoboken, NJ: Wiley-Blackwell.
14. The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) Designing theoretically-informed implementation interventions. Implement Sci 2006, 1:1-8. The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG).
15. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract 2010, 17:1-30.
16. Davis DA, Davis N. Educational interventions. Knowledge translation in health care: Moving from evidence to practice 2009, 113-123. Oxford, UK: Wiley-Blackwell, Straus S, Tetroe J, Graham ID.
17. Herschell AD, McNeil CB, Urquiza AJ, McGrath JM, Zebell NM, Timmer SG, Porter A. Evaluation of a treatment manual and workshops for disseminating, Parent-child Interaction Therapy. Adm Policy Ment Health 2009, 36:63-81.
18. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev 2010, 30:448-466.
19. Flanagan ME, Ramanujam R, Doebbeling BN. The effect of provider- and workflow-focused strategies for guideline implementation on provider acceptance. Implement Sci 2009, 4:1-10.
20. Solberg LI, Brekke ML, Fazio CJ, Fowles J, Jacobsen DN, Kottke TE, Mosser G, O'Connor PJ, Ohnsorg KA, Rolnick SJ. Lessons from experienced guideline implementers: attend to many factors and use multiple strategies. Journal on Quality Improvement 2000, 26:171-188.
21. Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. Knowledge Translation in health care: Moving from evidence to practice 2009, 94-113. Oxford, UK: Wiley-Blackwell, Straus S, Tetroe J, Graham ID.
22. Weisz JR, Chorpita BF, Palinkas LA, Schoenwald SK, Miranda J, Bearman SK, Daleiden EL, Ugueto AM, Ho A, Martin J, Gray J, Alleyne A, Langer DA, Southam-Gerow MA, Gibbons RD. Health TRN on YM: Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. Arch Gen Psychiatry 2012, 69:274-282.
23. Glisson C, Schoenwald S, Hemmelgarn A, Green P, Dukes D, Armstrong KS, Chapman JE. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol 2010, 78:537-550.
24. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011, 38:4-23.
25. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J 1998, 317:465-468.
26. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009, 4:1-15.
27. Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Medical Care Research Review 2004, 61:12S-30S.
28. Solberg LI. Guideline implementation: what the literature doesn't tell us. Journal on Quality Improvement 2000, 26:525-537.
29. Baker R, Cammosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2010, CD005470.
30. Mittman BS. Criteria for peer review of D/I funding applications 2010, Missouri: St. Louis.
31. Hoagwood KE, Kolko DJ. Introduction to the special section on practice contexts: a glimpse into the nether world of public mental health services for children and families. Adm Policy Ment Health 2009, 36:35-36.
32. Proctor EK, Rosen A. From knowledge production to implementation: research challenges and imperatives. Res Soc Work Pract 2008, 18:285-291.
33. Garland AF, Bickman L, Chorpita BF. Change what? Identifying quality improvement targets by investigating usual mental health care. Adm Policy Ment Health 2010, 37:15-26.
34. Schoenwald SK, Chapman JE, Kelleher K, Hoagwood KE, Landsverk J, Stevens J, Glisson C, Rolls-Reutz J. A survey of the infrastructure for children's mental health services: implications for the implementation of empirically supported treatments (ESTs). Adm Policy Ment Health 2008, 35:84-97.
35. Fixsen DL, Blase KA, Naoom SF, Wallace F. A National Plan of Implementation Research 2005, Chapel Hill, N. C.: National Implementation Research Network.
36. Grol R, Wensing M. Effective implementation: a model. Improving patient care: The implementation of change in clinical practice 2005, 41-57. Edinburgh: Elsevier, Grol R, Wensing M, Eccles M.
37. Proctor EK, Landsverk J, Aarons GA, Chambers DA, Glisson C, Mittman BS. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health 2009, 36:24-34.
38. Ferlie E. Organizational interventions. Knowledge translation in health care: Moving from evidence to practice 2009, 144-150. Oxford, UK: Wiley-Blackwell, Straus S, Tetroe J, Graham ID.
39. Grol R, Bosch MC, Hulscher MEJ, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q 2007, 85:93-138.
40. Rogers EM. Diffusion of Innovations 2003, New York: Free Press, 5.
41. Fraser MW, Richman JM, Galinsky MJ, Day SH. Intervention Research: Developing Social Programs 2009, Oxford: New York.
42. Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. The role of organizational processes in dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice 2012, 128-153. New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK.
43. Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, Green P. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health 2008, 35:98-113.
44. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004, 82:581-629.
45. Glisson C. Assessing and changing organizational culture and climate for effective services. Res Soc Work Pract 2007, 17:736-747.
46. Glisson C, Schoenwald SK, Kelleher K, Landsverk J, Hoagwood KE, Mayberg S, Green P. Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Adm Policy Ment Health 2008, 35:124-33.
47. Glisson C, Green P. The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Adm Policy Ment Health 2006, 33:433-48.
48. Glisson C, Hemmelgarn A. The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse Negl 1998, 22:401-21.
49. Glisson C, Hemmelgarn A, Green P, Williams NJ. Randomized trial of the availability, responsiveness and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. Journal of the American Academy of Child & Adolescent Psychiatry 2013, 52:493-500.
50. Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv 2006, 3:61-72.
51. Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci 2013, 8:1-11.
52. Bradley EH, Curry LA, Ramanadhan S, Rowe L, Nembhard IM, Krumholz HM. Research in action: using positive deviance to improve quality of health care. Implement Sci 2009, 4:1-11.
53. Pascale R, Sternin J, Sternin M. The Power of Positive Deviance: How Unlikely Innovators Solve the World's Toughest Problems 2010, Boston, MA: Harvard Business Press.
54. Aarons GA, Palinkas LA. Implementation of evidence-based practice in child welfare: service provider perspectives. Administrative Policy in Mental Health & Mental Health Services Research 2007, 34:411-419.
55. Pressman JL, Wildavsky A. Implementation: How Great Expectations in Washington Are Dashed in Oakland; or, Why It's Amazing That Federal Programs Work at All, This Being a Saga of the Economic Development Administration as Told by Two Sympathetic Observers Who Seek to Build Morals on a Foundation of Ruined Hopes 1984, Berkeley: University of California Press, 3.
56. Stake RE. Multiple Case Study Analysis 2005, New York: Guilford Press.
57. Yin RK. Case Study Research: Design and Methods 2009, Thousand Oaks, CA: Sage, 4, [Applied Social Research Methods Series].
58. Wensing M, Eccles M, Grol R. Observational evaluations of implementation strategies. Improving patient care: The implementation of change in clinical practice 2005, 248-255. Edinburgh: Elsevier, Grol R, Wensing M, Eccles M.
59. Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat 2012, 17:67-79.
60. Berwick DM. The science of improvement. JAMA 2008, 299:1182-1184.
61. Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Gasziou P, Ilott I, Kinmonth ALL, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B. An implementation research agenda. Implement Sci 2009, 4:1-7.
62. Institute of Medicine The State of Quality Improvement and Implementation Research: Workshop Summary 2007, Washington, DC: The National Academies Press, Institute of Medicine.
63. Landsverk J, Brown CH, Reutz JR, Palinkas LA, Horwitz SM. Design elements in implementation research: a structured review of child welfare and child mental health studies. Adm Policy Ment Health 2011, 38:54-63.
64. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed methods designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research 2011, 38:44-53.
65. Glisson C, Proctor EK. Testing an Organizational Implementation Strategy in Children's Mental Health 2009, National Institute of Mental Health (R01 MH084855), http://projectreporter.nih.gov/project_info_description.cfm?aid=8460576&icde=17345134&ddparam=&ddvalue=&ddsub=&cr=1&csb=default&cs=ASC.
66. Glisson C, Hemmelgarn A, Green P, Dukes D, Atkinson S, Williams NJ. Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child & Adolescent Psychiatry 2012, 51:780-787.
67. Small ML. "How many cases do I need?": on science and the logic of case selection in field based research. Ethnography 2009, 10:5-38.
68. Marshall MN. Sampling for qualitative research. Fam Pract 1996, 13:522-525.
69. Golden BR. The past is the past - or is it? The use of retrospective accounts as indicators of past strategy. Acad Manage J 1992, 35:848-860.
70. Guest G, Bunce A, Johnson L. How many interviews are enough?: an experiment with data saturation and variability. Field Methods 2006, 18:59-82.
71. Denzin NK, Lincoln YS. The SAGE Handbook of Qualitative Research 2011, Thousand Oaks, CA: Sage, 4.
72. Bernard HR. Research Methods in Anthropology: Qualitative and Quantitative Approaches 2011, Lanham, Maryland: AltaMira Press, 5.
73. Barbour R. Doing Focus Groups 2007, Thousand Oaks, CA: Sage.
74. Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons GA, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research 2011, 38:65-76.
75. Rabin BA, Purcell P, Naveed S, Moser RP, Henton MD, Proctor EK, Brownson RC, Glasgow RE. Advancing the application, quality and harmonization of implementation science measures. Implement Sci 2012, 7:1-11.
76. SIRC Measures Project http://www.seattleimplementation.org/sirc-projects/sirc-instrument-project/.
77. Forman J, Damschroder L. Qualitative content analysis. Empirical methods for bioethics: A primer 2008, 11:39-62. Amsterdam: Elsevier, Jacoby L, Siminoff LA, Advances in Bioethics.
78. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005, 15:1277-1288.
79. Kohlbacher F. The use of qualitative content analysis in case study research. Forum: Qualitative Social Research 2006, 7. http://www.qualitative-research.net/index.php/fqs/article/view/75/154.
80. Mayring P. Qualitative content analysis. Forum: Qualitative Social Research 2000, 1. http://www.qualitative-research.net/index.php/fqs/article/view/1089/2386.
81. Forsner T, Hansson J, Brommels M, Wistedt AA, Forsell Y. Implementing clinical guidelines in psychiatry: a qualitative study of perceived facilitators and barriers. BMC Psychiatry 2010, 10:1-10.
82. Hysong SJ, Best RG, Pugh JA. Clinical practice guideline implementation strategy patterns in veterans affairs primary care clinics. Health Serv Res 2007, 42:84-103.
83. Magnabosco JL. Innovations in mental health services implementation: a report on state-level data from the U.S. evidence-based practices project. Implement Sci 2006, 1:1-11.
84. Miles MB, Huberman AM. Qualitative Data Analysis 1994, Thousand Oaks, CA: Sage, 2.
85. Krippendorff K. Content Analysis: An Introduction to Its Methodology 2003, Thousand Oaks, CA: Sage Publications, 2.
86. Bowman C, Ambrosini V. Using single respondents in strategy research. Br J Manag 1997, 8:119-131.
87. Voss C, Tsikriktsis N, Frohlich M. Case research in operations management. International Journal of Operations & Production Management 2002, 22:195-219.
88. Creswell JW, Plano Clark VL. Designing and Conducting Mixed Methods Research 2011, Thousand Oaks, CA: Sage, 2.
89. Killaspy H, Johnson S, Pierce B, Bebbington P, Pilling S, Nolan F, King M. Successful engagement: a mixed methods study of the approaches of community treatment and community mental health teams in the REACT trial. Soc Psychiatry Psychiatr Epidemiol 2009, 44:532-540.
90. Isett KR, Burnam MA, Coleman-Beattie B, Hyde PS, Morrissey JP, Magnabosco J, Rapp CA, Ganju V, Goldman HH. The state policy context of implementation issues for evidence-based practices in mental health. Psychiatr Serv 2007, 58:914-921.
91. Chambers DA. Forward. Dissemination and implementation research in health: Translating science to practice 2012, New York: Oxford University Press, Brownson RC, Colditz GA, Proctor EK, vii-x.
92. Scheirer MA. Linking sustainability research to intervention types. Am J Public Health 2013, 103(4):e73-e80.
93. Cook JM, O'Donnell C, Dinnen S, Coyne JC, Ruzek JI, Schnurr PP. Measurement of a model of implementation for health care: toward a testable theory. Implement Sci 2012, 7:1-15.
94. Clancy CM, Slutsky JR. Guidelines for guidelines: we've come a long way. CHEST 2007, 132:746-747.