The Roles of System and Organizational Leadership in System-Wide Evidence-Based Intervention Sustainment: A Mixed-Method Study

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 43, Issue 6, 2016, Pages 991-1008

  Aarons, Gregory A ^a,b   Green, Amy E ^a,b   Trott, Elise ^c,d   Willging, Cathleen E ^c,d   Torres, Elisa M ^a,b   Ehrhart, Mark G ^e   Roesch, Scott C ^b,e  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CHILD AND ADOLESCENT SERVICES RESEARCH CENTER   (United States)

^c PACIFIC INSTITUTE FOR RESEARCH AND EVALUATION   (United States)

^d UNIVERSITY OF NEW MEXICO   (United States)

^e SAN DIEGO STATE UNIVERSITY   (United States)

Author keywords

EPIS; Evidence based practice; Healthcare; Leadership; Mixed methods; Sustainability

Indexed keywords

CALIFORNIA; CAREGIVER; CHILD ABUSE; CHILD HEALTH CARE; CHILD WELFARE; EDUCATION; EVIDENCE BASED PRACTICE; HEALTH CARE PERSONNEL; HEALTH PERSONNEL ATTITUDE; HUMAN; INFANT; INFORMATION PROCESSING; LEADERSHIP; MENTAL HEALTH SERVICE; NEWBORN; PRESCHOOL CHILD; PREVENTION AND CONTROL; PROGRAM EVALUATION; PUBLIC HEALTH; QUALITATIVE RESEARCH;

ATTITUDE OF HEALTH PERSONNEL; CALIFORNIA; CAREGIVERS; CHILD ABUSE; CHILD HEALTH SERVICES; CHILD WELFARE; CHILD, PRESCHOOL; EVIDENCE-BASED PRACTICE; FOCUS GROUPS; HEALTH PERSONNEL; HUMANS; INFANT; INFANT, NEWBORN; LEADERSHIP; MENTAL HEALTH SERVICES; PROGRAM EVALUATION; PUBLIC HEALTH; QUALITATIVE RESEARCH;

EID: 84979287939     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-016-0751-4     Document Type: Article

References (100)

1. Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57(8), 1162–1169.
2. Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014a). The Implementation Leadership Scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 45.
3. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11.
4. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014b). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274.
5. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. (in press). Discrepancies in leader and follower ratings of transformational leadership: Relationships with organizational culture in mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0672-7.
6. Aarons, G. A., Fettes, D. L., Flores, L. E., & Sommerfeld, D. H. (2009a). Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy, 47(11), 954–960.
7. Aarons, G. A., Fettes, D. L., Sommerfeld, D. H., & Palinkas, L. A. (2012a). Mixed methods for implementation research: Application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreatment, 17(1), 67–79.
8. Aarons, G. A., Green, A. E., Palinkas, L. A., Self-Brown, S., Whitaker, D. J., Lutzker, J. R., … Chaffin, M. J. (2012b). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7(32), 1–9.
9. Aarons, G. A., Green, A. E., Willging, C. E., Ehrhart, M. G., Roesch, S. C., Hecht, D. B., et al. (2014c). Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implementation Science, 9(1), 183–195.
10. Aarons, G. A., Horowitz, J. D., Dlugosz, L. R., & Ehrhart, M. G. (2012c). The role of organizational processes in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press.
11. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011a). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.
12. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3(1), 61–72.
13. Aarons, G. A., & Sommerfeld, D. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy Child and Adolescent Psychiatry, 51(4), 423–431.
14. Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009b). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77(2), 270–280.
15. Aarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011b). The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychological Services, 8(4), 269–281.
16. Antonakis, J., Avolio, B. J., & Sivasubramaniam, N. (2003). Context and leadership: An examination of the nine-factor full-range leadership theory using the Multifactor Leadership Questionnaire. Leadership Quarterly, 14(3), 261–295.
17. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285.
18. Avolio, B. J., Bass, B. M., & Jung, D. I. (1999). Re-examining the components of transformational and transactional leadership using the Multifactor Leadership Questionnaire. Journal of Occupational and Organizational Psychology, 72, 441–462.
19. Bain, P. G., Mann, L., & Pirola-Merlo, A. (2001). The innovative imperative: The relationships between team climate, innovation, and performance in research and development teams. Small Group Research, 32, 55–73.
20. Bass, B. M., & Avolio, B. J. (1995). MLQ: Multifactor leadership questionnaire. Technical Report. Binghamton University, NY: Center for Leadership Studies.
21. Boatwright, K. J., & Forrest, L. (2000). Leadership preferences: The influence of gender and needs for connection on workers’ ideal preferences for leadership behaviors. Journal of Leadership & Organizational Studies, 7(2), 18–34.
22. Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal. doi:10.1155/2014/802983.
23. Bunger, A. C., Collins-Camargo, C., McBeath, B., Chuang, E., Pérez-Jolles, M., & Wells, R. (2014). Collaboration, competition, and co-opetition: Interorganizational dynamics between private child welfare agencies and child serving sectors. Children and Youth Services Review, 38, 113–122.
24. Chaffin, M., Hecht, D., Bard, D., Silovsky, J. F., & Beasley, W. H. (2012). A statewide trial of the SafeCare home-based services model with parents in Child Protective Services. Pediatrics, 129(3), 509–515.
25. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52(1), 685–716.
26. Chen, L. Y., & Barnes, F. B. (2006). Leadership behaviors and knowledge sharing in professional service firms engaged in strategic alliances. Journal of Applied Management and Entrepreneurship, 11(2), 51–70.
27. Chreim, S., Williams, B. B., & Coller, K. E. (2012). Radical change in healthcare organization: Mapping transition between templates, enabling factors, and implementation processes. Journal of Health Organization and Management, 26(2), 215–236.
28. Collins, K. M., Onwuegbuzie, A. J., & Jiao, Q. G. (2007). A mixed methods investigation of mixed methods sampling designs in social and health science research. Journal of Mixed Methods Research, 1(3), 267–294.
29. Conger, J. A., & Kanungo, R. N. (1988). Charismatic leadership: The elusive factor in organizational effectiveness. San Francisco: Jossey-Bass.
30. Corbin, J., & Strauss, A. (2008). Basics of qualitative research: Techniques and procedures for developing grounded theory (3rd ed.). Thousand Oaks, CA: Sage.
31. Corrigan, P. W., Lickey, S. E., Campion, J., & Rashid, F. (2000). Mental health team leadership and consumers’ satisfaction and quality of life. Psychiatric Services, 51(6), 781–785.
32. Damanpour, F., & Schneider, M. (2006). Phases of the adoption of innovation in organizations: Effects of environment, organization and top managers. British Journal of Management, 17(3), 215–236.
33. Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50–64.
34. Demakis, J. G., McQueen, L., Kizer, K. W., & Feussner, J. R. (2000). Quality Enhancement Research Initiative (QUERI): A collaboration between research and clinical practice. Medical Care, 38, 17–25.
35. Dhar, R. L. (2015). Transformational leadership and employee creativity. Management Decision, 53(5), 894–910.
36. Eggleston, K., & Bhagat, R. (1993). Organizational contexts and contingent leadership roles: A theoretical exploration. Human Relations, 46(10), 1177–1191.
37. Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9, 157.
38. Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine de Gruyter.
39. Gray, M. J., Elhai, J. D., & Schmidt, L. O. (2007). Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behavior Modification, 31(6), 732.
40. Green, A. E., Trott, E., Willging, C. E., Finn, N. K., Ehrhart, M. G., & Aarons, G. A. (2016). The role of collaborations in sustaining an evidence-based intervention to reduce child neglect. Child Abuse and Neglect, 53, 4–16.
41. Greene, J. C. (2006). Toward a methodology of mixed methods social inquiry. Research in the Schools, 13(1), 93–98.
42. Greenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Russell, J., Hinder, S., et al. (2010). Adoption and non-adoption of a shared electronic summary record in England: A mixed-method case study. British Medical Journal, 340, c3111.
43. Grimes, J., Kurns, S., & Tilly, W. D. I. (2006). Sustainability: An enduring commitment to success. School Psychology Review, 35(2), 224–244.
44. Gumusluoglu, L., & Ilsev, A. (2009). Transformational leadership, creativity, and organizational innovation. Journal of Business Research, 62(4), 461–473.
45. Guth, W. D., & Macmillan, I. C. (1986). Strategy implementation versus middle management self-interest. Strategic Management Journal, 7(4), 313–327.
46. Harvey, G., Fitzgerald, L., Fielden, S., McBride, A., Waterman, H., Bamford, D., … Boaden, R. (2011). The NIHR collaboration for leadership in applied health research and care (CLAHRC) for Greater Manchester: Combining empirical, theoretical and experiential evidence to design and evaluate a large-scale implementation strategy. Implementation Science, 6(1), 96.
47. Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., et al. (2008). Statewide adoption and initial implementation of contingency management for substance abusing adolescents. Journal of Consulting and Clinical Psychology, 76(4), 556–567.
48. Hetland, H., & Sandal, G. (2003). Transformational leadership in Norway: Outcomes and personality correlates. European Journal of Work and Organizational Psychology, 12(2), 147–170.
49. Hill, N., Seo, M., Kang, J., & Taylor, M. (2012). Building employee commitment to change across organizational levels: The influence of hierarchical distance and direct managers’ transformational leadership. Organization Science, 23(3), 758–777.
50. Hunt, J. G. (1991). Leadership: A new synthesis. Thousand Oaks, CA: Sage.
51. Institute of Medicine [IOM]. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.
52. Jacobs, S. R., Weiner, B. J., & Bunger, A. C. (2014). Context matters: Measuring implementation climate among individuals and groups. Implementation Science, 9(1), 46.
53. Johnson, R. B., Onwuegbuzie, J. A., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133.
54. Jung, D., Chow, C., & Wu, A. (2003). The role of transformational leadership in enhancing organizational innovation: Hypotheses and some preliminary findings. Leadership Quarterly, 14, 525–544.
55. Jyoti, J., & Dev, M. (2015). The impact of transformational leadership on employee creativity: The role of learning orientation. Journal of Asia Business Studies, 9(1), 78–98.
56. Kinjerski, V., & Skrypnek, B. J. (2008). The promise of spirit at work: Increasing job satisfaction and organizational commitment and reducing turnover and absenteeism in long-term care. Journal of Gerontological Nursing, 34(10), 17–25.
57. Klein, K. J., Dansereau, F., & Hall, R. J. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19(2), 195–229.
58. Klein, K. J., & Kozlowski, S. W. J. (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. San Francisco: Jossey-Bass.
59. Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21(4), 1055–1080.
60. Kyratsis, Y., Ahmad, R., & Holmes, A. (2012). Making sense of evidence in management decisions: The role of research-based knowledge on innovation adoption and implementation in healthcare. Study protocol. Implementation Science, 7(1), 22.
61. Larsen, T., & Samdal, O. (2007). Implementing second step: Balancing fidelity and program adaptation. Journal of Educational and Psychological Consultation, 17(1), 1–29.
62. Leithwood, K., & Jantzi, D. (2006). Transformational school leadership for large-scale reform: Effects on students, teachers, and their classroom practices. School Effectiveness and School Improvement, 17(2), 201–227.
63. ®: Towards wide-scale implementation of a child maltreatment prevention program. International Journal of Child Health and Human Development, 2, 7–15.
64. Mancini, J. A., & Marek, L. I. (1998). Patterns of project survival and organizational support: The national youth at risk program sustainability study (Virginia Cooperative Extension Publication 350–800).
65. Mancini, J. A., & Marek, L. I. (2004). Sustaining community-based programs for families: Conceptualization and measurement. Family Relations, 53(4), 339–347.
66. Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480.
67. Michaelis, B., Stegmaier, R., & Sonntag, K. (2009). Affective commitment to change and innovation implementation behavior: The role of charismatic leadership and employees’ trust in top management. Journal of Change Management, 9(4), 399–417.
68. Michaelis, B., Stegmaier, R., & Sonntag, K. (2010). Shedding light on followers’ innovation implementation behavior: The role of transformational leadership, commitment to change, and climate for initiative. Journal of Managerial Psychology, 25(4), 408–429.
69. Muthén, L. K., & Muthén, B. O., (1998-2015). Mplus User’s Guide. (7th ed.). Los Angeles, CA: Muthén & Muthén
70. Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child & Adolescent Psychiatry, 52(10), 1009–1025.e1018.
71. O’Reilly, C. A., Caldwell, D. F., Chatman, J. A., Lapiz, M., & Self, W. (2010). How leadership matters: The effects of leaders’ alignment on strategy implementation. Leadership Quarterly, 21(1), 104–113.
72. Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53.
73. Patton, M. Q. (2002). Qualitative analysis and interpretation. In Qualitative research and evaluation methods (3rd ed., pp. 431–539). Thousand Oaks, CA: Sage.
74. Patton, M. Q. (2015). Qualitative research and evaluation methods: Integrating theory and methods (4th ed.). Thousand Oaks, CA: Sage.
75. Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
76. QSR International. (2012). NVivo qualitative data analysis software (Version 10).
77. Rogers, C., & Farson, R. (1955). Active listening. Chicago: University of Chicago.
78. Saad, M. S. M., & Mazzarol, T. (2014). Enhancing and sustaining organizational innovative performance through transformational leadership. Innovation, 13, 17.
79. Schein, E. (2010). Organizational culture and leadership. San Francisco: Wiley.
80. Scott, S. G., & Bruce, R. A. (1994). Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of Management Journal, 37(3), 580–607.
81. Skolarus, T. A., & Sales, A. E. (2014). Who uses what model? Assessing models for dissemination and implementation research using citation analysis. Paper presented at the 7th Annual NIH conference on the science of dissemination and implementation, Bethesda, MD.
82. Sloan, R., & Gruman, J. (1988). Participation in workplace health promotion programs: The contribution of health and organizational factors. Health Education and Behavior, 15(3), 269–288.
83. Soh, K. L., Davidson, P. M., Gavin, L., DiGiacomo, M., Rolley, J. X., Soh, K. G., et al. (2011). Factors to drive clinical practice improvement in a Malaysian intensive care unit: Assessment of organisational readiness using a mixed method approach. International Journal of Multiple Research Approaches, 5(1), 104–121.
84. Spinelli, R. J. (2006). The applicability of Bass’s model of transformational, transactional, and laissez-faire leadership in the hospital administrative environment. Hospital Topics, 84(2), 11–19.
85. Stagner, R. (1969). Corporate decision making: An empirical study. Journal of Applied Psychology, 53(1), 1–13.
86. Stamatakis, K. A., Vinson, C. A., & Kerner, J. F. (2012). Dissemination and implementation research in community and public health settings. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press.
87. Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., … Wallace, C. M. (2006). Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1, 23.
88. Stetler, C. B., Ritchie, J. A., Rycroft-Malone, J., Schultz, A. A., & Charns, M. P. (2009). Institutionalizing evidence-based practice: An organizational case study using a model of strategic change. Implementation Science, 4(78), 1–19.
89. Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., & Castro, F. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7(17), 1–19. doi:10.1186/1748-5908-7-17.
90. Tashakkori, A., & Teddlie, C. (2003). Issues and dilemmas in teaching research methods courses in social and behavioural sciences: US perspective. International Journal of Social Research Methodology: Theory & Practice, 6(1), 61–77.
91. Teddlie, C., & Yu, F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77–100.
92. U.S. Census Bureau. (2010). State & county Quickfacts. Retrieved from http://quickfacts.census.gov.
93. von Thiele Schwarz, U., Hasson, H., & Tafvelin, S. (2016). Leadership training as an occupational health intervention: Improved safety and sustained productivity. Safety Science, 81, 35–45.
94. Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 1.
95. Wike, T., Bledsoe, S., Manuel, J., Despard, M., Johnson, L., Bellamy, J., et al. (2014). Evidence-based practice in social work: Challenges and opportunities for clinicians and organizations. Clinical Social Work Journal, 42(2), 161–170.
96. Willging, C. E., Aarons, G. A., Trott, E. M., Green, A. E., Finn, N. K., Ehrhart, M. G., & Hecht, D. B. (In press). Contracting and procurement for evidence-based interventions in public-sector human services: A case study. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0681-6.
97. Willging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2015). From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment, 20(1), 24–36.
98. Wong, C., & Giallonardo, L. (2015). Leadership and its influence on patient outcomes. In Leadership and Nursing: Contemporary Perspectives (2nd ed., pp. 153–170). Sydney: Churchill Livingstone.
99. Wooldridge, B., & Floyd, S. W. (1990). The strategy process, middle management involvement, and organizational performance. Strategic Management Journal, 11(3), 231–241.
100. Wright, C., Catty, J., Watt, H., & Burns, T. (2004). A systematic review of home treatment services. Social Psychiatry and Psychiatric Epidemiology, 39(10), 789–796.