Leadership, Organizational Climate, and Perceived Burden of Evidence-Based Practice in Mental Health Services

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 43, Issue 5, 2016, Pages 629-639

  Brimhall, Kim C ^a   Fenwick, Karissa ^a   Farahnak, Lauren R ^b,c   Hurlburt, Michael S ^a,c   Roesch, Scott C ^d   Aarons, Gregory A ^b,c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c CHILD AND ADOLESCENT SERVICES RESEARCH CENTER   (United States)

^d SAN DIEGO STATE UNIVERSITY   (United States)

Author keywords

Attitudes; Evidence based practice; Organizational climate; Transformational leadership

Indexed keywords

ADULT; EVIDENCE BASED PRACTICE; FEMALE; HEALTH PERSONNEL ATTITUDE; HUMAN; LEADERSHIP; MALE; MENTAL HEALTH SERVICE; MIDDLE AGED; MULTILEVEL ANALYSIS; ORGANIZATION AND MANAGEMENT; ORGANIZATIONAL CULTURE; QUESTIONNAIRE;

ADULT; ATTITUDE OF HEALTH PERSONNEL; EVIDENCE-BASED PRACTICE; FEMALE; HUMANS; LEADERSHIP; MALE; MENTAL HEALTH SERVICES; MIDDLE AGED; MULTILEVEL ANALYSIS; ORGANIZATIONAL CULTURE; SURVEYS AND QUESTIONNAIRES;

EID: 84936804806     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-015-0670-9     Document Type: Article

References (75)

1. Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57, 1162–1169.
2. Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39, 331–340. doi:10.1007/s10488-010-0302-3.
3. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11. doi:10.1186/s13012-014-0192-y.
4. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. doi:10.1146/annurev-publhealth-032013-182447.
5. Aarons, G. A., Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. (2010). Psychometric properties and U.S. national norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment, 22, 356–365. doi:10.1037/a0019188.
6. Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration and Policy in Mental Health and Mental Health Services Research, 34, 465–469. doi:10.1007/s10488-007-0127-x.
7. Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419. doi:10.1007/s10488-007-0121-3.
8. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33, 289–301. doi:10.1007/s10488-006-0039-1.
9. Aarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011). The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychological Services, 8, 269–281. doi:10.1037/a0026196.
10. Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99, 2087–2095. doi:10.2105/AJPH.2009.161711.
11. American Academy of Child & Adolescent Psychiatry. (2006). Evidence based practice. Retrieved from: http://www.aacap.org/AACAP/Policy_Statements/2006/Evidence_Based_Practice.aspx.
12. American Psychological Association. (2005). Policy statement on evidence-based practice in psychology. Retrieved from http://www.apa.org/practice/guidelines/evidence-based-statement.aspx.
13. Arthur, C. A., & Hardy, L. (2014). Transformational leadership: A quasi-experiment study. Leadership & Organization Development Journal, 35, 38–53. doi:10.1108/LODJ-03-2012-0033.
14. Barling, J., Weber, T., & Kelloway, E. K. (1996). Effects of transformational leadership training on attitudinal and financial outcomes: A field experiment. Journal of Applied Psychology, 81, 827–832.
15. Bass, B. M. (1999). Two decades of research and development in transformational leadership. European Journal of Work and Organizational Psychology, 8, 9–32.
16. Bass, B., & Avolio, B. (1995). MLQ: multifactor leadership questionnaire: technical report. Palo Alto, CA: Mind Garden.
17. Bass, B. M., & Avolio, B. J. (1997). Full range leadership development: manual for the multifactor leadership questionnaire. Palo Alto, CA: Mind Garden.
18. Bass, B. M., & Riggio, R. E. (2006). Transformational leadership (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
19. Bastien, D. T., McPhee, R. D., & Bolton, K. A. (1995). A study and extended theory of the structuration of climate. Communications Monographs, 62(2), 87–109.
20. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30. doi:10.1111/j.1468-2850.2009.01187.x.
21. Beidas, R. S., & Kendall, P. C. (2014). Dissemination and implementation of evidence-based practices in child and adolescent mental health. New York, NY: Oxford University Press.
22. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349–381). San Francisco, CA: Jossey-Bass.
23. Brown, R. D. (2000, April). Interrater agreement reconsidered: The role of maximum possible variance. Paper presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
24. Brown, R. D., & Hauenstein, N. M. A. (2005). Interrater agreement reconsidered: An alternative to the rwg indices. Organizational Research Methods, 8, 165–184.
25. Bruns, E. J., Hoagwood, K. E., Rivard, J. C., Wotring, J., Marsenich, L., & Carter, B. (2008). State implementation of evidence-based practice for youths, part II: Recommendations for research and policy. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 499–504.
26. Carlson, M., Wilcox, R., Chou, C., Chang, M., Yang, F., Blanchard, J., et al. (2011). Psychometric properties of reverse-scored items on the CES-D in a sample of ethnically diverse older adults. Psychological Assessment, 23, 558–562.
27. Cashin, C., Scheffler, R., Felton, M., Adams, N., & Miller, L. (2008). Transformation of the California mental health system: Stakeholder-driven planning as a transformational activity. Psychiatric Services, 59, 1107–1114.
28. Conrad, K. J., Wright, B. D., McKnight, P., McFall, M., Fontana, A., & Rosenheck, R. (2004). Comparing traditional and Rasch analyses of the Mississippi PTSD scale: Revealing limitations of reverse-scored items. Journal of Applied Measurement, 5, 15–30.
29. Darkes, J., Greenbaum, P. E., & Goldman, M. S. (1998). Sensation seeking-disinhibition and alcohol use: Exploring issues of criterion contamination. Psychological Assessment, 10, 71–76. doi:10.1037/1040-3590.10.1.71.
30. Donnelly, M. (1994). Managing people and quality in a climate of change. Managing Service Quality: An International Journal, 4(4), 41–44. doi:10.1108/09604529410065261.
31. Fisher, D. M. (2014). A multilevel cross-cultural examination of role overload and organizational commitment: Investigating the interactive effects of context. Journal of Applied Psychology, 99(4), 723. doi:10.1037/a0035861.
32. Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281. doi:10.2105/AJPH.2012.300755.
33. Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare settings. Child Abuse and Neglect, 35, 582–591.
34. Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse and Neglect, 22, 401–421. doi:10.1016/S0145-2134(98)00005-2.
35. Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., & Research Network on Youth Mental Health. (2008a). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98–113. doi:10.1007/s10488-007-0148-5.
36. Glisson, C., Shoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., et al. (2008b). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35, 124–133. doi:10.1007/s10488-007-0152-9.
37. Grant, A. M. (2012). Leading with meaning: Beneficiary contact, prosocial impact, and the performance effects of transformational leadership. Academy of Management Journal, 55, 458–476. doi:10.5465/amj.2010.0588.
38. Hayes, A. F. (2009). Beyond Baron and Kenny: Statistical mediation analysis in the new millennium. Communication Monographs, 76(4), 408–420. doi:10.1080/03637750903310360.
39. Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567. doi:10.1037/0022-006X.76.4.556.
40. Jacobs, S. R., Weiner, B. J., & Bunger, A. C. (2014). Context matters: measuring implementation climate among individuals and groups. Implementation Science, 9, 46. doi:10.1186/1748-5908-9-46.
41. Kearney, E., & Gebert, D. (2009). Managing diversity and enhancing team outcomes: The promise of transformational leadership. Journal of Applied Psychology, 94, 77–89. doi:10.1037/a0013077.
42. Keller, R. T. (2006). Transformational leadership, initiating structure, and substitutes for leadership: A longitudinal study of research and development project team performance. Journal of Applied Psychology, 91, 202–210. doi:10.1037/0021-9010.91.1.202.
43. Kenny, D. A., & Judd, C. M. (1996). A general procedure for the estimation of interdependence. Psychological Bulletin, 119(1), 138–148. doi:10.1037/0033-2909.119.1.138.
44. Kirkbride, P. (2006). Developing transformational leaders: The full range leadership model in action. Industrial and Commercial Training, 38, 23–32. doi:10.1108/00197850610646016.
45. Krishnan, V. R. (2012). Transformational leadership and personal outcomes: Empowerment as mediator. Leadership & Organization Development Journal, 33, 550–563. doi:10.1108/01437731211253019.
46. Laschinger, H. K. S., Finegan, J., & Shamian, J. (2001). The impact of workplace empowerment, organizational trust on staff nurses’ work satisfaction and organizational commitment. Health Care Management Review, 26(3), 7–23.
47. Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout. Annual Review of Psychology, 52, 397–422. doi:10.1146/annurev.psych.52.1.397.
48. McArdle, J. J. (2013). Dealing with longitudinal attrition using logistic regression and decision tree analyses. In J. J. McArdle & G. Ritschard (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 282–311). New York: Taylor & Frances.
49. McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84. doi:10.1037/a0018121.
50. Mok, E., & Au-Yeung, B. (2002). Relationship between organizational climate and empowerment of nurses in Hong Kong. Journal of Nursing Management, 10(3), 129–137. doi:10.1046/j.1365-2834.2002.00285.x.
51. Mullen, J. E., & Kelloway, E. K. (2009). Safety leadership: A longitudinal study of the effects of transformational leadership on safety outcomes. Journal of Occupational and Organizational Psychology, 82(2), 253–272. doi:10.1348/096317908X325313.
52. Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
53. Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12(4), 531–544.
54. Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco, CA: Jossey-Bass.
55. Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reserve of social anxiety is not always the opposite: The reverse-scored items of the social interaction anxiety scale do not belong. Behavior Therapy, 38, 192–206.
56. Rubin, D. B. (1996). Multiple imputation after 18+ years. Journal of American Statistical Association, 91, 473–489. doi:10.2307/2291635.
57. Sarros, J. C., Cooper, B. K., & Santora, J. C. (2008). Building a climate for innovation through transformational leadership and organizational culture. Journal of Leadership & Organizational Studies, 15, 145–158.
58. Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177. doi:10.1037/1082-989X.7.2.147.
59. Scheffer, J. (2002). Dealing with missing data. Research Letters in the Information and Mathematical Sciences, 3, 153–160.
60. Schneider, B., Ehrhart, M. G., & Macey, W. H. (2013). Organizational climate and culture. Annual Review of Psychology, 64, 361–388. doi:10.1146/annurev-psych-113011-143809.
61. Seibert, S. E., Silver, S. R., & Randolph, W. A. (2004). Taking empowerment to the next level: A multiple-level model of empowerment, performance, and satisfaction. Academy of Management Journal, 47(3), 332–349. http://www.jstor.org/stable/20159585.
62. Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2011). Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: the triple p-positive parenting program. Child Maltreatment, 17, 86–95. doi:10.1146/annurev-clinpsy-032511-143104.
63. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.
64. Siu, O. L., Lu, L., & Cooper, C. L. (1999). Managerial stress in Hong Kong and Taiwan: A comparative study. Journal of Managerial Psychology, 14(1), 6–25. doi:10.1108/02683949910254675.
65. Sivasubramaniam, N., Murry, W. D., Avolio, B. J., & Jung, D. I. (2002). A longitudinal model of the effects of team leadership and group potency on group performance. Group and Organization Management, 27, 66–96. doi:10.1177/1059601102027001005.
66. Spector, P. E. (2006). Method variance in organizational research truth or urban legend? Organizational Research Methods, 9, 221–232.
67. Spreitzer, G. M. (1996). Social structural characteristics of psychological empowerment. Academy of Management Journal, 39(2), 483–504. http://www.jstor.org/stable/256789.
68. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson.
69. Tofighi, D., & MacKinnon, D. P. (2011). RMediation: An R package for mediation analysis confidence intervals. Behavior Research Methods, 43, 692–700. doi:10.3758/s13428-011-0076-x.
70. Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: The relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research, 39, 353–364. doi:10.1007/s10488-011-0357-9.
71. Wang, G., Oh, I.-S., Courtright, S. H., & Colbert, A. E. (2011). Transformational leadership and performance across criteria and levels: A meta-analytic review of 25 years of research. Group and Organization Management, 36, 223–270. doi:10.1177/1059601111401017.
72. Warren-Gross, L. (2009). How does a failing school stop failing? Knowledge Quest, 38(2), 40–43.
73. Zohar, D. (1980). Safety climate in industrial organizations: Theoretical and applied implications. Journal of Applied Psychology, 65, 96–102.
74. Zohar, D., & Luria, G. (2010). Group leaders as gatekeepers: Testing safety climate variations across levels of analysis. Applied Psychology, 59, 647–673. doi:10.1111/j.1464-0597.2010.00421.x.
75. Zohar, D., & Polachek, T. (2014). Discourse-based intervention for modifying supervisory communication as leverage for safety climate and performance improvement: A randomized field study. Journal of Applied Psychology, 99(1), 113. doi:10.1037/a0034096.