The reliability and validity of three-item screening measures for burnout: Evidence from group-employed health care practitioners in upstate New York

Stress and Health

Volumn 34, Issue 1, 2018, Pages 187-193

  Riley, Moira R ^a   Mohr, David C ^b,c   Waddimba, Anthony C ^d  

^a BASSETT HEALTHCARE   (United States)

^b VA BOSTON HEALTHCARE SYSTEM   (United States)

^c BOSTON UNIVERSITY SCHOOL OF PUBLIC HEALTH   (United States)

^d PARKLAND HEALTH AND HOSPITAL SYSTEM   (United States)

Author keywords

abbreviated Maslach burnout inventory; health care workforce; quality of work life; short form scales; stress resilience; validation studies

Indexed keywords

ACHIEVEMENT; ARTICLE; BURNOUT; CONTROLLED STUDY; CROSS-SECTIONAL STUDY; DEPERSONALIZATION; DIAGNOSTIC TEST ACCURACY STUDY; EMOTIONAL STRESS; HEALTH CARE PERSONNEL; HEALTH SURVEY; HUMAN; MASLACH BURNOUT INVENTORY; NEW YORK; PERSONAL ACHIEVEMENT; RELIABILITY; RURAL AREA; SCREENING; SENSITIVITY AND SPECIFICITY; VALIDITY; ADULT; DIAGNOSIS; FEMALE; JOB SATISFACTION; MALE; MIDDLE AGED; PSYCHOLOGY; PSYCHOMETRY; REPRODUCIBILITY; RURAL HEALTH;

ADULT; BURNOUT, PROFESSIONAL; CROSS-SECTIONAL STUDIES; DEPERSONALIZATION; FEMALE; HEALTH PERSONNEL; HUMANS; JOB SATISFACTION; MALE; MIDDLE AGED; NEW YORK; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RURAL HEALTH;

EID: 85041819528     PISSN: 15323005     EISSN: 15322998     Source Type: Journal    
DOI: 10.1002/smi.2762     Document Type: Article

References (41)

1. Bean, A. G., & Roszkowski, M. J. (1995). The long and short of it: When does questionnaire length affect response rate? Marketing Research, 7(1), 20–26.
2. Bodenheimer, T., & Sinsky, C. (2014). From triple to quadruple aim: Care of the patient requires care of the provider. Annals of Family Medicine, 12(6), 573–576. https://doi.org/10.1370/afm.1713.
3. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/bf02310555.
4. Dyrbye, L. N., & Shanafelt, T. D. (2011). Physician burnout: A potential threat to successful health care reform. Journal of the American Medical Association, 305(19), 2009–2010. https://doi.org/10.1001/jama.2011.652.
5. Ensz, G. R., & Kruger, K. (2010). A solution for rural physician burnout: The creation of the Peerist. Journal of Medical Practice Management, 26(1), 53–56.
6. Fordyce, M. W. (1988). A review of research on the happiness measures: A sixty second index of happiness and mental health. Social Indicators Research, 20(4), 355–381. https://doi.org/10.1007/BF00302333.
7. Gold, K. J., Sen, A., & Schwenk, T. L. (2013). Details on suicide among U.S. physicians: Data from the national violent death reporting system. General Hospital Psychiatry, 35(1), 45–49. https://doi.org/10.1016/j.genhosppsych.2012.08.005.
8. Gwet, K. L. (2014). Handbook of inter-rater reliability, fourth edition: The definitive guide to measuring the extent of agreement among raters. Gaithersburg, MD: Advanced Analytics, LLC.
9. Harman, H. H. (1960). Modern factor analysis. Chicago, IL: University of Chicago Press.
10. Hays, R. D., Reise, S., & Calderon, J. L. (2012). How much is lost in using single items? Journal of General Internal Medicine, 27(11), 1402–1403. https://doi.org/10.1007/s11606-012-2182-6.
11. Hoeppner, B. B., Kelly, J. F., Urbanoski, K. A., & Slaymaker, V. (2011). Comparative utility of a single-item vs. multiple-item measure of self-efficacy in predicting relapse among young adults. Journal of Substance Abuse Treatment, 41(3), 305–312. https://doi.org/10.1016/j.jsat.2011.04.005.
12. Kline, R. B. (2015). Principles and practice of structural equation modeling (fourth ed.). New York, NY: Guilford Press.
13. Legassie, J., Zibrowski, E. M., & Goldszmidt, M. A. (2008). Measuring resident well-being: Impostorism and burnout syndrome in residency. Journal of General Internal Medicine, 23(7), 1090–1094. https://doi.org/10.1007/s11606-008-0536-x.
14. Leiter, M. P., Frank, E., & Matheson, T. J. (2009). Demands, values, and burnout: Relevance for physicians. Canadian Family Physician, 55(12), 1224–1225.e1226.
15. Leiter, M. P., & Shaughnessy, K. (2006). The areas of worklife model of burnout: Tests of mediation relationships. Ergonomia, 28(4), 327–341.
16. Levy, P. (1967). The correction for spurious correlation in the evaluation of short-form tests. Journal of Clinical Psychology, 23(1), 84–86.
17. Longenecker, R., Zink, T., & Florence, J. (2012). Teaching and learning resilience: Building adaptive capacity for rural practice. A report and subsequent analysis of a workshop conducted at the rural medical educators conference, Savannah, Georgia, May 18, 2010. Journal of Rural Health, 28(2), 122–127. https://doi.org/10.1111/j.1748-0361.2011.00376.x.
18. Loo, R. (2002). A caveat on using single-item versus multiple-item scales. Journal of Managerial Psychology, 17(1), 68–75. https://doi.org/10.1108/02683940210415933.
19. Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach Burnout Inventory manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press, Inc.
20. McManus, I. C., Gordon, D., & Winder, B. C. (2000). Duties of a doctor: UK doctors and good medical practice. Quality in Health Care, 9(1), 14–22.
21. McManus, I. C., Winder, B. C., & Gordon, D. (2002). The causal links between stress and burnout in a longitudinal study of UK doctors. Lancet, 359(9323), 2089–2090.
22. Montgomery, A., Panagopoulou, E., Kehoe, I., & Valkanos, E. (2011). Connecting organisational culture and quality of care in the hospital: Is job burnout the missing link? Journal of Health Organization and Management, 25(1), 108–123.
23. Moore, K. A., Halle, T. G., Vandivere, S., & Mariner, C. L. (2002). Scaling back survey scales: How short is too short? Sociological Methods & Research, 30(4), 530–567.
24. Morley, C. P. (2012). Supporting physicians who work in challenging contexts: A role for the academic health center. Journal of the American Board of Family Medicine, 25(6), 756–758. https://doi.org/10.3122/jabfm.2012.06.120250.
25. Panagopoulou, E., Montgomery, A., & Benos, A. (2006). Burnout in internal medicine physicians: Differences between residents and specialists. European Journal of Internal Medicine, 17(3), 195–200. https://doi.org/10.1016/j.ejim.2005.11.013.
26. Privitera, M. R., Rosenstein, A. H., Plessow, F., & LoCastro, T. M. (2015). Physician burnout and occupational stress: An inconvenient truth with unitended consequences. Journal of Hospital Administration, 4(1), 27–35.
27. Schaufeli, W. B., Bakker, A. B., Hoogduin, K., Schaap, C., & Kladler, A. (2001). On the clinical validity of the Maslach Burnout Inventory and the burnout measure. Psychology & Health, 16(5), 565–582.
28. Shanafelt, T. D., Boone, S., Tan, L., Dyrbye, L. N., Sotile, W., Satele, D., … Oreskovich, M. R. (2012). Burnout and satisfaction with work-life balance among U.S. physicians relative to the general U.S. population. Archives of Internal Medicine, 172(18), 1377–1385. https://doi.org/10.1001/archinternmed.2012.3199.
29. Shanafelt, T. D., Hasan, O., Dyrbye, L. N., Sinsky, C., Satele, D., Sloan, J., & West, C. P. (2015). Changes in burnout and satisfaction with work-life balance in physicians and the general U.S. working population between 2011 and 2014. Mayo Clinic Proceedings, 90(12), 1600–1613. https://doi.org/10.1016/j.mayocp.2015.08.023.
30. Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008). The Brief Resilience Scale: Assessing the ability to bounce back. International Journal of Behavioral Medicine, 15(3), 194–200. https://doi.org/10.1080/10705500802222972.
31. Spinelli, W. M. (2013). The phantom limb of the triple aim. Mayo Clinic Proceedings, 88(12), 1356–1357. https://doi.org/10.1016/j.mayocp.2013.08.017.
32. Stanton, J. M., Sinar, E. F., Balzer, W. K., & Smith, P. C. (2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55(1), 167–194. https://doi.org/10.1111/j.1744-6570.2002.tb00108.x.
33. Stevenson, A. D., Phillips, C. B., & Anderson, K. J. (2011). Resilience among doctors who work in challenging areas: A qualitative study. British Journal of General Practice, 61(588), e404–e410. https://doi.org/10.3399/bjgp11X583182.
34. Waddimba, A. C., Nieves, M. A., Scribani, M., Krupa, N., Jenkins, P., & May, J. J. (2015). Predictors of burnout among physicians and advanced-practice clinicians in central New York. Journal of Hospital Administration, 4(6), 21–30.
35. Waddimba, A. C., Scribani, M., Krupa, N., May, J. J., & Jenkins, P. (2016a). Frequency of satisfaction and dissatisfaction with practice among rural-based, group-employed physicians and non-physician practitioners. BMC Health Services Research, 16(613). https://doi.org/10.1186/s12913-016-1777-8.
36. Waddimba, A. C., Scribani, M., Nieves, M. A., Krupa, N., May, J. J., & Jenkins, P. (2016b). Validation of single-item screening measures for provider burnout in a rural health care network. Evaluation and the Health Professions, 39(2), 215–225. https://doi.org/10.1177/0163278715573866.
37. Wallace, J. E., Lemaire, J. B., & Ghali, W. A. (2009). Physician wellness: A missing quality indicator. Lancet, 374(9702), 1714–1721.
38. West, C. P., Dyrbye, L. N., Satele, D. V., Sloan, J. A., & Shanafelt, T. D. (2012). Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. Journal of General Internal Medicine, 27(11), 1445–1452. https://doi.org/10.1007/s11606-012-2015-7.
39. West, C. P., Dyrbye, L. N., Sloan, J. A., & Shanafelt, T. D. (2009). Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. Journal of General Internal Medicine, 24(12), 1318–1321. https://doi.org/10.1007/s11606-009-1129-z.
40. Yuan, K.-H., & Zhong, X. (2008). Outliers, leverage observations, and influence cases in factor analysis: Using robust procedures to minimize their effect. Sociological Methodology, 38(1), 329–368.
41. Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6(1), 21–29.