Measuring workload of ICU nurses with a questionnaire survey: the NASA Task Load Index (TLX)

IIE Transactions on Healthcare Systems Engineering

Volumn 1, Issue 2, 2011, Pages 131-143

  Hoonakker, Peter ^a   Carayon, Pascale ^a   Gurses, Ayse P ^b   Brown, Roger ^c   Khunlertkit, Adjhaporn ^a   McGuire, Kerry ^a   Walker, James M ^d  

^a University of Wisconsin Madison   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

^d GEISINGER MEDICAL CENTER   (United States)

Author keywords

intensive care units; measurement; nurses; Workload

Indexed keywords

ADULT; ARTICLE; CAREGIVER BURDEN; COGNITION; COMPARATIVE STUDY; FEMALE; FRUSTRATION; HEALTH CARE SURVEY; HEALTH SERVICE; HUMAN; INTENSIVE CARE UNIT; MAJOR CLINICAL STUDY; MALE; NURSE; PATIENT SAFETY; PRIORITY JOURNAL; QUALITY OF LIFE; QUESTIONNAIRE; RELIABILITY; SENSITIVITY ANALYSIS; SHIFT WORKER; TASK PERFORMANCE; VALIDITY; WORKLOAD;

EID: 84981165716     PISSN: 19488300     EISSN: 19488319     Source Type: Journal    
DOI: 10.1080/19488300.2011.609524     Document Type: Article

References (46)

1. Alvarado, C. J. and Carayon, P. 2007. Workload and patient safety among critical care nurses. Critical Care Nursing Clinics North America, 19: 121-129.
2. Backs, R. W., Ryan, A. M. and Wilson, G. F. 1994. Psychphysiological measures of workload during continuous manual performance. Human Factors, 36: 514-531.
3. Baggs, J. G., Schmitt, M. H., Mushlin, A. I., Mitchell, P. H., Elredge, D. H.Oakes, D. 1999. Association between nurse-physician collaboration and patient outcomes in three intensive care units. Critical Care Medicine, 27(9): 1991-1998.
4. Battiste, V. and Bortolussi, M. Transport pilot workload: A comparison of two subjective techniques. Paper presented at the Human Factors Society Thirty-Second Annual Meeting, 24-28 October, Anaheim, CA.
5. Carayon, P. 2009. The balance theory and the work system model...twenty years later. International Journal of Human-Computer Interaction, 25(5): 313-327.
6. Carayon, P. and Alvarado, C. J. 2007. Workload and patient safety among critical care nurses. Critical Care Nursing Clinics North America, 19: 121-129.
7. Carayon, P., Alvarado, C. and Hundt, A. S. 2003. Reducing Workload and Increasing Patient Safety Through Work and Workspace Design, Washington, DC: Institute of Medicine.
8. Carayon, P. and Gurses, A. P. 2005. Nursing workload and patient safety in intensive care units: a human factors engineering evaluation of the literature. Intensive Critical Care Nursing, 21(5): 284-301.
9. Carayon, P., Hundt, A. S., Karsh, B.-T., Gürses, A. P., Alvarado, C. J.Smith, M. 2006. Work system design for patient safety: The SEIPS model. Quality & Safety in Health Care, 15(Suppl I): i50-i58.
10. Cohen, M. M., O'Brien-Pallas, L. L., Copplestone, C., Wall, R., Porter, J. and Rose, K. 1999. Nursing workload associated with adverse events in the postaneshesia care unit. Anesthesiology, 91(6): 1882-1990.
11. Cullen, D. J., Civetta, J. M., Briggs, B. A. and Ferrara, L. C. 1974. Therapeutic intervention scoring system: A method for quantitative comparison of patient care. Critical Care Medicine, 2(2): 57-60.
12. Embriaco, N., Papazian, L., Kentish-Barnes, N., Pochard, F. and Azoulay, E. 2007. Burnout syndrome among critical care healthcare workers. Current Opinion in Critical Care, 13(5): 482-488.
13. Goldstein, H. 2003. Multilevel Statistical Models, 3rd ed, London: Arnold.
14. Gurses, A. P. 2005. Performance Obstacles and Facilitators, Workload, Quality of Working Life and Quality and Safety of Care among Intensive Care Nurses, Madison, WI: University of Wisconsin-Madison.
15. Gurses, A. P. and Carayon, P. 2007. Performance obstacles of intensive care nurses. Nursing Research, 56(3): 185-194.
16. Gurses, A. P., Carayon, P. and Wall, M. 2009. Impact of performance obstacles on intensive care nurses' workload, perceived quality and safety of care, and quality of working life. Health Services Research, 44(2): 422-443.
17. Hart, S. G. NASA-Task Load Index (NASA-TLX): 20 years later. Paper presented at the Human Factors and Ergonomics Society (HFES) 50th annual meeting. San Francisco, CA.
18. Hart, S. G. and Staveland, L. E. 1988. "Development of NASA-TLX (Task Load Index): Results of emprical and theoretical research". In Human Mental Workload, Edited by: Hancock, P. A. and Meshkati, N. 139-183. North-Holland, the Netherlands: Elsevier Science Publishers B. V.
19. Hendy, K. C., Hamilton, K. M. and Landry, L. M. 1993. Measuring subjective workload: When is one scale better than another?. Human Factors, 35(4): 579-601.
20. Hill, S. G., Iavecchia, H. M., Byers, J. C., Bittner, A. C., Zaklad, A. L. and Christ, R. E. 1992. Comparison of four subjective workload rating scales. Human Factors, 34(4): 429-439.
21. Hoonakker, P. L. T., Carayon, P., Douglas, S., Schulz, K., Walker, J. and Wetterneck, T. B. 2008. "Communication in Intensive Care Units and the relation with quality of care and patient safety". In Human Factors in Organizational Design and Management, Edited by: Snelwar, L. I., Mascia, F. L. and Montedo, U. B. Vol. IX, 715-721. Santa Monica, CA: IEA Press.
22. Hoonakker, P. L. T., Carayon, P. and Walker, J. 2010. Evaluation of CPOE Implementation: Measuring end-user satisfaction with a survey questionnaire. Applied Clinical Informatics, 1(3): 268-285.
23. Hoonakker, P. L. T., Carayon, P., Walker, J. and Wetterneck, T. B. Coordination in the ICU and the Relation with Quality of Care and Patient Safety. Paper presented at the Healthcare systems Ergonomics and Patient Safety (HEPS 2008) Conference. Strasbourg, France.
24. Hoonakker, P. L. T., Cartmill, R. S., Carayon, P. and Walker, J. M. 2011. Development and Psychometric Qualities of the SEIPS Survey to Evaluate CPOE/EHR Implementation in ICUs. International Journal of Healthcare Information Systems and Informatics (IJHISI), 6(1): 51-69.
25. Hughes, M. 1999. Nursing workload: an unquantifiable entity. Journal of Nursing Management, 7(6): 317-322.
26. Joint Commission. 2007, March 31. Sentinel Events Statistics. Retrieved August 7, 2007, from http://www.jointcommission.org/SentinelEvents/Statistics/
27. Kiekkas, P., Sakellaropoulos, G. C., Brokalaki, H., Manolis, E., Samios, A.Skartsani, C. 2008. Association between nursing workload and mortality of intensive care unit patients. Journal of Nursing Scholarship, 40: 385-390.
28. Knaus, W. A., Zimmerman, J. E., Wagner, D. P., Draper, E. A. and Lawrence, D. E. 1981. APACHE- acute physiology and chronic health evaluation: A physiologically-based classification system. Critical Care Medicine, 9(8): 591-597.
29. Kramer, A. F. 1991. "Physiological metrics of mental workload: A review of recent progress". In Multi-task performance, Edited by: Damos, D. L. 279-328. London: Taylor & Francis.
30. Lazard, T., Metel, O., Guidet, B., Maury, E., Valleron, A. J. and Offenstadt, G. 1996. AIDS in a medical intensive care unit. Immediate prognosis and long-term survival. The Journal of the American Medical Association, 276: 1240-1245.
31. Llenore, E. and Ogle, K. R. 1999. Nurse-patient communication in the intensive care unit: a review of the literature. Australia Critical Care, 12(4): 142-145.
32. Lysaght, R. J., Hill, S. G., Dick, A. O., Plamondon, B. D., Linton, P. M.Wierwille, W. W. 1989. Operator workload: Comprehensive review and evaluation of operator workload methodologies (No. ARI Tech. Report 851), Fort Bliss, TX: U.S. Army Research Institute.
33. McManus, I. C., Keeling, A. and Paice, E. 2004. Stress, burnout and doctors' attitudes to work are determined by personality and learning style: a twelve year longitudinal study of UK medical graduates. BMC Medicine, 2(29)
34. Miranda, D. R., de Rijk, A. and Schaufeli, W. 1996. Simplified therapeutic intervention scoring system: The TISS-28 items- results from a multicenter study. Critical Care Medicine, 24: 64-73.
35. Miranda, D. R., Nap, R., de Rijk, A., Schaufeli, W., Iapichino, G. and Group, T. W. 2003. Nursing Activities Score. Critical Care Medicine, 31(2): 374-382.
36. Morris, R., MacNeela, P., Scott, A., Treacy, P. and Hyde, A. 2007. Reconsidering the conceptualization of nursing workload: literature review. Journal of Advanced Nursing, 57(5): 463-471.
37. Nunnaly, J. C. 1978. Psychometric theory, 2nd ed, New York: McGraw Hill.
38. Nygren, T. E. 1991. Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Human Factors, 31: 17-31.
39. Rasbash, J., Charlton, C., Browne, W. J., Healy, M. and Cameron, B. 2009. MLwiN Version 2.1, Bristol, UK: Centre for Multilevel Modelling, University of Bristol.
40. Rothen, H. U., Kung, V., Ryser, D. H., Zurcher, R. and Regli, B. 1999. Validation of "nine equivalents of nursing manpower use score" on an independent data sample. Intensive Care Medicine, 25: 606-611.
41. Rubio, S., Díaz, E., Martín, J. and Puente, J. M. 2004. Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA-TLX, and Workload Profile Methods. Applied Psychology: An International Review, 53(1): 61-86.
42. Schaufeli, W. and Le Blanc, P. 1998. "Personnel". In Organisation and Management of Intensive Care: A Prospective Study in 12 European Countries Edited by: Miranda, D. R., Ryan, D. W., Schaufeli, W. B. and Fidler, V. 169-205. Springer-Verlag, Berlin
43. Sheridan, T. 1980. Mental workload-What is it? Why bother with it?. Human Factors Society Bulletin, 23(2): 1-2.
44. Tsang, P. and Wilson, G. F. 1997. "Mental workload". In Handbook of Human Factors and Eronomics, Edited by: Salvendy, G. 417-449. Upper Saddle River, NJ: Wiley.
45. Weinger, M. B., Reddy, S. B. and Slagle, J. M. 2004. Multiple measures of anesthesia workload during teaching and nonteaching cases. Anesthesia & Analgesia, 98(5): 1419-1425.
46. Young, G., Zavelina, L. and Hooper, V. 2008. Assessment of Workload Using NASA Task Load Index in Perianesthesia Nursing. Journal of PeriAnesthesia Nursing, 23(2): 102-110.