Hands-free administration of subjective workload scales: Acceptability in a surgical training environment

Applied Ergonomics

Volumn 42, Issue 1, 2010, Pages 138-145

  Carswell, C Melody ^a   Lio, Cindy H ^a   Grant, Russell ^a   Klein, Martina I ^a,d   Clarke, Duncan ^a   Seales, W Brent ^a,b   Strup, Stephen ^c  

^a UNIVERSITY OF KENTUCKY   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

^c UNIVERSITY OF KENTUCKY   (United States)

^d TEXAS TECH UNIVERSITY   (United States)

Author keywords

Administration procedures; Human factors evaluation; Mental workload; Minimally invasive surgery; Reliability; Surgical training; Usability metrics

Indexed keywords

RELIABILITY; STUDENTS; SURGERY; SURVEYS; TRANSPLANTATION (SURGICAL);

HUMAN FACTORS EVALUATIONS; MENTAL WORKLOAD; MINIMALLY INVASIVE SURGERY; SURGICAL TRAINING; USABILITY METRICS;

NASA;

ADULT; ARTICLE; CANNULATION; CORRELATION COEFFICIENT; DECISION MAKING; FEMALE; FOLLOW UP; HUMAN; LAPAROSCOPIC SURGERY; MALE; MEDICAL STUDENT; MENTAL TASK; MULTIPLE RESOURCES QUESTIONNAIRE; NASA RAW TASK LOAD INDEX; NASA TASK LOAD INDEX; PHYSICAL PERFORMANCE; QUESTIONNAIRE; RATING SCALE; SENSITIVITY ANALYSIS; SURGICAL TRAINING; WORKLOAD;

EID: 77957293444     PISSN: 00036870     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apergo.2010.06.003     Document Type: Article

References (30)

1. Ballester, P., 2007. The Ergonomic Evaluation and Human-centred Design Approach to Robotic Systems in Minimal Invasive Surgery. Unpublished doctoral dissertation, University of Manchester, United Kingdom.
2. Boles D.B., Adair L.P. The multiple resources questionnaire (MRQ). Proceedings of the Human Factors and Ergonomics Society 2001, 45:1790-1794.
3. Boles D.B., Bursk J.H., Phillips J.B., Perdelwitz J.R. Predicting dual-task performance with the multiple resources questionnaire (MRQ). Human Factors 2007, 49(1):32-45.
4. Byers J.C., Bittner A.C., Hill S.G. Traditional and raw task load index (TLX) correlations: are paired comparisons necessary?. Advances in Industrial Ergonomics and Safety I 1989, 481-485. Taylor and Francis, Philadelphia, PA. A. Mita (Ed.).
5. Cao C.G.L. Guiding navigation in colonoscopy. Surgical Endoscopy 2006, 21(3):480-484.
6. Cohen J. Statistical Power Analysis for the Behavioral Sciences 1988, Lawrence Earlbaum Associates, Hillsdale, NJ. second ed.
7. Crossan, A., Brewster, S.A., Reid, S., Mellor, D., 2001. Comparison of simulated ovary training over different skill levels. In: Proceedings of the Eurohaptics Conference, Birmingham, UK, pp. 17-21.
8. David H., Pledger S. Speech recognition and keyboard input for control and stress reporting in ATC simulation. Contemporary Ergonomics 1995, 175-180. Taylor and Francis, London. S.A. Robertson (Ed.).
9. Hart S.G. NASA-task load index (NASA-TLX): 20 years later. Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting 2006, 904-908. Human Factors and Ergonomics Society, Santa Monica, CA.
10. Hart S.G., Staveland L.E. Development of NASA-TLX (task load index): results of empirical and theoretical research. Human Mental Workload 1988, 239-250. North Holland Press, North Holland, Amsterdam. P.A. Hancock, N. Meshkati (Eds.).
11. Landau K., Wiese G., Bopp V., Sinn-Behrendt A., Winter G., Salmanzadeh H. Integration of inspection tasks into machine operators' jobs in the consumer goods industry. Occupational Ergonomics 2006, 6(3-4):159-172.
12. Liu Y.L., Wickens C.D. Mental workload and cognitive task automaticity: an evaluation of subjective and time-estimation metrics. Ergonomics 1994, 37(11):1843-1854.
13. Matthews R., Legg S., Charlton S. The effect of cell phone type on drivers' subjective workload during concurrent driving and conversation. Accident Analysis and Prevention 2003, 35:451-457.
14. Moroney W.F., Biers D.W., Eggemeier F.T. Some measurement and methodological considerations in the application of subjective workload measurement techniques. The International Journal of Aviation Psychology 1995, 5(1):87-106.
15. Moroney W.F., Biers D.W., Eggemeier F.T., Mitchell J.A. A comparison of two scoring procedures with the NASA Task Load Index in a simulated flight tasks. Proceedings of the Aerospace Electronics Conference, USA 1992, 2:734-740.
16. Noyes J.M., Bruneau D.P.J. A self-analysis of the NASA-TLX subjective workload measure. Ergonomics 2007, 50:514-519.
17. Noyes J.M., Garland K.J. Computer- vs. paper-based tasks: are they equivalent?. Ergonomics 2008, 51:1352-1375.
18. Nygren T.E. Psychometric properties of subjective workload measurement techniques: implications for their use in the assessment of perceived mental workload. Human Factors 1991, 33.:17-33.
19. Otmani S., Rogé J., Muzet A. Sleepiness in professional drivers: effect of age and time of day. Accident Analysis and Prevention 2005, 37(5):930-937.
20. Park J., Jung W. A study on the validity of a task complexity measure for emergency operating procedures of nuclear power plants - comparing with a subjective workload. IEEE Transactions on Nuclear Science 2006, 53(5):2962-2970.
21. Reid G.B., Nygren T.E. The subjective workload assessment technique: a scaling procedure for measuring mental workload. Human Mental Workload 1988, 185-218. North Holland Press, North-Holland, Amsterdam. P.A. Hancock, N. Meshkati (Eds.).
22. Richards J.S., Fine P.R., Wilson T.L., Rogers J.T. A voice-operated method for administering the MMPI. Journal of Personality Assessment 1983, 47(2):167-170.
23. Stefanidis D., Haluck R., Pham T., Dunne B.J., Reinke T., Markley S., et al. Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center. Surgical Endoscopy 2007, 21(7):1158-1164.
24. Stefanidis D., Korndorffer J.R., Markley S., Sierra R., Heniford B.T., Scott D.J. Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training?. Journal of the American College of Surgeons 2007, 205(2):307-313.
25. Stefanidis D., Acker C.E., Swiderski D., Heniford T.B., Greene F.L. Challenges during the implementation of a laparoscopic skills curriculum in a busy general surgery residency program. Journal of Surgical Education 2008, 65(1):4-7.
26. Stefanidis D., Scerbo M.W., Sechrist C., Mostafavi A., Heniford T. Do novices display automaticity during simulator training?. The American Journal of Surgery 2008, 195(2):210-213.
27. Tsang P.S., Velazquez V.L. Diagnosticity and multidimensional workload ratings. Ergonomics 1996, 31:358-381.
28. Tsang P.S., Vidulich M.A. Mental workload and situation awareness. Handbook of Human Factors and Ergonomics 2006, Wiley, New York, (Chapter 9). third ed. G. Salvendy (Ed.).
29. Vildulich, M.A., 1989. The use of judgment matrices in subjective workload assessment: the subjective workload dominance (SWORD) technique. In: Proceedings of the Human Factors Society 33rd Annual Meeting, pp. 1406-1410.
30. Windell, D., Wiebe, E.N., Converse-Lane, S.A., Beith, B., 2006. A comparison of two mental workload instruments in multimedia instruction. In: Proceedings of the HFES Annual Meeting, San Francisco, CA, pp. 1764-1768.