Impact of automated decision aids on performance, operator behaviour and workload in a simulated supervisory control task

Ergonomics

Volumn 52, Issue 5, 2009, Pages 512-523

  Röttger, Stefan ^a   Bali, Krisztina ^b   Manzey, Dietrich ^b  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

Author keywords

Automation; Decision aid; Fault management; Mental workload; Operator behaviour; Performance; Process control

Indexed keywords

AUTOMATION; BENCHMARKING; DECISION MAKING; DECISION SUPPORT SYSTEMS; FAILURE ANALYSIS;

DECISION AID; FAULT MANAGEMENT; MENTAL WORKLOAD; OPERATOR BEHAVIOUR; PERFORMANCE;

PROCESS CONTROL;

ADULT; ARTICLE; ATTITUDE TO COMPUTERS; AUTOMATION; CONTROLLED STUDY; DECISION MAKING; ERGONOMICS; FEMALE; HUMAN; HUMAN EXPERIMENT; JOB PERFORMANCE; MALE; PROCESS CONTROL; SIMULATION; TASK PERFORMANCE; WORKLOAD; ADAPTIVE BEHAVIOR; ANALYSIS OF VARIANCE; CHINA; COGNITION; COMPARATIVE STUDY; COMPUTER INTERFACE; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; HEART RATE; HUNGARY; MAN MACHINE INTERACTION; STATISTICS AND NUMERICAL DATA; UNITED STATES;

ADAPTATION, PSYCHOLOGICAL; ADULT; ANALYSIS OF VARIANCE; AUTOMATION; CHINA; COGNITION; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; FEMALE; HEART RATE; HUMANS; HUNGARY; MALE; MAN-MACHINE SYSTEMS; TASK PERFORMANCE AND ANALYSIS; UNITED STATES; USER-COMPUTER INTERFACE; WORKLOAD;

EID: 68349148075     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140130802379129     Document Type: Article

References (50)

1. Bahner, E.J., Hüper, A.-D., and Manzey, D., 2008. Misuse of automated decision aids: Complacency, automation bias and the impact of training experience. International Journal of Human-Computer Studies, 66 (9), 688-699.
2. Bailey, N.R. and Scerbo, M.W., 2007. Automation-induced complacency for monitoring highly reliable systems: The role of task complexity, system experience, and operator trust. Theoretical Issues in Ergonomics Science, 8 (4), 321-348.
3. Bailey, N.R., et al. 2006. Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation. Human Factors, 48 (4), 693-709.
4. Berntson, G.G., et al. 1997. Heart rate variability: Origins, methods, and interpretive caveats. Psychophysiology, 34 (6), 623-648.
5. Endsley, M.R., 1987. The application of human factors to the development of expert systems for advanced cockpits. In: Proceedings of the Human Factors Society 31st annual meetingSanta Monica, CA: Human Factors Society, 1399-1392.
6. Endsley, M.R. and Kaber, D.B., 1999. Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics, 42 (3), 462-492.
7. Endsley, M.R. and Kiris, E.O., 1995. The out-of-the-loop performance problem and level of control in automation. Human Factors, 37 (2), 381-394.
8. Funke, G., et al. 2007. Vehicle automation: A remedy for driver stress? Ergonomics, 50 (8), 1302-1323.
9. Gopher, D. and Donchin, E., 1986. Workload - An examination of the concept. In: K.R. Boff, L. Kaufman, and J.P. Thomas, eds. Handbook of perception and human performance, vol. II, Cognitive processes and performance. New York, NY, USA: John Wiley and Sons, 41-41-41-49.
10. Goteman, Ö. and Dekker, S., 2003. Flight crew and aircraft performance during RNAV approaches: Studying the effects of throwing new technology at an old problem. Human Factors and Aerospace Safety, 3 (2), 147-164.
11. Hart, S.G. and Staveland, L.E., 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: P.A. Hancock and N. Meshkati, eds. Human Mental Workload. Amsterdam: North-Holland, 139-183.
12. Helbing, K., Spaeth, T., and Valasek, J., 2006. Improving aircraft sequencing and separation at a small aircraft transportation system airport. Journal of Aircraft, 43 (6), 1636-1642.
13. Hilburn, B.G., Jorna, P.G., and Parasuraman, R., 1995. The effect of advanced ATC automation on workload and monitoring performance: An empirical investigation in Dutch airspace. In: R.S. Jensen and L.A. Rakovan, eds. Proceedings of the Eighth International Symposium on aviation psychology, Columbia, OH, USA: Ohio State University, vol. I. 387-391.
14. Hilburn, B.G., et al. 1997. The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload. In: M. Mouloua and J. Koonce, eds. Human-automation interaction: Research and practice. Mahwah, NJ: Erlbaum, 84-91.
15. Hockey, G.R.J., 1997. Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework. Biological Psychology, 45 (1-3), 73-93.
16. Hockey, G.R.J., Sauer, J., and Wastell, D.G., 2007. Adaptability of training in simulated process control: Knowledge- versus rule-based guidance under task changes and environmental stress. Human Factors 49 (1), 158-174.
17. Hockey, G.R.J., Wastell, D.G., and Sauer, J., 1998. Effects of sleep deprivation and user interface on complex performance: A multilevel analysis of compensatory control. Human Factors, 40 (2), 233-253.
18. Jorna, P.G.A.M., 1992. Spectral analysis of heart rate and psychological state: A review of its validity as a workload index. Biological Psychology, 34 (2-3), 237-257.
19. Kaber, D.B. and Endsley, M.R., 2004. The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science, 5 (2), 113-153.
20. Kaber, D.B., Onal, E., and Endsley, M.R., 2000. Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload. Human Factors and Ergonomics in Manufacturing, 10 (4), 409-430.
21. Kaber, D.B. and Riley, J.M., 1999. Adaptive automation of a dynamic control task based on secondary task workload measurement. International Journal of Cognitive Ergonomics, 3 (3), 169-187.
22. Kaber, D.B., et al. 2005. Adaptive automation of human-machine system information-processing functions. Human Factors, 47 (4), 730-741.
23. Kaber, D.B., et al. 2006. Situation awareness implications of adaptive automation for information processing in an air traffic control-related task. International Journal of Industrial Ergonomics 36 (5), 447-462.
24. Korteling, J.E. and van der Borg, W., 1997. Partial camera automation in an unmanned air vehicle. IEEE Transactions on Systems Man and Cybernetics Part a-Systems and Humans, 27 (2), 256-262.
25. Kudat, H., et al. 2006. Heart rate variability in diabetes patients. The Journal of International Medical Research, 34 (3), 291-296.
26. Lorenz, B., et al. 2002. Automated fault-management in a simulated spaceflight micro-world. Aviation, Space, and Environmental Medicine 73 (9), 886-897.
27. Ma, R.Q. and Kaber, D.B., 2005. Situation awareness and workload in driving while using adaptive cruise control and a cell phone. International Journal of Industrial Ergonomics, 35 (10), 939-953.
28. McFadden, S.M., Vimalachandran, A., and Blackmore, E., 2004. Factors affecting performance on a target monitoring task employing an automatic tracker. Ergonomics, 47 (3), 257-281.
29. Metzger, U. and Parasuraman, R., 2005. Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors, 47 (1), 35-49.
30. Meyer, J., 2001. Effects of warning validity and proximity on responses to warnings. Human Factors, 43 (4), 563-572.
31. Moroney, W.F., Biers, D.W., and Eggemeier, F.T., 1995. Some measurement and methodological considerations in the application of subjective workload measurement techniques. International Journal of Aviation Psychology, 5 (1), 87-106.
32. Mulder, L.J.M., 1992. Measurement and analysis methods of heart rate and respiration for use in applied environments. Biological Psychology 34 (2-3), 205-236.
33. Nickel, P. and Nachreiner, F., 2003. Sensitivity and diagnosticity of the 0.1-Hz component of heart rate variability as an indicator of mental workload. Human Factors, 45 (4), 575-590.
34. Noyes, J.M. and Bruneau, D.P.J., 2007. A self-analysis of the NASA-TLX workload measure. Ergonomics, 50 (4), 514-519.
35. Nygren, T.E., 1991. Psychometric properties of subjective workload measurement techniques - implications for their use in the assessment of perceived mental workload. Human Factors, 33 (1), 17-33.
36. O'Donnell, R.D. and Eggemeier, F.T., 1986. Workload assessment methodology. In: K.R. Boff, L. Kaufman, and J.P. Thomas, eds. Handbook of perception and human performance, vol. II, Cognitive processes and performance. New York, NY, USA: John Wiley and Sons, 42-41-42-49.
37. Parasuraman, R., Sheridan, T.B., and Wickens, C.D., 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man and Cybernetics - PartA: Systems and Humans 30 (3), 286-297.
38. Prinzel, L.J., Pope, A.T., and Freeman, F.G., 2002. Physiological self-regulation and adaptive automation. The International Journal of Aviation Psychology, 12 (2), 179-196.
39. Prinzel, L.J., et al. 2003. Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component. Human Factors, 45 (4), 601-613.
40. Sauer, J., et al. 2003. Performance in a complex multiple-task environment during a laboratory-based simulation of occasional night work. Human Factors, 45 (4), 657-669.
41. Sauer, J., et al. 2008. The effects of heuristic rule training on operator performance in a simulated process control environment. Ergonomics, 51 (7), 953-967.
42. Seppelt, B.D. and Lee, J.D., 2007. Making adaptive cruise control (ACC) limits visible. International Journal of Human-Computer Studies, 65 (3), 192-205.
43. Sharma, S., 2006. Linear temporal characteristics of heart interbeat interval as an index of the pilot's perceived risk. Ergonomics, 49 (9), 874-884.
44. Sheridan, T.B., 2002. Humans and automation: System design and research issues. New York, NY, USA: John Wiley and Sons. Wiley-Interscience.
45. Sheridan, T.B. and Verplank, W.L., 1978. Human and computer control of undersea teleoperators. Technical Report. Cambridge, MA: MIT Man-machine Systems Laboratory.
46. Stanton, N.A. and Young, M.S., 2005. Driver behaviour with adaptive cruise control. Ergonomics, 48 (10), 1294-1313.
47. Wei, Z.G., Macwan, A.P., and Wieringa, P.A., 1998. A quantitative measure for degree of automation and its relation to system performance and mental load. Human Factors, 40 (2), 277-295.
48. Wright, M.C. and Kaber, D.B., 2005. Effects of automation of information-processing functions on teamwork. Human Factors, 47 (1), 50-66.
49. Young, M.S. and Stanton, N.A., 2004. Taking the load off: Investigations of how adaptive cruise control affects mental workload. Ergonomics 47 (9), 1014-1035.
50. Young, M.S. and Stanton, N.A., 2007. What's skill got to do with it? Vehicle automation and driver mental workload. Ergonomics, 50 (8), 1324-1339.