Human performance consequences of stages and levels of automation: An integrated meta-analysis

Human Factors

Volumn 56, Issue 3, 2014, Pages 476-488

  Onnasch, Linda ^a   Wickens, Christopher D ^b   Li, Huiyang ^c   Manzey, Dietrich ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b ALION SCIENCE AND TECHNOLOGY   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

degree of automation; function allocation; human automation interaction; operator performance; situation awareness; workload

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS;

DEGREE OF AUTOMATION; FUNCTION ALLOCATIONS; HUMAN-AUTOMATION INTERACTIONS; OPERATOR PERFORMANCE; SITUATION AWARENESS; WORKLOAD;

AUTOMATION;

ARTICLE; AUTOMATION; AWARENESS; FEMALE; HUMAN; MALE; META ANALYSIS; TASK PERFORMANCE; WORKLOAD;

AUTOMATION; AWARENESS; FEMALE; HUMANS; MALE; TASK PERFORMANCE AND ANALYSIS; WORKLOAD;

EID: 84898996221     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720813501549     Document Type: Article

References (65)

1. Bahner E. J., Huper A. D., Manzey D.. Misuse of automated decision aids: Complacency, automation bias and training experience. International Journal of Human-Computer Studies. 2008 ; 66: 688-699
2. Bainbridge L.. Ironies of automation. Automatica. 1983 ; 19: 775-779
3. Bennett K. B., Flach J. M. Display and interface design: Subtle science, exact art. Boca Raton, FL: CRC Press ; 2011:
4. Burns C. M., Skraaning G., Jamieson G., Lau N., Kwok J., Welch R., Andresen G.. Evaluation of ecological interface design for nuclear process control: Situation awareness effects. Human Factors. 2008 ; 50: 663-698
5. Calhoun G. L., Draper M. K., Ruff H. A. Proceedings of the Human Factors and Ergonomics Society 53rd annual meeting. Santa Monica, CA: Human Factors and Ergonomics Society ; 2009: 197-201.
6. Crocoll W. M., Coury B. G. Proceedings of the Human Factors and Ergonomics Society 34th annual meeting. Santa Monica, CA: Human Factors and Ergonomics Society ; 1990: 1524-1528.
7. Crossman E. R. F. W. The human operator in process control. Edwards E. Lees F., ed. London, UK: Taylor & Francis ; 1974: 1-24.
8. Cummings M. L., Mitchell P. J.. Operator scheduling strategies in supervisory control of multiple UAVs. Aerospace Science and Technology. 2007 ; 11: 339-348 (Pubitemid 46680420)
9. Dekker S. W. A., Woods D. D.. MABA-MABA or abracadabra? Progress on human-automation co-ordination. Cognition, Technology, and Work. 2002 ; 4: 240-244
10. Endsley M. R. Proceedings of the National Aerospace and Electronics Conference (NAECON). New York, NY: IEEE ; 1988: 789-795.
11. Endsley M. R. Situation awareness: Analysis and measurement. Endsley M. R. Garland D. J., ed. Mahwah, NJ: Lawrence Erlbaum ; 2000: 147-173.
12. Endsley M. R., Kaber D. B.. Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics. 1999 ; 42: 462-492 (Pubitemid 29074295)
13. Endsley M. R., Kiris E. O.. The out-of-the-loop performance problem and level of control in automation. Human Factors. 1995 ; 37: 387-394
14. Ephrath A. R., Young L. R. Human detection and diagnosis of system failures. Rasmussen J. Rouse W. B., ed. New York, NY: Plenum ; 1981: 143-154.
15. Fadden S., Ververs P., Wickens C. D. Proceedings of the 42nd annual meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society ; 1998: 16-20.
16. Hart S. G., Staveland L. E. Human mental workload. Hancock P. A. Meshkati N., ed. Amsterdam, Netherlands: Elsevier ; 1988: 139-183.
17. Hoffman R. R., Crandall B., Shadbolt N.. Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors. 1998 ; 40: 254-276 (Pubitemid 28378073)
18. Horrey W. J., Wickens C. D.. Examining the impact of cell phone conversations on driving using meta-analytic techniques. Human Factors. 2006 ; 48: 196-205 (Pubitemid 43666535)
19. Hutchins S. D., Wickens C. D., Carolan T. F., Cumming J. M.. The influence of cognitive load on transfer with error prevention training methods: A meta-analysis. Human Factors. 2013 ; 55: 854-874
20. Kaber D. B., Endsley M. R.. The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science. 2004 ; 5: 113-153
21. Kaber D. B., Onal E., Endsley M. R.. Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload. Human Factors and Ergonomics in Manufacturing. 2000 ; 10: 409-430
22. Kessel C. J., Wickens C. D.. The transfer of failure-detection skills between monitoring and controlling dynamic systems. Human Factors. 1982 ; 24: 49-60
23. Kirlik A.. Modeling strategic behavior in human-automation interaction: Why an "aid" can (and should) go unused. Human Factors. 1993 ; 35: 221-242 (Pubitemid 23204668)
24. Layton C., Smith P. J., McCoy C. E.. Design of a cooperative problem-solving system for en-route flight planning: An empirical evaluation. Human Factors. 1994 ; 36: 94-119 (Pubitemid 24177078)
25. Li H., Wickens C. D., Sarter N. B., Sebok A.. An investigation of automation degree in assisting robotic arm control.:
26. Lorenz B., Di Nocera F., Röttger S., Parasuraman R.. Automated fault-management in a simulated spaceflight micro-world. Aviation, Space, and Environmental Medicine. 2002a ; 73: 886-897 (Pubitemid 34994518)
27. Lorenz B., Di Nocera F., Röttger S., Parasuraman R. Human factors in transportation, communication, health, and the workplace. de Waard D. Brookhuis K. A. Moraal J. Toffetti A., ed. Maastricht, Netherlands: Shaker ; 2002b: 517-524.
28. Manzey D., Reichenbach J., Onnasch L.. Human performance consequences of automated decision aids: The impact of degree of automation and system experience. Journal of Cognitive Engineering and Decision Making. 2012 ; 6: 57-87
29. Metzger U., Parasuraman R.. Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors. 2005 ; 47: 35-49 (Pubitemid 40593935)
30. Miller C. A., Parasuraman R.. Designing for flexible interaction of humans and automation: Delegation interfaces for supervisory control. Human Factors. 2007 ; 49: 57-75 (Pubitemid 46175382)
31. Mosier K. L., Skitka L. J. Automation and human performance: Theory and applications. Parasuraman R. Mouloua M., ed. Mahwah, NJ: Lawrence Erlbaum ; 1996: 201-220.
32. Osgood J.. The similarity paradox in human learning: A resolution. Psychological Review. 1949 ; 47: 419-427
33. Parasuraman R., Manzey D.. Complacency and bias in human use of automation: A review and attentional synthesis. Human Factors. 2010 ; 52: 381-410
34. Parasuraman R., Molloy R., Singh I. L.. Performance consequences of automation-induced "complacency.". International Journal of Aviation Psychology. 1993 ; 3: 1-23
35. Parasuraman R., Riley V.. Humans and automation: Use, misuse, disuse and abuse. Human Factors. 1997 ; 39: 230-253
36. Parasuraman R., Sheridan T. B., Wickens C. D.. A model of types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics-Part A. 2000 ; 30: 286-297
37. Parasuraman R., Sheridan T., Wickens C.. Situation awareness, mental workload, and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making. 2008 ; 6: 140-160
38. Rasmussen J., Rouse W. B. Human detection and diagnosis of system failures. New York, NY: Plenum ; 1981:
39. Reichenbach J., Onnasch L., Manzey D.. Human performance consequences of automated decision aids in states of sleep loss. Human Factors. 2011 ; 53: 717-728
40. Rosenthal R. Meta-analytic procedures for social research. Newbury Park, CA: Sage ; 1991:
41. Röttger S., Bali K., Manzey D.. Impact of automated decision aids on performance, operator behaviour and workload in a simulated supervisory control task. Ergonomics. 2009 ; 52: 512-523
42. Rovira E., McGarry K., Parasuraman R.. Effects of imperfect automation on decision making in a simulated command and control task. Human Factors. 2007 ; 49: 76-87 (Pubitemid 46175383)
43. Sarter N. B.. Investigating mode errors on automated flight decks: Illustrating the problem-driven, cumulative, and interdisciplinary nature of human factors research. Human Factors. 2008 ; 50: 506-510
44. Sarter N. B., Schroeder B.. Supporting decision making and action selection under time pressure and uncertainty: The case of in-flight icing. Human Factors. 2001 ; 43: 573-583 (Pubitemid 34327075)
45. Seppelt B. D., Lee J. D.. Making adaptive cruise control (ACC) limits visible. International Journal of Human-Computer Studies. 2007 ; 65: 192-205 (Pubitemid 46096752)
46. Sethumadhavan A. Proceedings of the Human Factors and Ergonomics Society 53rd annual meeting. Santa Monica, CA: Human Factors and Ergonomics Society ; 2009: 1-5.
47. Sheridan T. B. Humans and automation: Systems design and research issues. New York, NY: John Wiley ; 2002:
48. Sheridan T. B., Parasuraman R.. Human vs. automation in responding to failures: An expected-value analysis. Human Factors. 2000 ; 42: 403-407 (Pubitemid 32002801)
49. Sheridan T. B., Verplank W. L. Human and computer control of undersea teleoperators. Cambridge, MA: MIT, Man Machine Systems Laboratory ; 1978:
50. Slamecka N. J., Graf P.. The generation effect: Delineation of a phenomenon. Journal of Experimental Psychology: Human Learning & Memory. 1978 ; 4: 592-604
51. Taylor R. M. Situational awareness in aerospace operations. Neuilly Sur Seine, France: NATO-AGARD ; 1990:
52. Wickens C. D.. Multiple resources and mental workload. Human Factors. 2008a ; 50: 449-455 (Pubitemid 352029804)
53. Wickens C. D.. Situation awareness: Review of Mica Endsley's 1995 articles on situation awareness theory and measurement. Human Factors. 2008b ; 50: 397-403 (Pubitemid 352029797)
54. Wickens C. D., Dixon S. R.. The benefits of imperfect diagnostic automation: A synthesis of the literature. Theoretical Issues in Ergonomics Science. 2007 ; 8: 201-212
55. Wickens C. D., Hollands J. G., Banbury S., Parasuraman R. Engineering psychology and human performance. 2012 ). Engineering psychology and human performance (4th ed.). New York, NY: Pearson. New York, NY: Pearson ; 2012:
56. Wickens C. D., Hooey B. L., Gore B. F., Sebok A., Koenicke C. S.. Identifying black swans in NextGen: Predicting human performance in off-nominal conditions. Human Factors. 2009 ; 51: 638-651
57. Wickens C. D., Hutchinson S., Carolan T., Cumming J.. Effectiveness of part task training and increasing difficulty training strategies: A meta-analysis approach. Human Factors. 2013 ; 55: 461-470
58. Wickens C. D., Kessel C. J.. The effects of participatory mode and task workload on the detection of dynamic system failures. IEEE Transactions on Systems, Man and Cybernetics. 1979 ; 9: 24-34
59. Wickens C. D., Kessel C. J.. Processing resource demands of failure detection in dynamic systems. Journal of Experimental Psychology: Human Perception and Performance. 1980 ; 6: 564-577
60. Wickens C. D., Kessel C. J. Human detection and diagnosis of system failures. Rasmussen J. Rouse W. B., ed. New York, NY: Plenum ; 1981: 155-169.
61. Wickens C. D., Mavor A. S., Parasuraman R., McGee P. The future of air traffic control: Human operators and automation. Wickens C. D. Mavor A. S. McGee J. P., ed. Washington, DC: National Academy ; 1998: 225-245.
62. Wiener E. L. Human factors in aviation. Wiener E. L. Nagel D. C., ed. San Diego, CA: Academic Press ; 1988: 433-461.
63. Wiener E. L., Curry R. E.. Flight-deck automation: Promises and problems. Ergonomics. 1980 ; 23: 995-1011 (Pubitemid 11195680)
64. Wright M. C., Kaber D. B.. Effects of automation of information- processing functions on teamwork. Human Factors. 2005 ; 47: 50-66 (Pubitemid 40593936)
65. Yeh M., Merlo J. L., Wickens C. D., Brandenburg D. L.. Head up vs. head down: Costs of imprecision, unreliability, and visual clutter on cue effectiveness for display signaling. Human Factors. 2003 ; 45: 390-407 (Pubitemid 37509592)