From Here to Autonomy: Lessons Learned from Human-Automation Research

Human Factors

Volumn 59, Issue 1, 2017, Pages 5-27

  Endsley, Mica R ^a  

^a SA Technologies   (United States)

Author keywords

adaptive automation; autonomy; human automation interaction; level of automation; monitoring; situation awareness; trust; vigilance

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; CONTROL THEORY; MONITORING;

ADAPTIVE AUTOMATION; AUTONOMY; HUMAN-AUTOMATION INTERACTIONS; LEVEL OF AUTOMATIONS; SITUATION AWARENESS; TRUST; VIGILANCE;

AUTOMATION;

ALERTNESS; AVIATION; AWARENESS; HUMAN; MODEL; MONITORING; RELIABILITY; ROBOTICS; TRUST; AUTOMATION; MAN MACHINE INTERACTION; TASK PERFORMANCE;

AUTOMATION; HUMANS; MAN-MACHINE SYSTEMS; TASK PERFORMANCE AND ANALYSIS;

EID: 85011629132     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720816681350     Document Type: Article

References (98)

1. Bailey N. R., Scerbo M. W., Freeman F. G., Mikulka P. J., Scott L. A., (2003). A brain-based adaptive automation system and situation awareness: The role of complacency potential. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 1048-1052). Santa Monica, CA: Human Factors and Ergonomics Society.
2. Bainbridge L., (1983). Ironies of automation. Automatica, 19, 775-779.
3. BEA. (2012). On the accident on 1st June 2009 to the Airbus A330-203 registered F-FGZCP operated by Air France flight AF 447 Rio de Janeiro-Paris. Cedex, France: Bureau d'Enquétes et d'Analyses pour la sécurité de l'aviation civile.
4. Billings C. E., (1991). Human-centered aircraft automation: A concept and guidelines (NASA Technical Memorandum 103885). Moffet Field, CA: NASA Ames Research Center.
5. Billings C. E., (1997). Aviation automation: The search for a human-centered approach. Mahwah, NJ: Lawrence Erlbaum.
6. Bolstad C. A., Endsley M. R., (2000). The effect of task load and shared displays on team situation awareness. In Proceedings of the Human Factors and Ergonomics Society 44th Annual Meeting (pp. 189-192). Santa Monica, CA: Human Factors and Ergonomics Society.
7. Carsten O., Lai F. C. H., Barnard Y., Jamson A. H., Merat N., (2012). Control task substitution in semiautomated driving: Does it matter what aspects are automated? Human Factors, 54, 747-761.
8. Chiou E. K., Lee J. D., (2016). Cooperation in human agent systems to support resilience: A microworld experiment. Human Factors, 58, 846-863.
9. Cooke N. J., Kiekel P. A., Salas E., Stout R., Bowers C., Cannon-Bowers J. A., (2003). Measuring team knowledge: A window to the cognitive underpinnings of team performance. Group Dynamics, Theory, Research and Practice, 7, 179-199.
10. Crocoll W. M., Coury B. G., (1990). Status or recommendation: Selecting the type of information for decision aiding. In Proceedings of the Human Factors and Ergonomics Society 34th Annual Meeting (pp. 1524-1528). Santa Monica, CA: Human Factors and Ergonomics Society.
11. Cuevas H. M., Fiore S. M., Caldwell B. S., Strater L., (2007). Augmenting team cognition in human-automation teams performing in complex operational environments. Aviation, Space and Environmental Medicine, 78 (5), B63-B70.
12. Endsley M. R., (1990). A methodology for the objective measurement of situation awareness. In Situational awareness in aerospace operations (AGARD-CP-478) (pp. 1/1-1/9). Neuilly Sur Seine, France: NATO-AGARD.
13. Endsley M. R., (1993). Situation awareness and workload: Flip sides of the same coin. In Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 906-911). Columbus: Ohio State University Department of Aviation.
14. Endsley M. R., (1995a). Toward a theory of situation awareness in dynamic systems. Human Factors, 37, 32-64.
15. Endsley M. R., (1995b). Towards a new paradigm for automation: Designing for situation awareness. In Proceedings of the 6th IFAC/IFIP/IFOR/IEA Symposium on Analysis, Design and Evaluation of Man-Machine Systems (pp. 421-426). Cambridge, MA: MIT Press.
16. Endsley M. R., (1996). Automation and situation awareness. In Parasuraman R., Mouloua M., (Eds.), Automation and human performance: Theory and applications (pp. 163-181). Mahwah, NJ: Lawrence Erlbaum.
17. Endsley M. R., (2006). Expertise and situation awareness. In Ericsson K. A., Charness N., Feltovich P. J., Hoffman R. R., (Eds.), The Cambridge handbook of expertise and expert performance (pp. 633-651). New York, NY: Cambridge University Press.
18. Endsley M. R., (2015). Situation awareness: Operationally necessary and scientifically grounded. Cognition, Technology and Work, 17, 163-167.
19. Endsley M. R., Bolstad C. A., (1994). Individual differences in pilot situation awareness. International Journal of Aviation Psychology, 4, 241-264.
20. Endsley M. R., Bolte B., Jones D. G., (2003). Designing for situation awareness: An approach to human-centered design. London, UK: Taylor & Francis.
21. Endsley M. R., Jones W. M., (2001). A model of inter- and intrateam situation awareness: Implications for design, training and measurement. In McNeese M., Salas E., Endsley M., (Eds.), New trends in cooperative activities: Understanding system dynamics in complex environments (pp. 46-67). Santa Monica, CA: Human Factors and Ergonomics Society.
22. Endsley M. R., Kaber D. B., (1997). The use of level of automation as a means of alleviating out-of-the-loop performance problems: A taxonomy and empirical analysis. In Seppala P., Luopajarvi T., Nygard C. H., Mattila M., (Eds.), 13th Triennial Congress of the International Ergonomics Association (Vol. 1, pp. 168-170). Helsinki: Finnish Institute of Occupational Health.
23. Endsley M. R., Kaber D. B., (1999). Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics, 42, 462-492.
24. Endsley M. R., Kiris E. O., (1994). Information presentation for expert systems in future fighter aircraft. International Journal of Aviation Psychology, 4, 333-348.
25. Endsley M. R., Kiris E. O., (1995). The out-of-the-loop performance problem and level of control in automation. Human Factors, 37, 381-394.
26. Endsley M. R., Mogford R., Allendoerfer K., Snyder M. D., Stein E. S., (1997). Effect of free flight conditions on controller performance, workload and situation awareness: A preliminary investigation of changes in locus of control using existing technology (DOT/FAA/CT-TN 97/12). Atlantic City, NJ: Federal Aviation Administration William J. Hughes Technical Center.
27. Endsley M. R., Robertson M. M., (2000). Situation awareness in aircraft maintenance teams. International Journal of Industrial Ergonomics, 26, 301-325.
28. Endsley M. R., Rodgers M. D., (1998). Distribution of attention, situation awareness, and workload in a passive air traffic control task: Implications for operational errors and automation. Air Traffic Control Quarterly, 6 (1), 21-44.
29. Endsley M. R., Selcon S. J., (1997). Designing to aid decisions through situation awareness enhancement. In Proceedings of the 2nd Symposium on Situation Awareness in Tactical Aircraft (pp. 107-112). Patuxent River, MD: Naval Air Warfare Center Aircraft Division.
30. Endsley M. R., Sollenberger R., Stein E., (1999). The use of predictive displays for aiding controller situation awareness. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 51-55). Santa Monica, CA: Human Factors and Ergonomics Society.
31. Furukawa H., Parasuraman R., (2003). Supporting system-centered view of operators through ecological interface design: Two experiments on human-centered automation. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 567-571). Santa Monica, CA: Human Factors and Ergonomics Society.
32. Grubb P. L., Miller L. C., Nelson W. T., Warm J. S., Dember W. N., (1994). Cognitive failure and perceived workload in vigilance performance. In Mouloua M., Parasuraman R., (Eds.), Human performance in automated systems: Current research and trends (pp. 115-121). Hillsdale, NJ: Lawrence Erlbaum.
33. Guerlain S. A., Smith P., Heinz Obradovich, J., Rudman S., Strohm P., Smith J. W.,. Sachs L., (1999). Interactive critiquing as a form of decision support: An empirical evaluation. Human Factors, 41, 72-89.
34. Hancock P., (2013). In search of vigilance: The problem of iatrogenically created psychological phenomena. American Psychologist, 68, 97-109.
35. Hancock P., (2016). Imposing limits on autonomous systems. Ergonomics. Advance online publication.
36. Hancock P. A., Billings D. R., Schaefer K. E., Chen J. Y. C., De Visser E. J., Parasuraman R., (2011). A meta-analysis of factors affecting trust in human-robot interaction. Human Factors, 53, 517-527.
37. Hancock P., Meshkati N., (Eds.). (1988). Human mental workload. Amsterdam, Netherlands: North-Holland.
38. Hergeth S., Lorenz L., Vilimek R., Krems J. F., (2016). Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving. Human Factors. Advance online publication.
39. Hilburn B., Jorna P. G., Bryne E. A., Parasuraman R., (1997). The effect of adaptive air traffic control decision aiding on controller mental workload. In Mouloua M., Koonce J. M., (Eds.), Human automation interaction: Research and practice (pp. 84-91). Mahwah, NJ: Lawrence Erlbaum.
40. Hoff K. A., Bashir M., (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57, 407-434.
41. Huang S. H., Endsley M. R., (1997). Providing understanding of the behavior of feedforward neural networks. IEEE Transactions: Systems, Man and Cybernetics, 27, 465-474.
42. Kaber D., Onal E., Endsley M. R., (2000). Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload. Human Factors and Ergonomics in Manufacturing, 10, 409-430.
43. Kaber D. B., Endsley M. R., (1997). Level of automation and adaptive automation effects on performance in a dynamic control task. In Proceedings of the 13th Triennial Congress of the International Ergonomics Association (pp. 202-204). Helsinki: Finnish Institute of Occupational Health.
44. Kaber D. B., Endsley M. R., (2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomic Science, 5, 113-153.
45. Kaber D. B., Riley J., (1999). Adaptive automation of a dynamic control task based on secondary task workload measurement. International Journal of Cognitive Ergonomics, 3, 169-187.
46. Klein G. A., Woods D. D., Bradshaw J. M., Hoffman R. R., Feltovich P. J., (2004). Ten challenges for making automation a "team player" in joint human-agent activity. IEEE Intelligent Systems, 19 (6), 91-95.
47. Krogmann U., (1999). From automation to autonomy: Trends towards autonomous combat systems. In Advances in Vehicle Systems Concepts and Integration (RTO MP-44). Neuilly Sur-Seine Cedex, France: NATO Research and Technology Organization.
48. Kuipers A., Kappers A., van Holten C. R., van Bergen J. H. W., Oosterveld W. J., (1990). Spatial disorientation incidents in the R.N.L.A.F. F16 and F5 aircraft and suggestions for prevention. In Situational awareness in aerospace operations (AGARD-CP-478) (pp. OV/E/1-OV/E/16). Neuilly Sur Seine, France: NATO-AGARD.
49. Layton C., Smith P. J., McCoy C. E., (1994). Design of a cooperative problem-solving system for en-route flight planning: An empirical evaluation. Human Factors, 36, 94-119.
50. Lee J. D., See K. A., (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50-80.
51. Li H., Wickens C. D., Sarter N., Sebok A., (2014). Stages and levels of automation in support of space teleoperations. Human Factors, 56, 1050-1061.
52. Lorenz L., Di Nocera F., Rottger S., Parasuraman R., (2002). Automated fault management in a simulated spaceflight micro-world. Aviation, Space and Environmental Medicine, 73, 886-897.
53. Ma R., Sheik-Nainar M. A., Kaber D. B., (2005). Situation awareness in driving while using adaptive cruise control and a cell phone. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 381-385). Santa Monica, CA: Human Factors and Ergonomics Society.
54. Madhavan P., Wiegmann D. A., (2005). Cognitive anchoring on self-generated decisions reduces operator reliance on automated diagnostic aids. Human Factors, 47, 332-341.
55. Manzey D., Reichenbach J., Onnasch L., (2012). Human performance consequences of automated decision aids: The impact of degree of automation and system experience. Journal of Cognitive Engineering and Decision Making, 6, 57-87.
56. McClumpha A., James M., (1994). Understanding automated aircraft. In Mouloua M., Parasuraman R., (Eds.), Human performance in automated systems: Current research and trends (pp. 183-190). Hillsdale, NJ: Lawrence Erlbaum.
57. Merritt S. M., Lee D., Unnerstall J. L., Huber K., (2015). Are well callibrated users effective users? Associations between calibration of trust and performance on an automation-aided task. Human Factors, 57, 34-47.
58. Metzger U., Parasuraman R., (2001). The role of the air traffic controller in future air traffic management: An empirical study of active control vs. passive monitoring. Human Factors, 43, 519-528.
59. Metzger U., Parasuraman R., (2005). Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors, 47, 35-49.
60. Miller C., (2000,). From the Microsoft paperclip to the rotorcraft pilot's associate: Lessons learned from fielding adaptive automation systems. Paper presented at the Human Performance, Situation Awareness and Automation Conference, Savannah, GA.
61. Miller C. A., Pelican M., Goldman R., (1999,). Tasking interfaces for flexible interaction with automation: Keeping the operator in control. Paper presented at the International Conference on Intelligent User Interfaces, Redondo Beach, CA.
62. Moray N., (1986). Monitoring behavior and supervisory control. In Boff K., (Ed.), Handbook of perception and human performance (Vol. 2, pp. 40/41-40/51). New York, NY: Wiley.
63. Moray N., Inagaki T., (2000). Attention and complacency. Theoretical Issues in Ergonomics Science, 1 (4), 354-365.
64. Muir B. M., Moray N., (1996). Trust in automation: Part 2. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429-460.
65. National Transportation Safety Board. (1986). China Airlies B-747-SP, 300 NM northwest of San Francisco, CA, 2/19/85 (NTSB Report No AAR-86/03). Washington, DC: Author.
66. National Transportation Safety Board. (1990). Aircraft accidents report: USAIR, Inc., Boeing 737-400, LaGuardia Airport, Flushing New York, September 20, 1989 (NTSB/AAR-90-03). Washington, DC: Author.
67. Olson W. A., Sarter N. B., (1999). Supporting informed consent in human machine collaboration: The role of conflict type, time pressure, and display design. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 189-193). Santa Monica, CA: Human Factors and Ergonomics Society.
68. Onnasch L., Wickens C. D., Li H., Manzey D., (2014). Human performance consequences of stages and levels of automation: An integrated meta-analysis. Human Factors, 56, 476-488.
69. Parasuraman R., Molloy R., Singh I. L., (1993). Performance consequences of automation-induced complacency. International Journal of Aviation Psychology, 3, 1-23.
70. Parasuraman R., Riley V., (1997). Humans and automation: Use, misuse, disuse and abuse. Human Factors, 39, 230-253.
71. Parasuraman R., Sheridan T. B., Wickens C. D., (2000). A model of types and levels of human interaction with automation. IEEE Transactions on Systems, Man and Cybernetics, 30, 286-297.
72. Prince C., Salas E., (2000). Team situation awareness, errors, and crew resource management: Research integration for training guidance. In Endsley M. R., Garland D. J., (Eds.), Situation awareness analysis and measurement (pp. 325-347). Mahwah, NJ: Lawrence Erlbaum.
73. Prinzel L. J., Freeman F. G., Scerbo M. W., Mikulka P. J., Pope A. T., (2003). Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component. Human Factors, 45, 601-613.
74. Pritchett A. R., Hansman R. J., (1997). Pilot non-conformance to alerting system commands. In Proceedings of the Ninth International Symposium on Aviation Psychology (pp. 274-279). Columbus: Ohio State University Department of Aviation.
75. Reichenbach J., Onnasch L., Manzey D., (2011). Human performance consequences of automated decision aids in states of sleep loss. Human Factors, 53, 717-728.
76. Roediger H. L., Karpicke J. D., (2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181-210.
77. Rouse W. B., (1988). Adaptive aiding for human/computer control. Human Factors, 30, 431-438.
78. Rovira E., McGarry K., Parasuraman R., (2007). Effects of imperfect automation on decision making in a simulated command and control task. Human Factors, 49, 76-87.
79. Salas E., Prince C., Baker D. P., Shrestha L., (1995). Sitaution awareness in team performance: Implications for measurement and training. Human Factors, 37, 123-136.
80. Sarter N. B., Schroeder B., (2001). Supporting decision making and action selection under time pressure and uncertainty: The case of in-flight icing. Human Factors, 43, 573-583.
81. Scerbo M. W., (1996). Theoretical perspectives on adaptive automation. In Parasuraman R., Mouloua M., (Eds.), Automation and human performance: Theory and application (pp. 37-63). Mahwah, NJ: Lawrence Erlbaum.
82. Schaefer K. E., Chen J. Y. C., Szalma J. L., Hancock P. A., (2016). A meta-analysis of factors influencing the development of trust in automation: Implications for understanding autonomy in future systems. Human Factors, 58, 377-400.
83. Sethumadhavan A., (2009). Effects of automation types on air traffic controller situation awareness and performance. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting (pp. 1-5). Santa Monica, CA: Human Factors and Ergonomics Society.
84. Sheridan T. B., Verplanck W. L., (1978). Human and computer control of undersea teleoperators. Cambridge, MA: MIT Man-Machine Laboratory.
85. Sklar A. E., Sarter N. B., (1999). Good vibrations: Tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors, 41, 543-552.
86. Slamecka N. J., Graf P., (1978). The generation effect: Delineation of a phenomenon. Journal of Experimental Psychology: Human Learning and Memory, 4, 592-604.
87. Taylor R. M., Reising J., (1994). The human-electronic crew: Can we trust the team? Wright Patterson Air Force Base, OH: Flight Dynamics Directorate, Wright Laboratory, Air Force Materiel Command.
88. U.S. Air Force. (2015). Autonomous horizons. Washington, DC: U.S. Air Force Office of the Chief Scientist.
89. U.S. Canada Power System Outage Task Force. (2004). Final report on the August 14, 2003 blackout in the United States and Canada: Causes and recommendations. Retrieved from http://certs.lbl.gov/pdf/b-f-web-part1.pdf
90. Wickens C. D., Dixon S. R., (2007). The benefits of imperfect diagnostic automation: A synthesis of the literature. Theoretical Issues in Ergonomics Science, 8, 201-212.
91. Wickens C. D., Kessel C., (1979). The effect of participatory mode and task workload on the detection of dynamic system failures. IEEE Transactions on Systems, Man and Cybernetics, 9, 24-34.
92. Wickens C. D., Sebok A., Li H., Sarter N., Gacy A. M., (2015). Using modeling and simulation to predict operator performance and automation induced complacency with robotic automation: A case study and empirical validation. Human Factors, 57, 959-975.
93. Wiener E. L., Curry R. E., (1980). Flight deck automation: Promises and problems. Ergonomics, 23, 995-1011.
94. Wilson G. F., Russell C. A., (2007). Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Human Factors, 49, 1005-1018.
95. Woods D. D., (2016). The risks of automomy: Doyle's catch. Journal of Cognitive Engineering and Decision Making, 10, 131-133.
96. Woods D. D., Cook R. I., (2006). Incidents: Markers of resilience or brittleness? In Hollnagel E., Woods D. D., Leveson N., (Eds.), Resilience engineering: Concepts and precepts (pp. 69-76). Aldershot, UK: Ashgate.
97. Yeh M., Wickens C. D., Seagull F. J., (1999). Target cueing in visual search: The effects of conformality and display location on the allocation of visual attention. Human Factors, 41, 524-542.
98. Young L. R. A., (1969). On adaptive manual control. Ergonomics, 12, 635-657.