Ironies of Automation: Still Unresolved after All These Years

IEEE Transactions on Human-Machine Systems

Volumn 48, Issue 5, 2018, Pages 419-433

  Strauch, Barry ^a,b  

^a NATIONAL TRANSPORTATION SAFETY BOARD   (United States)

^b NONE   (United States)

Author keywords

Automation; ergonomics; human factors; man machine systems; vehicular automation

Indexed keywords

ACCIDENT PREVENTION; ACCIDENTS; ERGONOMICS; HUMAN ENGINEERING; MONITORING; PERSONNEL TRAINING; RELIABILITY;

ACCIDENT INVESTIGATORS; AUTOMATED SYSTEMS; MACHINE SYSTEMS; OPERATOR INTERVENTIONS; OPERATOR PERFORMANCE; SYSTEM ELEMENTS; SYSTEM OPERATION; SYSTEMS OPERATION;

AUTOMATION;

EID: 85028462842     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2017.2732506     Document Type: Article

References (68)

1. L. Bainbridge, "Ironies of automation, " Automatica, vol. 19, no. 6, pp. 775-779, 1983.
2. E. L Wiener and R. E. Curry, "Flight-deck automation: Promises and problems, " Ergonomics, vol. 23, no. 10, pp. 995-1011, 1980.
3. D.A. Norman, "The problem with automation: Inappropriate feedback and interaction, not 'over-automation, " Philosoph. Trans. Roy. Soc. London, vol. 327, pp. 85-593, Apr. 1990.
4. G. Baxter, J. Rooksby, Y. Wang, and A. Khajeh-Hosseini, "The ironies of automation.. still going strong at 30, " in Proc. ECCE 2012 Conf., Edinburgh, Scotland, 2012, pp. 65-71.
5. M. L. Jones, "The ironies of automation law: Tying policy knots with fair automation practices principles, " Vanderbilt J. Entertainment Tech. Law, vol. 18, no. 1, pp. 77-134, 2015.
6. M. R. Endsley and E. O. Kiris, "The out-of-the-loop performance problem and level of control in automation, " Human Factors, vol. 37, no. 2, pp. 381-394, 1995.
7. K. L. Mosier, L. J. Skitka, S. Heers, and M. Burdick, "Automation bias: Decision making and performance in high-tech cockpits, " Int. J. Aviat. Psych., vol. 8, no. 1, pp. 47-63, 1998.
8. L. J. Skitka and K. L Mosier, "Automation bias and errors: Are crews better than individuals, " Int. J. Av. Psych., vol. 10, no. 1, pp. 85-97, 2000.
9. R. Parasuraman and D. H. Manzey, "Complacency and bias in human use of automation: An attentional integration, " Human Factors, vol. 52, no. 3, pp. 381-410, 2010.
10. N. Sarter and D. D. Woods, "How in the world did we ever get into that mode? Mode error and awareness in supervisory control, " Human Factors, vol. 37, no. 1, pp. 5-19, 1995.
11. R. Parasuraman and V. Riley, "Humans and automation: Use, misuse, disuse and abuse, " Human Factors, vol. 39, no. 2, pp. 230-253, 1997.
12. C. E. Billings, Aviation Automation: The Search for a Human-Centered Approach. Mahwah, NJ, USA: LEA, 1997.
13. S. M. Casner, R. W. Geven, M. P. Recker, and J. W. Schooler, "The retention of manual flying skills in the automated cockpit, " Human Factors, vol. 56, no. 8, pp. 1506-1516, 2014.
14. R. Parasuraman and C. D. Wickens, "Humans: Still vital after all these years of automation, " Human Factors, vol. 50, no. 3, pp. 511-520, 2008.
15. J. Rasmussen, "Skills, rules, knowledge: Signals, signs, and symbols and other distinctions in human performance models, " IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 3, pp. 257-266, May/Jun. 1983.
16. C. Perrow, Normal Accidents: Living With High-Risk Technologies. New York, NY, USA: Basic Books, 1984.
17. W. B. Rouse and S. H. Rouse, "Analysis and classification of human error, " IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 4, pp. 539-549, Jul./Aug. 1983.
18. A. I. Siegel and J. J. Wolf, "A technique for evaluating man-machine system designs, " Human Factors, vol. 3, no. 1, pp. 18-28, 1961.
19. C. W. Suggs, "Application of servo theory to a manual repetitive operation, " Human Factors, vol. 9, no. 5, pp. 433-438, 1967.
20. S. Baron and D. L. Kleinman, "The human as an optimal controller and information processor, " IEEE Trans. Man-Mach. Syst. vol. MMS-10, no. 1, pp. 9-17, Mar. 1969.
21. A. E. Preyss and J. L. Meiry, "Stochastic modeling of human learning behavior, " IEEE Trans. Man-Mach. Syst., vol. MMS-9, no. 2, pp. 36-46, Jun. 1968.
22. H. A. Sholl, "Modeling of an operator's performance in a short-term visual information processing task, " IEEE Trans. Syst., Man, Cybern., vol. SMC-2, no. 3, pp. 352-362, Jul. 1972.
23. W. B. Rouse, "A model of the human as a suboptimal smoother, " IEEE Trans. Syst., Man, Cybern., vol. SMC-6, no. 5, pp. 337-343, May 1976.
24. D. L. Kleinman and R. E. Curry, "Some new control theoretic models for human operator display monitoring, " IEEE Trans. Syst., Man, Cybern., vol. 7, no. 11, pp. 778-784, Nov. 1977.
25. R. W. Taylor, "Man-computer input-output techniques, " IEEE Trans. Human Factors Electron., vol. HFE-8, no. 1, pp. 1-4. Mar. 1967.
26. T. C. Ting and A. N. Badre, "A dynamic model of man-machine interactions: Design and application with an audiographic learning facility, " Int. J. Man-Mach. Stud., vol. 8, pp. 75-88, 1976.
27. A. D. Swain, "Some problems in the measurement of human performance in man-machine systems, " Human Factors, vol. 6, no. 6, pp. 687-700, 1964.
28. J. A. Adams, "Issues in human reliability, " Human Factors, vol. 24, no. 1, pp. 1-10, 1982.
29. C. D. Wickens and C. Kessel, "The effect of participatory mode and task workload on the detection of dynamic system failures, " IEEE Trans. Syst., Man, Cybern., vol. 9, no. 1, pp. 24-31, Jan. 1979.
30. L. Bainbridge, J. Beishon, J. Hemming, and M. Splaine, "A study of realtime human decision-making using a plant simulator, " Operations Res. Quart., vol. 19, pp. 91-106, 1968.
31. L. Bainbridge, "An analysis of a verbal protocol from a process control task, " Ph.D. dissertation, Bristol, U.K., Univ. Bristol, 1972.
32. L. Bainbridge, "The influence of display type on decision making, " in Proc. IEEE Conf. Publ., no. 80, Displays, 1971, pp. 209-215.
33. L. Bainbridge, "Problems in the assessment of mental load, " Le Travail Humane, vol. 37, no. 2, pp. 279-302, 1974.
34. L. Bainbridge, "Forgotten alternatives in skills and workload, " Ergonomics, vol. 21, no. 3, pp. 169-185, 1978.
35. L. Bainbridge, "Verbal reportsas evidenceofthe process operator's knowledge, " Int. J. Man-Mach. Stud., vol. 11, pp. 411-436, 1979.
36. L. Bainbridge, "Mathematical equations or processing routines, " in Human Detection and Diagnosis of System Failures NATO Conference Series III: Human Factors, vol. 15, J. Rasmussen and W. B. Rouse, Eds. New York, NY, USA: Plenum Press, 1981, pp. 259-286.
37. L. Bainbridge, "Diagnostic skills in process operations, " in Proc. 1984 Int. Conf. Occup. Ergon., vol. 2: Revs., Toronto, ON, Canada, 1984, pp. 1-10.
38. A. S. Baum and C. G. Drury, "Modelling the human process controller, " Int. J. Man-Mach. Stud., vol. 8, pp. 1-11, 1976.
39. National Highway Traffic Safety Administration, Federal Automated Vehicles Policy, 2016. [Online]. Available: https://one.nhtsa.gov/nhtsa/av/pdf/Federal-Automated-Vehicles-Policy.pdf
40. National Transportation Safety Board, Marine accident report, heeling accident on M/V Crown Princess, Atlantic Ocean off Port Canaveral, FL, USA, Jul. 18, 2006, (MAR-08/01), 2008. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/MAR0801.pd
41. National Transportation Safety Board, Aircraft accident report, China Airlines Boeing 747-SP, N4522V, 300 nautical miles northwest of San Francisco, San Francisco, CA, USA, Feb. 19, 1985, (AAR-86/03), 1985. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR8603.pdf
42. R. D. Sorkin, "Why are people turning off our alarms, " J. Acoust. Soc. Am., vol. 84, no. 3, pp. 1107-1108, 1988.
43. National Transportation Safety Board, Railroad accident report, rear-end collision of Amtrak passenger Train 94, The Colonial, and Consoli-dated Rail Corporation Freight Train ENS 121, on the Northeast Corridor, Chase, MD, USA, Jan. 4, 1987. (RAR-88/01), 1988. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/RAR8801.pdf
44. Bureau d'Enquêtes et d'Analyses pour la Sécurité de l'Aviation Civile, Final report on the accident on 1st June 2009, to the Air-bus A330-203, F-GZCP, by Air France, AF 447 Rio de Janeiro-Paris, 2012. [Online]. Available: https://www.bea.aero/docspa/2009/f-cp090601.en/pdf/f-cp090601.en.pdf
45. National Transportation Safety Board, Enbridge Incorporated, Haz-ardous liquid pipeline rupture and release, Marshall, MI, USA, Jul. 25, 2010, (PAR-12/01), 2012. [Online]. Available: https://www. ntsb.gov/investigations/AccidentReports/Reports/PAR1201.pdf
46. National Transportation Safety Board, Aircraft accident report, stall and loss of control on final approach, Atlantic Coast Airlines, Inc./United Express Flight 6291, Jetstream 4101, N304UE, Columbus, OH, USA, Jan. 7, 1994, (AAR-94/07), 1994. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Pages/AAR9407. aspx
47. National Transportation Safety Board, Aircraft accident report, flight into terrain during missed approach, USAir Flight 1016, DC-9-31, N954VJ, Charlotte/Douglas International Airport, Charlotte, NC, USA, Jul. 2, 1994, (AAR-95/03), 1995. [Online]. Available: https://www. ntsb.gov/investigations/AccidentReports/Reports/AAR9503.pdf
48. His Majesty's Government of Nepal, Report on the accident of Thai Airways International A310, flight TG 311 (HS-TID), 31 July 1991, Kat-mandu, Nepal, 1993.
49. Aeronautica Civil of the Government of Colombia, Aircraft accident report, controlled flight into terrain, American Airlines Flight 965, Boeing 757-223, N651AA, near Cali, Colombia, December 20, 1995, Bogotá, Colombia, 1996.
50. National Transportation Safety Board, Aircraft accident report, Scan-dinavian Airlines System, Flight 901, McDonnell Douglas DC-10-30, John F. Kennedy International Airport, Jamaica, NY, USA, Feb. 28, 1984, (AAR-84/15), 1984. [Online]. Available: https://www.ntsb. gov/investigations/AccidentReports/Pages/AAR8415.aspx
51. Dutch Safety Board, Crashed during approach, Boeing 737-800, Amsterdam Schiphol Airport, 25 February 2009, The Hague, 2010. [Online]. Available: https://www.onderzoeksraad.nl/en/onderzoek/1748/crashed-during-approach-boeing-737-800-amsterdam-schiphol-airport/fase/1475/dutch-safety-board-issues-preliminary-report-crash-turkish-airlines
52. National Transportation Safety Board, Aircraft accident report, descent below visual glidepath and impact with seawall, Asiana Airlines Flight 214, Boeing 777-200ER, HL7742, San Francisco, CA, USA, Jul. 6, 2013. (AAR-14/01). 2014. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR1401.pdf
53. B. Strauch, "The automation-by-expertise-by-training interaction: Why automation-related accidents continue to occur in sociotechnical systems, " Human Factors, vol. 59, no. 2, pp. 204-228, 2017.
54. Federal Aviation Administration. (1996). Human factors team report on the interfaces between flightcrews and modern flight deck systems. 1996. [Online] Available: www.tc.faa.gov/its/worldpac/techrpt/hffaces. pdf
55. Federal Aviation Administration, Final report of the performance-based operations aviation rulemaking committee/commercial aviation safety team flight deck automation working group, 2013. [Online] Available: https://www.faa.gov/about/office-org/headquarters-offices/avs/offices/afs/afs400/parc/parc-reco/media/2013/130908-parc-fltdawg-final-report-recommendations.pdf
56. S. M. Casner, R. W. Geven, and K. T. Williams, "The effectiveness of airline pilot training for abnormal events, " Human Factors, vol. 55, no. 3, pp. 477-485, 2013.
57. P. A. Hancock, "Automation: How much is too much, " Ergonomics, vol. 57, no. 3, pp. 449-454, 2014.
58. National Transportation Safety Board, Railroad accident report, collision of Metrolink train 111 with Union Pacific train LOF65-12. Chatsworth, CA, USA, Sep. 12, 2008, (RAR-10/01), 2010. [Online]. Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/RAR1001. pdf
59. National Highway Traffic Safety Administration, Critical reasons for crashes investigated in the National Motor Vehicles Crash Causation Survey, 2015. [Online]. Available: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812115
60. D. D. Woods, "The risks of autonomy: Doyle's Catch, " J. Cogn. Eng. Decision Making, vol. 10, pp. 131-133, Jun. 2016.
61. A. Sebok and C. D. Wickens, "Implementing lumberjacks and black swans into model-based tools for support human-automaton interaction, " Human Factors, vol. 59, no. 2, pp. 189-203. 2017.
62. A. F. L. Larsson, K. Kircher, and J. A. Hultgren, "Learning from ex-perience: Familiarity with ACC and responding to a cut-in situation in automatic driving, " Transp. Res. Part F, vol. 27, pp. 229-237, 2014.
63. N. Merat, A. H. Jamson, F. C. H. Lai, M. Daly, and O. J. J. Carsten, "Transition to manual: Driver behavior when resuming control from a highly automated vehicle, " Transp. Res. Part F, vol. 27, pp. 274-282, 2014.
64. N. Strand, J. Jilsson, I. C. M. Karlsson, and L. Nilsson, "Semi-automated versus highly automated driving in critical situations caused by automation failures, " Transp. Res. Part F, vol. 27, pp. 218-228, 2014.
65. M. R. Endsley, "From here to autonomy: Lessons learned from human-automation research, " Human Factors, vol. 59, no. 1, pp. 5-27, 2017.
66. K. Stowers, J. Oglesby, S. Sonesh, K. Leyva, Iwig, and E. Salas, "A framework to guide the assessment of human-machine systems, " Human Factors, vol. 59, no. 2, pp. 172-188, 2017.
67. National Transportation Safety Board, Allision of the Passenger Vessel Seastreak Wall Street with Pier 11, Lower Manhattan, New York, New York, January 9, 2013, (MAR-14/01), 2014. [Online] Available: https://www.ntsb.gov/investigations/AccidentReports/Reports/MAR1401.pdf
68. J. S. Bauer, M. W. Newman, and J. A. Kientz, "What designers talk about when they talk about context, " Human-Comput. Interaction, vol. 29, pp. 420-450, 2014.