Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel

Human Factors

Volumn 60, Issue 8, 2018, Pages 1095-1116

  Victor, Trent W ^a   Tivesten, Emma ^a   Gustavsson, Pär ^a   Johansson, Joel ^a   Sangberg, Fredrik ^a   Ljung Aust, Mikael ^a  

^a VOLVO CAR CORPORATION   (Sweden)

Author keywords

accident analysis; attentional processes; autonomous driving; human automation interaction; mental models; shared mental models

Indexed keywords

ACCIDENTS; COGNITIVE SYSTEMS; WHEELS;

ACCIDENT ANALYSIS; ACTIVE DRIVERS; ASSISTANCE SYSTEM; AUTONOMOUS DRIVING; HIGHLY RELIABLE; INTERVENTION RESPONSE; MENTAL MODEL; SHARED MENTAL MODEL;

AUTOMATION;

ACCIDENT; ARTICLE; ATTENTION; AUTOMATION; DRIVER; EXPECTATION; EYE; HUMAN; HUMAN EXPERIMENT; PREDICTION; RESPONSIBILITY; ADULT; CAR DRIVING; CONFLICT; FEMALE; MALE; MAN MACHINE INTERACTION; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; TRAFFIC ACCIDENT;

ACCIDENTS, TRAFFIC; ADULT; ATTENTION; AUTOMATION; AUTOMOBILE DRIVING; CONFLICT (PSYCHOLOGY); FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; MODELS, PSYCHOLOGICAL; PSYCHOMOTOR PERFORMANCE;

EID: 85052591959     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720818788164     Document Type: Article

References (57)

1. Bainbridge L., (1983). Ironies of automation. Automatica, 19, 775–779
2. Beggiato M., Krems J. F., (2013). The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F, 18, 47–57. doi:10.1016/j.trf.2012.12.006
3. Benjamini Y., Hochberg Y., (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289–300
4. Billings C. E., (1988). Toward human centered automation. In Norman S. D., Orlady H. W., (Eds.), Flight deck automation: Promises and realities (pp. 167–190). Moffet Field, CA: NASA-Ames Research Center
5. Bradley M. M., Lang P. J., (1994). Measuring emotion: The self-assessment mannequin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49–59
6. Campbell J. L., Brown. J. L., Graving J. S., Richard C. M., Lichty M. G., Sanquist T... Morgan J. L., (2016). Human factors design guidance for driver-vehicle interfaces (Report No. DOT HS 812 360). Washington, DC: National Highway Traffic Safety Administration
7. Clark A., (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36, 181–204. doi:10.1017/S0140525X12000477
8. de Winter J. C. F., Happee R., Martens M., Stanton N. A. (2014). Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence. Transportation Research Part F: Traffic Psychology and Behaviour, 27, 196–217
9. Endsley M. R., (2015). Autonomous horizons: System autonomy in the air force. A path to the future (Autonomous Horizons No. AF/ST TR 15-01). Washington DC: Department of the Air Force Headquarters of the Air Force. Retrieved from http://www.af.mil/Portals/1/documents/SECAF/AutonomousHorizons.pdf?timestamp=1435068339702
10. Endsley M. R., Kiris E. O., (1995). The out-of-the-loop performance problem and level of control in automation. Human Factors, 37, pp. 381–394
11. Engström J., Bärgman J., Nilsson D., Bianchi Piccinini G. F., Seppelt B., Markkula G., Victor T., (2017). Great expectations: A predictive processing account for automobile driving. Theoretical Issues in Ergonomics Science. Advance online publication. doi:10.1080/1463922X.2017.1306148
12. Eugensson A., Ivarsson J., Lie A., Tingvall C., (2011, June). Cars are driven on roads, joint visions and modern technologies stress the need for co-operation. Paper presented at the International Technical Conference on the Enhanced Safety of Vehicles, Washington, DC
13. Hergeth S., (2016). Automation trust in conditional automated driving systems: Approaches to operationalization and design (unpublished thesis). doi:10.13140/RG.2.2.35823.02724
14. Hergeth S., Lorenz L., Vilimek R., Krems J. F., (2016). Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving. Human Factors, 58, 509–519. doi:10.1177/0018720815625744
15. Hoff K. A., Bashir M., (2015). Trust in automation: Integrating empirical evidence on factors that inuence trust. Human Factors, 57, 407–434. doi:10.1177/0018720814547570
16. International Organization for Standardization. (2014). ISO 15007-1:2014 Road vehicles – Measurement of driver visual behaviour with respect to transport information and control systems – Part 1: Definitions and parameters. Retrieved from https://www.iso.org/standard/56621.html
17. Johansson J., (2009). Vision Zero: Implementing a policy for traffic safety. Safety Science, 47, 826–831. http://dx.doi.org/10.1016/j.ssci.2008.10.023
18. Kaida K., Takahashi M., Åkerstedt T., Nakata A., Otsuka Y., Haratani T., Fukasawa K., (2006). Validation of the Karolinska Sleepiness Scale against performance and EEG variables. Clinical Neurophysiology, 117, 1574–1581
19. Larsson A. F. L., (2012). Driver usage and understanding of adaptive cruise control. Applied Ergonomics, 43, 501–506
20. Lee J. D., Moeckli J., Brown T. L., Roberts S. C., Schwarz C., Yekhshatyan L., Nadler E., Liang Y., Victor T., Marshall D., (2013). Distraction detection and mitigation through driver feedback (Report DOT HS 811 547A). Washington, DC: National Highway Traffic Safety Administration
21. Lee J. D., See K. A., (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50–80
22. Lee J. D., Wickens C., Liu Y., Boyle L., (2017). Designing for people: An introduction to human factors engineering (3rd ed.). ISBN:1539808009
23. Lindman M., Isaksson-Hellman I., Strandroth J., (2017). Basic numbers needed to understand the traffic safety effect of automated cars. In IRC-17-40 IRCOBI Conference 2017 (pp. 244–256). Retrieved from http://www.ircobi.org/wordpress/downloads/irc17/pdf-files/10.pdf
24. Mack A., Rock I., (1998). Inattentional blindness. Cambridge, MA: MIT Press
25. Merat N., Seppelt B., Louw T., Engström J., Lee J.D., Johansson E... Keinath A., (2018). The “out-of-the-loop” concept in automated driving: Proposed definition, measures and implications. Manuscript submitted for publication
26. Metzger U., Parasuraman R., (2005). Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors, 47, 35–49
27. Miller E. K., Cohen J. D., (2001). An integrative theory of prefrontal cortex function. Annual Reviews of Neuroscience, 24, 167–202. doi:10.1146/annurev.neuro.24.1.167
28. Molloy R., Parasuraman R., (1996). Monitoring an automated system for a single failure: Vigilance and task complexity effects. Human Factors, 38, 311–322
29. Morando A., Victor T., Dozza M., (2018). A reference model for driver attention in automation: Glance behavior changes during lateral and longitudinal assistance. Manuscript submitted for publication
30. Muir B. M., Moray N., (1996). Trust in automation: Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460. doi:10.1080/00140139608964474
31. Mulder M., Abbink D., Carlson T., (2015). Introduction to the special issue on shared control: Applications. Journal of Human–Robot Interaction, 4. doi:10.5898/JHRI.4.3.Mulder
32. National Highway Traffic Safety Administration. (2015). Critical reasons for crashes investigated in the National Motor Vehicle Crash Causation Survey (DOT HS 812115). Retrieved from https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812115
33. Nidhi K., Groves D. G., (2017). The enemy of good: Estimating the cost of waiting for nearly perfect automated vehicles. Santa Monica, CA: RAND Corporation. Retrieved from https://www.rand.org/pubs/research_reports/RR2150.html
34. Nidhi K., Paddock S. M., (2016). Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability? Santa Monica, CA: RAND Corporation. Retrieved from https://www.rand.org/pubs/research_reports/RR1478.html
35. Onnasch L., Wickens C. D., Li H., Manzey D., (2013). Human performance consequences of stages and levels of automation: An integrated meta-analysis. Human Factors. Advance online publication. doi:10.1177/0018720813501549
36. Parasuraman R., Manzey D. H., (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52, 381–410
37. Parasuraman R., Riley V., (1997). Humans and automation: Use, misuse, disuse and abuse. Human Factors, 39, 230–253
38. Parasuraman R., Sheridan T., Wickens C., (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man and Cybernetics, 30, 286–297
39. Parasuraman R., Sheridan T. B., Wickens C. D., (2008). Situation awareness, mental workload, and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making, 2, 140–160. doi:10.1518/155534308X284417
40. Payre W., Cestac J., Delhomme P., (2015). Fully automated driving: Impact of trust and practice on manual control recovery. Human Factors, 58, 229–241. doi:10.1177/0018720815612319
41. Price M., Lee J., Dinparastdjadid A., Toyoda H., Domeyer J., (2017, September). Effect of vehicle control algorithms on eye behavior in highly automated vehicles. Paper presented at Fourth International Symposium on Future Active Safety Technology, Nara, Japan
42. SAE. (2016). SAE J3016 taxonomy and definitions for terms related to driving automation systems for on-road motor vehicle. Retrieved from https://saemobilus.sae.org/content/j3016_201609
43. Sarter N. B., Woods D. D., (1994, June). Autonomy, authority, and observability: The evolution of critical automation properties and their impact on man-machine coordination and cooperation. Paper presented at the 6th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Man–Machine Systems, Cambridge, MA
44. Sarter N. B., Woods D.D., (1995). “How in the world did I ever get into that mode”: Mode error and awareness in supervisory control. Human Factors, 37, 5–19
45. Seppelt B., (2009). Supporting operator reliance on automation through continuous feedback (Doctoral dissertation). University of Iowa, Iowa City. Retrieved from http://ir.uiowa.edu/cgi/viewcontent.cgi?article=1617&context=etd
46. Seppelt B., Lee J., (2012). Human factors and ergonomics in automation design. In Salvendy G., (Ed.), Handbook of human factors and ergonomics (4th ed., pp. 1615–1642). New York, NY: Wiley. doi:10.1002/9781118131350.ch59
47. Seppelt B. D., Victor T. W., (2016). Potential solutions to human factors challenges in road vehicle automation. In Meyer G., Beiker S., (Eds.), Road vehicle automation 3 (pp. 131–148). Cham, Switzerland: Springer International. https://doi.org/10.1007/978-3-319-40503-2_11
48. Sheridan T., (1992). Telerobotics, automation and human supervisory control. Cambridge, MA: MIT Press
49. Simons D. J., Levin D. T., (1997). Change blindness. Trends in Cognitive Sciences, 1, 261–267. doi:10.1016/s1364-6613(97)01080-2
50. Strand N., Nilsson J., Karlsson I. M., Nilsson L., (2014). Semi-automated versus highly automated driving in critical situations caused by automation failures. Transportation Research Part F: Traffic Psychology and Behaviour, 27, 218–228
51. Trimble T., Bishop R., Morgan J., Blanco M., (2014). Human factors evaluation of Level 2 and Level 3 automated driving concepts: Past research, state of automation technology, and emerging system concepts (DOT HS 812 043). Washington, DC: National Highway Traffic Safety Administration
52. Victor T., (2005). Keeping eye and mind on the road. Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Social Sciences 9. Uppsala, Sweden: Acta Universitatis Upsaliensis
53. Victor T., Dozza M., Bärgman J., Boda C.-N., Engström J., Flannagan C., Lee J. D., Markkula G., (2015). Analysis of Naturalistic Driving Study data: Safer glances, driver inattention and crash risk. Washington, DC: Transportation Research Board. Retrieved from http://onlinepubs.trb.org/onlinepubs/shrp2/SHRP2_S2-S08A-RW-1.pdf
54. Victor T., Harbluk J. L., Engström J. A., (2005). Sensitivity of eye-movement measures to in-vehicle task difficulty. Transportation Research Part F: Traffic Psychology and Behaviour, 8, 167–190
55. Victor T., Rothoff M., Coelingh E., Ödblom A., Burgdorf K., (2017). When autonomous vehicles are introduced on a larger scale in the road transport system: The Drive Me project. In Watzenig D., Horn M., (Eds.), Automated driving: Safer and more efficient future driving (pp. 541–546). Cham, Switzerland: Springer International
56. Wickens C. D., Hooey B., Gore B. F., Sebok A., Koenicke C., (2009). Identifying black swans in NextGen: Predicting human performance in off-nominal conditions. Human Factors, 51, 638–651
57. Wiener E. L., Curry R. E., (1980). Flight deck automation: Promises and problems. Ergonomics, 23, 995–1011