Trust and Distrust of Automated Parking in a Tesla Model X

Human Factors

Volumn 62, Issue 2, 2020, Pages 194-210

  Tenhundfeld, Nathan L ^a   de Visser, Ewart J ^b   Ries, Anthony J ^b   Finomore, Victor S ^c   Tossell, Chad C ^b  

^a UNIVERSITY OF ALABAMA IN HUNTSVILLE   (United States)

^b UNITED STATES AIR FORCE ACADEMY   (United States)

^c WEST VIRGINIA UNIVERSITY   (United States)

Author keywords

autonomous parking; driving; self driving cars; self parking; Tesla; trust in automation

Indexed keywords

AUTONOMOUS VEHICLES; BEHAVIORAL RESEARCH; RISK MANAGEMENT;

AUTOMATED FEATURES; AUTONOMOUS PARKING; BEHAVIORAL INTERVENTIONS; DRIVING; OPEN-ENDED QUESTIONS; RECENT RESEARCHES; RISK-TAKING BEHAVIORS; TESLA;

AUTOMATION;

ADULT; ARTICLE; AUTOMATION; CONTROLLED STUDY; DRIVER; ERROR; FEMALE; HIGH RISK BEHAVIOR; HUMAN; HUMAN EXPERIMENT; MALE; QUESTIONNAIRE; TRUST; ADOLESCENT; CAR; CAR DRIVING; MAN MACHINE INTERACTION; PSYCHOLOGY; YOUNG ADULT;

ADOLESCENT; AUTOMATION; AUTOMOBILE DRIVING; AUTOMOBILES; HUMANS; MALE; MAN-MACHINE SYSTEMS; RISK-TAKING; SURVEYS AND QUESTIONNAIRES; TRUST; YOUNG ADULT;

EID: 85070953759     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720819865412     Document Type: Article

References (59)

1. American Automobile Association (AAA). (2015). Fact sheet: Active parking assist systems. Retrieved from http://publicaffairsresources.aaa.biz/wp-content/uploads/2016/02/Automotive-Engineering-ADAS-Survey-Fact-Sheet-FINAL-3.pdf
2. Abrams R., Kurtz A., (2016, July 1). Joshua Brown, who died in self-driving accident, tested limits of his Tesla. The New York Times. Retrieved from https://www.nytimes.com/2016/07/02/business/joshua-brown-technology-enthusiast-tested-the-limits-of-his-tesla.html
3. Andersen K. E., Koslich S., Pedersen B. M. K., Weigelin B. C., Jensen L. C., (2017). Do we blindly trust self-driving cars? In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-robot Interaction (pp. 67–68). Retrieved from https://dl.acm.org/citation.cfm?id=3038428
4. Banks V. A., Eriksson A., O’Donoghue J., Stanton N. A., (2018). Is partially automated driving a bad idea? Observations from an on-road study. Applied Ergonomics, 68, 138–145.
5. Basu C., Yang Q., Hungerman D., Singhal M., Dragan A. D., (2017). Do you want your autonomous car to drive like you? In Proceedings of the 2017 ACM/IEEE International Conference on Human-robot Interaction–HRI’17 (pp. 417–425). doi:10.1145/2909824.3020250
6. Bondi E., Fang F., Hamilton M., Kar D., Dmello D., Choi J... Nevatia R., (2018). SPOT poachers in action: Augmenting conservation drones with automatic detection in near real time. In The Thirtieth AAAI Conference on Innovative Applications of Artificial Intelligence (IAAI-18) (pp. 7741–7746). Retrieved from https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16282
7. Chen J. Y. C., Procci K., Boyce M., Wright J., Garcia A., Barnes M. J., (2014). Situation awareness-based agent transparency (No. ARL-TR-6905). Retrieved from https://apps.dtic.mil/dtic/tr/fulltext/u2/a600351.pdf
8. Davies A., (2018). The wired guide to self-driving cars. Wired, 1–13. doi:10.1002/jbm.820140406
9. de Visser E. J., Monfort S. S., Mckendrick R., Smith M. A. B., Mcknight P. E., Krueger F. (2016). Almost human: Anthropomorphism increases trust resilience in cognitive agents. Journal of Experimental Psychology: Applied, 22, 331–349. doi:10.1037/xap0000092
10. de Visser E. J., Pak R., Shaw T. H. (2018). From “automation” to “autonomy”: The importance of trust repair in human-machine interaction. Ergonomics, 61, 1409–1427.
11. de Visser E. J., Parasuraman R. (2011). Adaptive aiding of human-robot teaming: Effects of imperfect automation on performance, trust, and workload. Journal of Cognitive Engineering and Decision Making, 5, 209–231. doi:10.1177/1555343411410160
12. De Winter J. C. F., Happee R., Martens M. H., Stanton N. A. (2014). Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence. Transportation Research Part F: Traffic Psychology and Behaviour, 27(Pt. B), 196–217. doi:10.1016/j.trf.2014.06.016
13. Endsley M. R., (2017). Autonomous driving systems: A preliminary naturalistic study of the Tesla Model S. Journal of Cognitive Engineering and Decision Making, 11, 225–238. doi:10.1177/1555343417695197
14. Eriksson A., Banks V. A., Stanton N. A., (2017). Transition to manual: Comparing simulator with on-road control transitions. Accident Analysis & Prevention, C, 102, 227–234.
15. Fridman L., (2018). Human-centered autonomous vehicle systems: Principles of effective shared autonomy. arXiv. Retrieved from https://arxiv.org/abs/1810.01835
16. Fridman L., Brown D. E., Glazer M., Angell W., Dodd S., Jenik B... Reimer B., (2017). MIT autonomous vehicle technology study: Large-scale deep learning based analysis of driver behavior and interaction with automation. Arxiv Preprint, 1–17. Retrieved from https://arxiv.org/abs/1711.06976
17. Griggs T., Wakabayashi D., (2018, March 21). How a self-driving Uber killed a pedestrian in Arizona. The New York Times. Retrieved from https://www.nytimes.com/interactive/2018/03/20/us/self-driving-uber-pedestrian-killed.html
18. Gunning D., (2017). Explainable Artificial Intelligence (XAI). Retrieved from https://www.darpa.mil/attachments/XAIProgramUpdate.pdf
19. Hancock P. A., Billings D. R., Schaefer K. E., Chen J. Y. C., de Visser E. J., Parasuraman R., (2011). A meta-analysis of factors affecting trust in human-robot interaction. Human Factors, 53, 517–527. doi:10.1177/0018720811417254
20. Hoff K. A., Bashir M., (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57, 407–434. doi:10.1177/0018720814547570
21. Howe G., Xu G., Hoover R., Elsasser D., Barickman F., (2016). Commercial connected vehicle test procedure development and test results—Forward collision warning. Washington, DC. Retrieved from https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/812298_connectedvehiclev2vreport.pdf
22. Kaber D. B., Endsley M. R., (2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science, 5, 113–153. doi:10.1080/1463922021000054335
23. Körber M., Baseler E., Bengler K., (2018). Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics, 66, 18–31.
24. Langley P., Meadows B., Sridharan M., Choi D., (2017). Explainable agency for intelligent autonomous systems. In 29th AAAI Conference on Innovative Applications (IAAI-17) (pp. 4762–4763). doi:10.1074/jbc.P110.201731
25. Lee J. D., Moray N., (1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270.
26. Lee J. D., Moray N., (1994). Trust, self-confidence, and operators’ adaptation to automation. International Journal of Human-Computer Studies, 40, 153–184.
27. Lee J. D., See K. A., (2004). Trust in automation: Designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46, 50–80. doi:10.1518/hfes.46.1.50_30392
28. Lejuez C. W., Read J. P., Kahler C. W., Richards J. B., Ramsey S. E., Stuart G. L... Strong D. R., (2002). Evaluation of a behavioral measure of risk taking: The Balloon Analogue Risk Task (BART). Journal of Experimental Psychology: Applied, 8, 75–84. doi:10.1037//1076-898X.8.2.75
29. Lyons J. B., Ho N. T., Van Abel A. L., Hoffmann L. C., Sadler G. G., Fergueson W. E... Wilkins M., (2017). Comparing trust in auto-GCAS between experienced and novice air force pilots. Ergonomics in Design, 25(4), 4–9. doi:10.1177/1064804617716612
30. Mcdowell K., Nunez P., Hutchins S. D., Metcalfe J. S., (2008). Secure mobility and the autonomous driver. IEEE Transactions on Robotics, 24, 688–697.
31. Mercado J. E., Rupp M. A., Chen J. Y. C., Barnes M. J., Barber D. J., Procci K., (2016). Intelligent agent transparency in human-agent teaming for multi-UxV management. Human Factors, 58, 401–415. doi:10.1177/0018720815621206
32. Muir B. M., (1987). Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27, 527–539.
33. Muir B. M., Moray N., (1996). Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460.
34. National Highway Traffic Safety Administration. (2017). Automated driving systems 2.0: A vision for safety. Washington, DC: US Department of Transportation, DOT HS, 812, 442.
35. Norman D., (2013). The design of everyday things: Revised and expanded edition. New York, NY: Basic Books.
36. Okamura K., Yamada S., (2018). Adaptive trust calibration for supervised autonomous vehicles. In Adjunct Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications. Retrieved from https://dl.acm.org/citation.cfm?doid=3239092.3265948
37. Onnasch L., Wickens C. D., Li H., Manzey D. H., (2014). Human performance consequences of stages and levels of automation: An integrated meta-analysis. Human Factors, 56, 476–488. doi:10.1177/0018720813501549
38. Parasuraman R., Manzey D. H., (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52, 381–410. doi:10.1177/0018720810376055.Copyright
39. Parasuraman R., Riley V., (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society, 39, 230–253. doi:10.1518/001872097778543886
40. Parasuraman R., Sheridan T. B., Wickens C. D., (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics, 30, 286–297.
41. Parasuraman R., Wickens C. D., (2008). Humans: Still vital after all these years of automation. Human Factors, 50, 511–520. doi:10.4324/9781315095080-14
42. Payre W., Cestac J., Delhomme P., (2016). Fully automated driving: Impact of trust and practice on manual control recovery. Human Factors, 58, 229–241. doi:10.1177/0018720815612319
43. Reimer B., Mehler B., Coughlin J. F., (2010). An evaluation of driver reactions to new vehicle parking assist technologies developed to reduce driver stress. Retrieved from http://web.mit.edu/reimer/www/pdfs/reimer_2010_parking_technology_and_driver%20_stress.pdf
44. Riley V., (1989). A general model of mixed-initiative human-machine systems. Proceedings of the Human Factors Society Annual Meeting, 33, 124–128. doi:10.1177/154193128903300227
45. Riley V., (1996). What avionics engineers should know about pilots and automation. IEEE Aerospace and Electronic Systems Magazine, 11, 3–8.
46. Robinette P., Li W., Allen R., Howard A. M., Wagner A. R., (2016). Overtrust of robots in emergency evacuation scenarios. In ACM/IEEE International Conference on Human-robot Interaction (pp. 101–108). doi:10.1109/HRI.2016.7451740
47. Rudin-Brown C. M., Parker H. A., (2004). Behavioural adaptation to adaptive cruise control (ACC): Implications for preventative strategies. Transportation Research Part F: Traffic Psychology and Behaviour, 7, 59–76.
48. Sarter N. B., Woods D. D., (1997). Team play with a powerful and independent agent: Operational experiences and automation surprises on the Airbus A-320. Human Factors, 39, 553–569. doi:10.1518/001872097778667997
49. Schaefer K. E., Chen J. Y. C., Szalma J. L., Hancock P. A., (2016). A meta-analysis of factors influencing the development of trust in automation: Implications for understanding autonomy in future systems. Human Factors, 58, 377–400. doi:10.1177/0018720816634228
50. Shen S., Neyens D. M., (2014). Assessing drivers’ performance when automated driver support systems fail with different levels of automation. In Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting (pp. 2068–2072). doi:10.1177/1541931214581435
51. Sheridan T. B., Verplank W. L., (1978). Human and computer control of undersea teleoperators. Retrieved from https://apps.dtic.mil/dtic/tr/fulltext/u2/a057655.pdf
52. Solís-Marcos I., Ahlström C., Kircher K., (2018). Performance of an additional task during Level 2 automated driving: An on-road study comparing drivers with and without experience with partial automation. Human Factors, 60, 778–792. doi:10.1177/0018720818773636
53. Stanton N. A., Young M. S., (1998). Vehicle automation and driving performance. Ergonomics, 41, 1014–1028. doi:10.1080/001401398186568
54. Tesla. (2017). Model X owner’s manual. Retrieved from https://www.tesla.com/sites/default/files/model_x_owners_manual_north_america_en.pdf
55. Verberne F. M. F., Ham J., Midden C. J. H., (2012). Trust in smart systems: Sharing driving goals and giving information to increase trustworthiness and acceptability of smart systems in cars. Human Factors, 54, 799–810. doi:10.1177/0018720812443825
56. Wachter S., Mittelstadt B., Floridi L., (2017). Transparent, explainable, and accountable AI for robotics. Science Robotics, 2(6). doi:10.19595/j.cnki.1000
57. Wagner A. R., Borenstein J., Howard A. M., (2018). Overtrust in the robotic age. Communications of the ACM, 61(9), 22–24. doi:10.1145/3241365
58. Walch M., Lange K., Baumann M., Weber M., (2015). Autonomous driving: investigating the feasibility of car-driver handover assistance. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 11–18). doi:10.1145/2799250.2799268
59. White T. L., Lejuez C. W., de Wit H., (2008). Test-retest characteristics of the Balloon Analogue Risk Task (BART). Experimental Clinical Psychopharmacology, 16, 565–570. doi:10.1037/a0014083.Test-Retest