Calibrating Trust in Automation Through Familiarity With the Autoparking Feature of a Tesla Model X

Journal of Cognitive Engineering and Decision Making

Volumn 13, Issue 4, 2019, Pages 279-294

  Tenhundfeld, Nathan L ^a   de Visser, Ewart J ^b   Haring, Kerstin S ^c   Ries, Anthony J ^d   Finomore, Victor S ^e   Tossell, Chad C ^c  

^a UNIVERSITY OF ALABAMA IN HUNTSVILLE   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

^c UNITED STATES AIR FORCE ACADEMY   (United States)

^d U S ARMY   (United States)

^e WEST VIRGINIA UNIVERSITY   (United States)

Author keywords

automation; field study; human automation interaction; methods

Indexed keywords

ENGINEERING;

AUTONOMOUS SYSTEMS; FIELD STUDIES; METHODS;

AUTOMATION;

ADULT; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATION; DRIVER; FIELD STUDY; HUMAN; MONITORING; TRUST;

EID: 85071042038     PISSN: 15553434     EISSN: 21695032     Source Type: Journal    
DOI: 10.1177/1555343419869083     Document Type: Article

References (69)

1. American Automobile Association. (2015). Fact sheet: Active parking assist systems. Retrieved from http://publicaffairsresources.aaa.biz/wp-content/uploads/2016/02/Automotive-Engineering-ADAS-Survey-Fact-Sheet-FINAL-3.pdf
2. Bahner J. E., Hüper A. D., Manzey D. H., (2008). Misuse of automated decision aids: Complacency, automation bias and the impact of training experience. International Journal of Human-computer Studies, 66, 688–699.
3. Banks V. A., Eriksson A., O’Donoghue J., Stanton N. A., (2018). Is partially automated driving a bad idea? Observations from an on-road study. Applied Ergonomics, 68, 138–145.
4. Basu C., Singhal M., (2016). Trust dynamics in human autonomous vehicle interaction: A review of trust models. In AAAI spring symposium—Technical report, pp. 85–91. Retrieved from https://www.aaai.org/ocs/index.php/SSS/SSS16/paper/view/12746
5. Basu C., Yang Q., Hungerman D., Singhal M., Dragan A. D., (2017). Do you want your autonomous car to drive like you? In Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction (HRI’17) (pp. 417–425). Retrieved from https://doi.org/10.1145/2909824.3020250
6. Boyd R., Richerson P. J., (2005). The origin and evolution of cultures. London, England: Oxford University Press.
7. Caird J. K., Horrey W. J., (2011). Twelve practical and useful questions about driving simulation. Boca Raton, FL: CRC Press.
8. Casner S. M., Hutchins E. L., (2019). What do we tell the drivers? Toward minimum driver training standards for partially automated cars. Journal of Cognitive Engineering and Decision Making, 13, 55–66. doi:10.1177/1555343419830901
9. Chen J. Y. C., Lakhmani S. G., Stowers K., Selkowitz A. R., Wright J. L., Barnes M., (2018). Situation awareness-based agent transparency and human-autonomy teaming effectiveness. Theoretical Issues in Ergonomics Science, 19, 259–282.
10. Chen J. Y. C., Procci K., Boyce M., Wright J., Garcia A., Barnes M. J., (2014). Situation awareness-based agent transparency (No. ARL-TR-6905). Army research lab Aberdeen proving ground, MD: Human research and engineering directorate.
11. Choi J. K., Ji Y. G., (2015). Investigating the importance of trust on adopting an autonomous vehicle. International Journal of Human-Computer Interaction, 31, 692–702. doi:10.1080/10447318.2015.1070549
12. Cummings M. L., (2019). Adaptation of human licensing examinations to the certification of autonomous systems. In Yu H., Li X., Murray R. M., Ramesh S., Tomlin C. J., (Eds.), Safe, autonomous and intelligent vehicles (pp. 145–162). Bern, Switzerland: Springer.
13. de Visser E. J., Beatty P. J., Estepp J. R., Kohn S., Abubshait A., Fedota J. R., McDonald C. G. (2018). Learning from the slips of others: Neural correlates of trust in automated agents. Frontiers in Human Neuroscience, 12, Article 309. doi:10.3389/fnhum.2018.00309
14. de Visser E. J., Cohen M., Freedy A., Parasuraman R. (2014). A design methodology for trust cue calibration in cognitive agents. In Shumaker R., Lackey S., (Eds.), International conference on virtual, augmented and mixed reality (pp. 251–262). London, England: Springer. doi:10.1007/978-3-642-39405-8
15. de Visser E. J., Monfort S. S., Mckendrick R., Smith M. A. B., Mcknight P. E., Krueger F. (2016). Almost human: Anthropomorphism increases trust resilience in cognitive agents. Journal of Experimental Psychology, 22, 331–349. doi:10.1037/xap0000092
16. de Visser E. J., Pak R., Shaw T. H. (2018). From “automation” to “autonomy”: The importance of trust repair in human-machine interaction. Ergonomics, 61, 1409–1427.
17. de Visser E. J., Parasuraman R., Freedy A., Freedy E., Weltman G. (2006). A comprehensive methodology for assessing human-robot team performance for use in training and simulation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 2639–2643.
18. De Winter J. C. F., Happee R., Martens M. H., Stanton N. A. (2014). Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence. Transportation Research Part F: Traffic Psychology and Behaviour, 27, 196–217. doi:10.1016/j.trf.2014.06.016
19. Dikmen M., Burns C. M., (2016). Autonomous driving in the real world: Experiences with Tesla autopilot and summon. In Proceedings of the 8th international conference on automotive user interfaces and interactive vehicular applications (Automotive’UI 16) (pp. 225–228). Retrieved from https://dl.acm.org/citation.cfm?doid=3003715.3005465
20. Endsley M. R., (2017). A preliminary naturalistic study of the Tesla model S. Journal of Cognitive Engineering and Decision Making, 11, 225–238. doi:10.1177/1555343417695197
21. Eriksson A., Banks V. A., Stanton N. A., (2017). Transition to manual: Comparing simulator with on- road control transitions. Accident Analysis & Prevention C, 102, 227–234.
22. French B., Duenser A., Heathcote A., (2018). Trust in automation: A literature review. Retrieved from https://pdfs.semanticscholar.org/92f0/7d3d1356307decb6e97382ad884d0f62668d.pdf
23. Gigerenzer G., (2008). Why heuristics work. Perspectives on Psychological Science, 3, 20–29.
24. Gunning D., (2017). Explainable artificial intelligence (XAI). Retrieved from https://www.darpa.mil/attachments/XAIProgramUpdate.pdf
25. Hancock P. A., (2017). Imposing limits on autonomous systems. Ergonomics, 60, 284–291. doi:10.1080/00140139.2016.1190035
26. Hancock P. A., Nourbakhsh I., Stewart J., (2019). On the future of transportation in an era of automated and autonomous vehicles. Proceedings of the National Academy of Sciences, 116, 7684–7691. doi:10.1073/pnas.1805770115
27. Helldin T., Falkman G., Riveiro M., Davidsson S., (2013). Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. In Proceedings of the 5th international conference on automotive user interfaces and interactive vehicular applications (Automotive’UI 13) (pp. 210–217). Retrieved from https://doi.org/10.1145/2516540.2516554
28. Hergeth S., Lorenz L., Krems J. F., (2017). Prior familiarization with takeover requests affects drivers’ takeover performance and automation trust. Human Factors, 59, 457–470. doi:10.1177/0018720816678714
29. Hergeth S., Lorenz L., Vilimek R., Krems J. F., (2015). Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving. Human Factors, 58, 509–519. doi:10.1177/0018720815625744
30. Hoff K. A., Bashir M., (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57, 407–434. doi:10.1177/0018720814547570
31. Jian J.-Y., Bisantz A. M., Drury C. G., Llinas J., (2000). Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4, 53–71.
32. Kaber D. B., (2018). A conceptual framework of autonomous and automated agents. Theoretical Issues in Ergonomics Science, 19, 406–430. doi:10.1080/1463922X.2017.1363314
33. Kaber D. B., Endsley M. R., (2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science, 5, 113–153. doi:10.1080/1463922021000054335
34. Koo J., Kwac J., Ju W., Steinert M., Leifer L., Nass C., (2015). Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing, 9, 269–275. doi:10.1007/s12008-014-0227-2
35. Körber M., Baseler E., Bengler K., (2018). Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics, 66, 18–31. https://doi.org/10.1016/j.apergo.2017.07.006
36. Koustanaï A., Cavallo V., Delhomme P., Mas A., (2012). Simulator training with a forward collision warning system. Human Factors, 54, 709–721. doi:10.1177/0018720812441796
37. Kramer R. M., (1999). Trust and distrust in organizations: Emerging perspectives, enduring questions. Annual Review of Psychology, 50, 569–598. doi:10.1146/annurev.psych.50.1.569
38. Langley P., Meadows B., Sridharan M., Choi D., (2017). Explainable agency for intelligent autonomous systems. In 29th AAAI conference on innovative applications IAAI-172917(IAAI-17) (pp. 4762–4763). Retrieved from http://www.isle.org/~langley/talks/explain.iaai17.pdf
39. Lee J. D., Moray N., (1994). Trust, self-confidence, and operators’ adaptation to automation. International Journal of Human-computer Studies, 40, 153–184.
40. Lee J. D., See K. A., (2004). Trust in automation: Designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46, 50–80. doi:10.1518/hfes.46.1.50_30392
41. Lewicki R. J., McAllister D. J., Bies R. J., (1998). Trust and distrust: New relationships and realities. Academy of Management, 23, 438–458.
42. Madhavan P., Wiegmann D. A., (2007). Effects of information source, pedigree, and reliability on operator interaction with decision support systems. Human Factors, 49, 773–785. doi:10.1518/001872007x230154
43. Madhavan P., Wiegmann D. A., Lacson F. C., (2006). Automation failures on tasks easily performed by operators undermine trust in automated aids. Human Factors: The Journal of the Human Factors and Ergonomics Society, 48, 241–256. doi:10.1518/001872006777724408
44. McGuirl J. M., Sarter N. B., (2006). Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Human Factors, 48, 656–665.
45. Mercado J. E., Rupp M. A., Chen J. Y. C., Barnes M. J., Barber D. J., Procci K., (2016). Intelligent agent transparency in human-agent teaming for multi-UxV management. Human Factors, 58, 401–415. doi:10.1177/0018720815621206
46. Merritt S. M., Ilgen D. R., (2008). Not all trust is created equal: Dispositional and history- based trust in human-automation interactions. Human Factors, 50, 194–210. doi:10.1518/001872008X288574
47. Merritt S. M., Lee D., Unnerstall J. L., Huber K., (2015). Are well-calibrated users effective users? Associations between calibration of trust and performance on an automation-aided task. Human Factors, 57, 34–47. doi:10.1177/0018720814561675
48. Merritt S. M., Unnerstall J. L., Lee D., Huber K., (2015). Measuring individual differences in the perfect automation schema. Human Factors, 57, 740–753. doi:10.1177/0018720815581247
49. Meyerson D., Weick K. E., Kramer R. M., (1996). Swift trust and temporary groups. In Kramer R. M., Tyler T. R., (Eds.), Trust in organizations: Frontiers of theory and research (pp. 166–195). Thousand Oaks, CA: SAGE.
50. Muir B. M., (1994). Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37, 1905–1922.
51. Muir B. M., Moray N., (1996). Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460.
52. Norman D., (2013). The design of everyday things (Revised and expanded ed.). New York, NY: Basic Books.
53. Onnasch L., Wickens C. D., Li H., Manzey D. H., (2014). Human performance consequences of stages and levels of automation: An integrated meta-analysis. Human Factors, 56, 476–488. doi:10.1177/0018720813501549
54. Parasuraman R., Manzey D. H., (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52, 381–410. doi:10.1177/0018720810376055
55. Parasuraman R., Sheridan T. B., Wickens C. D., (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics, 30, 286–297.
56. Payre W., Cestac J., Delhomme P., (2016). Fully automated driving: Impact of trust and practice on manual control recovery. Human Factors, 58, 229–241. doi:10.1177/0018720815612319
57. Pop V. L., Shrewsbury A., Durso F. T., (2015). Individual differences in the calibration of trust in automation. Human Factors, 57, 545–556. doi:10.1177/0018720814564422
58. Rajaonah B., Anceaux F., Vienne F., (2006). Study of driver trust during cooperation with adaptive cruise control. Le Travail Humain, 69, 99–127. doi:10.3917/th.692.0099
59. Sarter N. B., Woods D. D., (1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors, 37, 5–19. doi:10.1518/001872095779049516
60. Sarter N. B., Woods D. D., Billings C. E., (1997). Automation surprises. In Salvendy G., (Ed.), Handbook of human factors and ergonomics (2nd ed.). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.134.7077&rep=rep1&type=pdf
61. Schaefer K. E., Chen J. Y. C., Szalma J. L., Hancock P. A., (2016). A meta-analysis of factors influencing the development of trust in automation: Implications for understanding autonomy in future systems. Human Factors, 58, 377–400. doi:10.1177/0018720816634228
62. Sheridan T. B., Verplank W. L., (1978). Human and computer control of undersea teleoperators. Retrieved from https://apps.dtic.mil/docs/citations/ADA057655
63. Tenhundfeld N. L., de Visser E. J., Ries A. J., Finomore V. S., Tossell C. C., (2019). Use and disuse of autonomous parking in a Tesla Model X. Human Factors. Advance online publication. doi:10.1177/0018720819865412
64. Tesla. (2017). Model X owner’s manual. Retrieved from https://www.tesla.com/sites/default/files/model_x_owners_manual_north_america_en.pdf
65. Wachter S., Mittelstadt B., Floridi L., (2017). Transparent, explainable, and accountable AI for robotics. Science Robotics, 2(6). Retrieved from http://discovery.ucl.ac.uk/10038294/1/Wachter_Transparent_explainable_accountable_AI.pdf
66. Walch M., Lange K., Baumann M., Weber M., (2015). Autonomous driving: Investigating the feasibility of car-driver handover assistance. In Proceedings of the 7th international conference on automotive user interfaces and interactive vehicular applications (pp. 11–18). Retrieved from https://doi.org/10.1145/2799250.2799268
67. Walker F., Verwey W., Martens M. H., (2018, June 13–14). Gaze behaviour as a measure of trust in automated vehicles. Retrieved from http://www.humanist-vce.eu/fileadmin/contributeurs/humanist/TheHague2018/29-walker.pdf
68. Warwick G., (2017). Lockheed’s Skunk works demos autonomy for unmanned loyal Wingman. Aviation Week. Retrieved from http://aviationweek.com/defense/lockheed-s-skunk-works-demos-autonomy-unmanned-loyal-wingman
69. Yang X. J., Unhelkar V. V., Li K., Shah J. A., (2017). Evaluating effects of user experience and system transparency on trust in automation. In Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction (HRI’17) (pp. 408–416). Retrieved from https://doi.org/10.1145/2909824.3020230