The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency

Human Factors

Volumn 62, Issue 5, 2020, Pages 718-736

  Kraus, Johannes ^a   Scholz, David ^a   Stiegemeier, Dina ^a   Baumann, Martin ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

compliance and reliance; function allocation; human automation interaction; trust formation; trust in automation

Indexed keywords

CALIBRATION; MAN MACHINE SYSTEMS; TRANSPARENCY; VEHICLES;

COMPLIANCE AND RELIANCE; FUNCTION ALLOCATIONS; HUMAN-AUTOMATION INTERACTIONS; HUMAN-MACHINE INTERACTION; PSYCHOLOGICAL PROCESS; SYSTEM CAPABILITIES; THEORETICAL MODELING; TRUST FORMATION;

AUTOMATION;

AUTOMATION; CALIBRATION; CAR DRIVING; MAN MACHINE INTERACTION; STATISTICAL MODEL; THEORETICAL MODEL; TRUST;

AUTOMATION; AUTOMOBILE DRIVING; CALIBRATION; MAN-MACHINE SYSTEMS; MODELS, STATISTICAL; MODELS, THEORETICAL; TRUST;

EID: 85068185171     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720819853686     Document Type: Article

References (63)

1. Ajzen I., (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T
2. Ajzen I., Fishbein M., (1980). Understanding attitudes and predicting social behavior. Englewood-Cliffs, NJ: Prentice Hall.
3. Beggiato M., Krems J. F., (2013). The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F: Traffic Psychology and Behaviour, 18, 47–57. doi:10.1016/j.trf.2012.12.006
4. Beggiato M., Pereira M., Petzoldt T., Krems J., (2015). Learning and development of trust, acceptance and the mental model of ACC. A longitudinal on-road study. Transportation Research Part F: Traffic Psychology and Behaviour, 35, 75–84. doi:10.1016/j.trf.2015.10.005
5. Bühner M., Ziegler M., (2009). Statistik für Psychologen und Sozialwissenschaftler [Statistics for psychologists and social scientists]. Hallbergmoos, Germany: Pearson Deutsch-land GmbH.
6. Chavaillaz A., Wastell D., Sauer J., (2016). System reliability, performance and trust in adaptable automation. Applied Ergonomics, 52, 333–342. doi:10.1016/j.apergo.2015.07.012
7. Chen Y. C., Procci K., Boyce M., Wright J., Garcia A., Barnes M., (2014). Situation awareness-based agent transparency. MD: Aberdeen Proving Ground. Retrieved from https://www.arl.army.mil/arlreports/2014/technical-report.cfm?id=7066
8. Desai M., Kaniarasu P., Medvedev M., Steinfeld A., Yanco H., (2013, March 3–6). Impact of robot failures and feedback on real-time trust. In 8th ACM/IEEE international conference on human-robot interaction (pp. 251–258). IEEE. doi:10.1109/HRI.2013.6483596
9. De Winter J., Van Leuween P., Happee P., (2012, August 28–31). Advantages and disadvantages of driving simulators: A discussion. In Spink A. J., Grieco F., Krips O. E., Loijens L. W. S., Noldus L. P. J. J., Zimmermann P. H., (Eds.), Proceedings of measuring behavior 2012 (pp. 47–50). Utrecht, The Netherlands.
10. Dzindolet M. T., Peterson S. A., Pomranky R. A., Pierce L. G., Beck H. P., (2003). The role of trust in automation reliance. International Journal of Human-Computer Studies, 58, 697–718. doi:10.1016/S1071-5819(03)00038-7
11. Ekman F., Johansson M., Sochor J. L., (2016, October 23–27). To see or not to see: The effect of object recognition on users’ trust in “automated vehicles.” Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Article No. 42). doi:10.1145/2971485.2971551
12. Electronic Arts. (2013). TETRIS (Version 3.0.10) [Mobile application software]. Retrieved from https://play.google.com/store?hl=de
13. Emzivat Y., Ibanez-Guzman J., Martinet P., Roux O. H., (2017, June). Dynamic driving task fallback for an automated driving system whose ability to monitor the driving environment has been compromised. IEEE Intelligent Vehicles Symposium, Redondo Beach, CA. Retrieved from https://hal.archives-ouvertes.fr/hal-01724931
14. Endsley M. R., (2017). From here to autonomy: Lessons learned from human-automation research. Human Factors, 59, 5–27. doi:10.1177/0018720816681350
15. Fishbein M., Ajzen I., (1975). Belief, attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
16. Forster Y., Kraus J., Feinauer S., Baumann M., (2018, September 23–25). Calibration of trust expectancies in conditionally automated driving by brand, reliability information and introductionary videos: An online study. Proceedings of the 10th international conference on Automotive User Interfaces and Interactive Vehicular Applications, Association for Computing Machinery, New York, NY.
17. George D., Mallery M., (2003). Using SPSS for Windows step by step: A simple guide and reference. Boston, MA: Allyn & Bacon.
18. Gold C., Damböck D., Lorenz L., Bengler K., (2013). “Take over!” How long does it take to get the driver back into the loop? Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57, 1938–1942. doi:10.1177/1541931213571433
19. Gold C., Körber M., Lechner D., Bengler K., (2016). Taking over control from highly automated vehicles in complex traffic situations. Human Factors, 58, 642–652. doi:10.1177/0018720816634226
20. Gong L., (2008). How social is social responses to computers? The function of the degree of anthropomorphism in computer representations. Computers in Human Behavior, 24, 1494–1509.
21. Hancock P. A., Billings D. R., Schaefer K. E., Chen J. Y., de Visser E. J., Parasuraman R., (2011). A meta-analysis of factors affecting trust in human-robot interaction. Human Factors, 53, 517–527. doi:10.1177/0018720811417254
22. Hartwich F., Witzlack C., Beggiato M., Krems J., (2018). The first impression counts—A combined driving simulator and test track study on the development of trust and acceptance of highly automated driving. Transportation Research Part F: Traffic Psychology and Behavior. Advance online publication. doi:10.1016/j.trf.2018.05.012
23. Helldin T., Falkman G., Riveiro M., Davidsson S., (2013). Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. In Terken J., (Ed.), Proceedings of the 5th international conference on automotive user interfaces and interactive vehicular applications (pp. 210–217). New York, NY: Association for Computing Machinery. doi:10.1145/2516540.2516554
24. Hergeth S., Lorenz L., Krems J. F., (2017). Prior familiarization with takeover requests affects drivers’ takeover performance and automation trust. Human Factors, 59, 457–470. doi:10.1177/0018720816678714
25. Hergeth S., Lorenz L., Krems J. F., Toenert L., (2015, June 22–25). Effects of take-over requests and cultural background on automation trust in highly automated driving. In Proceedings of the eighth international driving symposium on human factors in driver assessment, training and vehicle design (pp. 331–337). Iowa City: Public Policy Center, University of Iowa. doi:10.17077/drivingassessment.1591
26. Hergeth S., Lorenz L., Vilimek R., Krems J. F., (2016). Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving. Human Factors, 58, 509–519. doi:10.1177/0018720815625744
27. Hoc J.-M., Young M. S., Blosseville J.-M., (2009). Cooperation between drivers and automation: Implications for safety. Theoretical Issues in Ergonomics Science, 10, 135–160. doi:10.1080/14639220802368856
28. Hoff K. A., Bashir M., (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57, 407–434. doi:10.1177/0018720814547570
29. IBM Corp. (2016). IBM SPSS statistics (Computer software). Ehningen, Germany: Author.
30. Jian J.-Y., Bisantz A. M., Drury C. G., (2000). Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4, 53–71. doi:10.1207/S15327566IJCE0401_04
31. Kazi T. A., Stanton N. A., Walker G. H., Young M. S., (2007). Designer driving: Drivers’ conceptual models and level of trust in adaptive cruise control. International Journal of Vehicle Design, 45, 339–360. doi:10.1504/IJVD.2007.014909
32. Körber M., Baseler E., Bengler K., (2018). Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics, 66, 18–31. doi:10.1016/j.apergo.2017.07.006
33. Lacson F. C., Wiegmann D. A., Madhavan P., (2005). Effects of attribute and goal framing on automation reliance and compliance. In Human factors and ergonomics society 49th annual meeting proceedings (pp. 482–486). Thousand Oaks, CA: SAGE. doi:10.1177/154193120504900357
34. Lee J., Moray N., (1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270. doi:10.1080/00140139208967392
35. Lee J. D., See K. A., (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50–80. doi:10.1518/hfes.46.1.50_30392
36. Madhavan P., Wiegmann D. A., (2007). Similarities and differences between human–human and human–automation trust: An integrative review. Theoretical Issues in Ergonomics Science, 8, 277–301. doi:10.1080/14639220500337708
37. Madsen M., Gregor S., (2000). Measuring human-computer trust. In Gable G., Vitale M., (Eds.), Proceedings of the 11th Australasian Conference on Information Systems (pp. 53–64). Melbourne, Australia: AIS.
38. Merritt S. M., Ilgen D. R., (2008). Not all trust is created equal: Dispositional and history-based trust in human-automation interactions. Human Factors, 50, 194–210. doi:10.1518/001872008X288574
39. Merritt S. M., Unnerstall J. L., Lee D., Huber K., (2015). Measuring individual differences in the perfect automation schema. Human Factors, 57, 740–753. doi:10.1177/0018720815581247
40. Miller D., Johns M., Mok B., Gowda N., Sirkin D., Lee K., Ju W., (2016). Behavioral measurement of trust in automation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60, 1849–1853. doi:10.1177/1541931213601422
41. Molina C. B. S. T., Almeida J. R., de Vismari L. F., González R. I. R., Naufal J. K., Camargo J. B., (2017, June 26–29). Assuring fully autonomous vehicles safety by design: The autonomous vehicle control (AVC) module strategy. 47th annual IEEE/IFIP international conference on Dependable Systems and Networks Workshops (DSN-W). doi:10.1109/DSN-W.2017.14
42. Moray N., Inagaki T., (1999). Laboratory studies of trust between humans and machines in automated systems. Transactions of the Institute of Measurement and Control, 21, 203–211.
43. Muir B. M., (1987). Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27, 527–539. doi:10.1016/S0020-7373(87)80013-5
44. Muir B. M., (1994). Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37, 1905–1922. doi:10.1080/00140139408964957
45. Muir B. M., Moray N., (1996). Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460. doi:10.1080/00140139608964474
46. Parasuraman R., Miller C. A., (2004). Trust and etiquette in high-criticality automated systems. Communications of the ACM, 47(4), 51–55. doi:10.1145/975817.975844
47. Parasuraman R., Riley V., (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.
48. Parasuraman R., Sheridan T. B., Wickens C. D., (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics–Part A: Systems and Humans, 30, 286–297. doi:10.1109/3468.844354
49. Payre W., Cestac J., Delhomme P., (2014). Intention to use a fully automated car: Attitudes and a priori acceptability. Transportation Research Part F: Traffic Psychology and Behaviour, 27(B), 252–263. doi:10.1016/j.trf.2014.04.009
50. Rosenthal R., Rosnow R. L., (1985). Contrast analysis: Focused comparisons in the analysis of variance. Cambridge, UK: Cambridge University Press.
51. Rovio Entertainment Corporation. (2010). Angry birds (Version 7.9.3) [Mobile application software]. Retrieved from https://play.google.com/store?hl=de
52. SAE International. (2014). Automated driving-levels of driving automation are defined in new SAE international standard J3016. Retrieved from https://www.oemoffhighway.com/electronics/smart-systems/automated-systems/document/12183694/automated-driving-levels-of-driving-automation-are-defined-in-new-sae-international-standard-j3016
53. Schmider E., Ziegler M., Danay E., Beyer L., Bühner M., (2010). Is it really robust? Methodology, 6, 147–151. doi:10.1027/1614-2241/a000016
54. Seong Y., Bisantz A. M., (2008). The impact of cognitive feedback on judgment performance and trust with decision aids. International Journal of Industrial Ergonomics, 38, 608–625. doi:10.1016/j.ergon.2008.01.007
55. Van den Beukel A. P., van der Voort M. C., Eger A. O. (2016). Supporting the changing driver’s task: Exploration of interface designs for supervision and intervention in automated driving. Transportation Research Part F: Traffic Psychology and Behaviour, 43, 279–301. doi:10.1016/j.trf.2016.09.009
56. Walch M., Mühl K., Kraus J., Stoll T., Baumann M., Weber M., (2017). From car-driver-handovers to cooperative interfaces: Visions for driver–vehicle interaction in automated driving. In: Meixner G., Müller C. (Eds.), Automotive user interfaces. Human–Computer Interaction Series (pp. 273–294). Cham, Switzerland: Springer.
57. Walker G. H., Stanton N. A., Salmon P., (2016). Trust in vehicle technology. International Journal of Vehicle Design, 70, 157–182. doi:10.1504/IJVD.2016.074419
58. Wang L., Jamieson G. A., Hollands J. G., (2009). Trust and reliance on an automated combat identification system. Human Factors: The Journal of the Human Factors and Ergonomics Society, 51, 281–291. doi:10.1177/0018720809338842
59. Wiegmann D. A., Rich A., Zhang H., (2001). Automated diagnostic aids: The effects of aid reliability on users’ trust and reliance. Theoretical Issues in Ergonomics Science, 2, 352–367. doi:10.1080/14639220110110306
60. Wintersberger P., von Sawitzky T., Frison A.-K., Riener A., (2017). Traffic augmentation as a means to increase trust in automated driving systems. In Proceedings of the 12th biannual conference on Italian SIGCHI chapter (pp. 1–17). New York, NY: Association for Computing Machinery. doi:10.1145/3125571.3125600
61. Woods D., (2001). Human-centered design of automated agents and human-automation team play. Retreived from http://www.erogersphd.com/EMorePages/HRI/HRI-ARCHIVE/woods1.pdf
62. Würzburger Institute for Traffic Science GmbH. (2014). Driving simulation and SILAB 5.1 (Computer software). Veitshöchheim: Author. Retrieved from https://wivw.de/de/silab/
63. Yang X. J., Unhelkar V. V., Li K., Shah J. A., (2017). Evaluating effects of user experience and system transparency on trust in automation. In Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction (pp. 408–416). New York, NY: Association for Computing Machinery. doi:10.1145/2909824.3020230