From manual to automated driving: how does trust evolve?

Theoretical Issues in Ergonomics Science

Volumn 22, Issue 5, 2021, Pages 528-554

  Manchon, J B ^a,b   Bueno, Mercedes ^a   Navarro, Jordan ^b  

^a Institut Vedecom   (France)

^b Lyon University   (France)

Author keywords

driving simulation; highly automated driving; Human automation interaction; meta analysis; trust in automation

Indexed keywords

EID: 85094189716     PISSN: 1463922X     EISSN: 1464536X     Source Type: Journal    
DOI: 10.1080/1463922X.2020.1830450     Document Type: Article

References (78)

1. Abe, G., K., Sato, M., Itoh. 2018. “ Driver Trust in Automated Driving Systems: The Case of Overtaking and Passing.” IEEE Transactions on Human-Machine Systems 48 (1): 85–94. doi: 10.1109/THMS.2017.2781619.
2. Abraham, H., C., Lee, S., Brady, C., Fitzgerald, B., Mehler, B., Reimer, and J.F., Coughlin. 2016. “ Autonomous Vehicles, Trust, and Driving Alternatives: A Survey of Consumer Preferences.” Massachusetts Institute of Technology, AgeLab, Cambridge 1: 16.
3. Atkinson, D., P., Hancock, R.R., Hoffman, J.D., Lee, E., Rovira, C., Stokes, and A.R., Wagner. 2012. “ Trust in Computers and Robots: The Uses and Boundaries of the Analogy to Interpersonal Trust.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56 (1): 303–307. doi: 10.1177/1071181312561071.
4. Barber, B., 1983. The Logic and Limits of Trust. New Brunswick, NJ: Rutgers University Press.
5. Beller, J., M., Heesen, and M., Vollrath. 2013. “Improving the driver-automation interaction: an approach using automation uncertainty.” Human Factors 55 (6): 1130–1141. doi: 10.1177/0018720813482327.
6. Biros, David P., Mark, Daly, and Gregg, Gunsch. 2004. “ The Influence of Task Load and Automation Trust on Deception Detection.” Group Decision and Negotiation 13 (2): 173–189. doi: 10.1023/B:GRUP.0000021840.85686.57.
7. Brell, T., R., Philipsen, and M., Ziefle. 2019. “ sCARy! Risk Perceptions in Autonomous Driving: The Influence of Experience on Perceived Benefits and Barriers.” Risk Analysis 39 (2): 342–357. doi: 10.1111/risa.13190.
8. Bueno, M., E., Dogan, F.H., Selem, E., Monacelli, S., Boverie, and A., Guillaume. 2016. “ How Different Mental Workload Levels Affect the Take-over Control after Automated Driving.” Intelligent Transportation Systems (ITSC), 2016 IEEE 19th International Conference on, 2040–2045.
9. Castelfranchi, Cristiano, and, Rino, Falcone. 2000. “ Trust and Control: A Dialectic Link.” Applied Artificial Intelligence 14 (8): 799–823. doi: 10.1080/08839510050127560.
10. Chien, Shih-Yi, Michael, Lewis, Zhaleh, Semnani-Azad, and Katia, Sycara. 2014. “ An Empirical Model of Cultural Factors on Trust in Automation.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58 (1): 859–863. doi: 10.1177/1541931214581181.
11. Choi, J.K., and Y.G., Ji. 2015. “ Investigating the Importance of Trust on Adopting an Autonomous Vehicle.” International Journal of Human-Computer Interaction 31 (10): 692–702. doi: 10.1080/10447318.2015.1070549.
12. Corritore, Cynthia L, Beverly, Kracher, and Susan, Wiedenbeck. 2003. “ On-Line Trust: concepts, Evolving Themes, a Model.” International Journal of Human-Computer Studies 58 (6): 737–758. doi: 10.1016/S1071-5819(03)00041-7.
13. Davis, Fred D, Richard P, Bagozzi, and Paul R, Warshaw. 1989. “ User Acceptance of Computer Technology: A Comparison of Two Theoretical Models.” Management Science 35 (8): 982–1003. doi: 10.1287/mnsc.35.8.982.
14. De Vries, Peter, Cees, Midden, and Don, Bouwhuis. 2003. “ The Effects of Errors on System Trust, Self-Confidence, and the Allocation of Control in Route Planning.” International Journal of Human-Computer Studies 58 (6): 719–735. doi: 10.1016/S1071-5819(03)00039-9.
15. de Waard, D., 1996. “ The Measurement of Drivers’ Mental Workload.” [Ph.D. thesis.]. University of Groningen.
16. Du, N., J., Haspiel, Q., Zhang, D., Tilbury, A.K., Pradhan, X.J., Yang, and L.P., Robert. 2019. “ Look Who’s Talking Now: Implications of AV’s Explanations on Driver’s Trust, AV Preference, Anxiety and Mental Workload.” Transportation Research Part C: Emerging Technologies 104: 428–442. doi: 10.1016/j.trc.2019.05.025.
17. Ebnali, M., K., Hulme, A., Ebnali-Heidari, and A., Mazloumi. 2019. “ How Does Training Effect Users’ Attitudes and Skills Needed for Highly Automated Driving? ” Transportation Research Part F: Traffic Psychology and Behaviour 66: 184–195. doi: 10.1016/j.trf.2019.09.001.
18. Feldhütter, A., C., Gold, A., Hüger, and K., Bengler. 2016. “ Trust in Automation as a Matter of Media Influence and Experience of Automated Vehicles.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60 (1): 2024–2028. doi: 10.1177/1541931213601460.
19. Forster, Y., F., Naujoks, and A., Neukum. 2017. “ Increasing Anthropomorphism and Trust in Automated Driving Functions by Adding Speech Output.” 2017 IEEE Intelligent Vehicles Symposium (IV), 365–372. doi: 10.1109/IVS.2017.7995746.
20. Gold, C., M., Körber, C., Hohenberger, D., Lechner, and K., Bengler. 2015. “ Trust in Automation–before and after the Experience of Take-over Scenarios in a Highly Automated Vehicle.” Procedia Manufacturing 3: 3025–3032. doi: 10.1016/j.promfg.2015.07.847.
21. Gong, L., 2008. “ How Social is Social Responses to Computers? Thefunction of the Degree of Anthropomorphism in Computer Rep-Resentations.” Computers in Human Behavior 24: 1494
22. Hartwich, F., C., Witzlack, M., Beggiato, and J.F., Krems. 2019. “ The First Impression Counts–a Combined Driving Simulator and Test Track Study on the Development of Trust and Acceptance of Highly Automated Driving.” Transportation Research Part F: Traffic Psychology and Behaviour 65: 522–535. doi: 10.1016/j.trf.2018.05.012.
23. Häuslschmid, R., M., von Bülow, B., Pfleging, and A., Butz. 2017. “ SupportingTrust in Autonomous Driving.” Proceedings of the 22nd International Conference on Intelligent User Interfaces - IUI ‘17, 319–329. doi: 10.1145/3025171.3025198.
24. Helldin, T., G., Falkman, M., Riveiro, and S., Davidsson. 2013. “ Presenting System Uncertainty in Automotive UIs for Supporting Trust Calibration in Autonomous Driving.” Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI ‘13, 210–217. doi: 10.1145/2516540.2516554.
25. Hergeth, S., L., Lorenz, and J.F., Krems. 2017. “ Prior Familiarization with Takeover Requests Affects Drivers’ Takeover Performance and Automation Trust.” Human Factors 59 (3): 457–470. doi: 10.1177/0018720816678714.
26. Hergeth, S., L., Lorenz, J., Krems, and L., Toenert. 2015. “ Effects of Take-Over Requests and Cultural Background on Automation Trust in Highly Automated Driving.” Proceedings of the Eighth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Salt Lake City, Utah, June 22–25. doi: 10.17077/drivingassessment.1591.
27. Hergeth, Sebastian, Lutz, Lorenz, Roman, Vilimek, and Josef F., Krems. 2016. “ Keep Your Scanners Peeled: Gaze Behavior as a Measure of Automation Trust during Highly Automated Driving.” Human Factors 58 (3): 509–519. doi: 10.1177/0018720815625744.
28. Hoff, K.A., and M., Bashir. 2015. “ Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust.” Human Factors 57 (3): 407–434. doi: 10.1177/0018720814547570.
29. Hwang, Peter, and, Willem P, Burgers. 1997. “ Properties of Trust: An Analytical View.” Organizational Behavior and Human Decision Processes 69 (1): 67–73. doi: 10.1006/obhd.1996.2673.
30. Jian, J.-Y., A., Bisantz, and C., Drury. 2000. “ Foundations for an Empirically Determined Scale of Trust in Automated Systems.” International Journal of Cognitive Ergonomics 4 (1): 53–71. doi: 10.1207/S15327566IJCE0401_04.
31. Khastgir, S., S., Birrell, G., Dhadyalla, and P., Jennings. 2018. “ Calibrating Trust through Knowledge: Introducing the Concept of Informed Safety for Automation in Vehicles.” Transportation Research Part C: Emerging Technologies 96: 290–303. doi: 10.1016/j.trc.2018.07.001.
32. Koo, J., J., Kwac, W., Ju, M., Steinert, L., Leifer, and C., Nass. 2015. “ Why Did my Car Just Do That? Explaining Semi-Autonomous Driving Actions to Improve Driver Understanding, Trust, and Performance.” International Journal on Interactive Design and Manufacturing (IJIDeM) 9 (4): 269–275. doi: 10.1007/s12008-014-0227-2.
33. Körber, M., 2015. Vertrauen in automation [trust in automation]. Retrieved from-content/uploads/2016/08/Vertrauen_In_Automation.pdf
34. Körber, M., 2018. “ Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation.” 20th Triennial Congress of the IEA 2018: 13–30. doi: 10.1007/978-3-319-96074-6_2.
35. Körber, M., E., Baseler, and K., Bengler. 2018 a. “ Introduction Matters: Manipulating Trust in Automation and Reliance in Automated Driving.” Applied Ergonomics 66: 18–31. doi: 10.1016/j.apergo.2017.07.006.
36. Körber, M., L., Prasch, and K., Bengler. 2018 b. “ Why Do I Have to Drive Now? Post Hoc Explanations of Takeover Requests.” Human Factors 3 (60): 305–323.
37. Kraus, J., D., Scholz, D., Stiegemeier, and M., Baumann. 2020. “ The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency.” Human Factors 62 (5): 718–736. doi: 10.1177/0018720819853686.
38. Lee, J.D., and N., Moray. 1994. “ Trust, Self-Confidence, and Operators’ Adaptation to Automation.” International Journal of Human-Computer Studies 40 (1): 153–184. doi: 10.1006/ijhc.1994.1007.
39. Lee, J.D., and K., See. 2004. “ Trust in Automation: Designing for Appropriate Reliance.” Human Factors 46 (1): 50–80. doi: 10.1518/hfes.46.1.50_30392.
40. Lewis, J.D., and A., Weigert. 1985. “ Trust as a Social Reality.” Social Forces 63 (4): 967–985. doi: 10.1093/sf/63.4.967.
41. Lu, Z., B., Zhang, A., Feldhütter, R., Happee, M., Martens, and J. C. F., De Winter. 2019. “ Beyond Mere Take-over Requests: The Effects of Monitoring Requests on Driver Attention, Take-over Performance, and Acceptance.” Transportation Research Part F: Traffic Psychology and Behaviour 63: 22–37. doi: 10.1016/j.trf.2019.03.018.
42. Madhavan, P, and D.A., Wiegmann. 2007. “ Similarities and Differences between Human–human and Human–automation Trust: An Integrative Review.” Theoretical Issues in Ergonomics Science 8 (4): 277–301. doi: 10.1080/14639220500337708.
43. Madsen, M., and S. Gregor., 2000. Measuring human-computer trust. Proceedings of the 11 Th Australasian Conference on Information Systems, 6–8.
44. Manchon, J.B., M., Bueno, and J., Navarro. 2019. “ How the Initial Level of Trust in Automated Driving Impact Drivers’ Behavior and Early Trust Construction.” [Manuscript submitted for publication]. VEDECOM Institute.
45. Maurer, S., R., Erbach, I., Kraiem, S., Kuhnert, P., Grimm, and E., Rukzio. 2018. “ Designing a Guardian Angel: Giving an Automated Vehicle the Possibility to Override Its Driver.” Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 341–350. 10.1145/3239060.3239078.
46. Mayer, R.C., J.H., Davis, and F.D., Schoorman. 1995. “ An Integrative Model of Organizational Trust.” The Academy of Management Review 20 (3): 709–734. doi: 10.2307/258792.
47. Merritt, S.M., H., Heimbaugh, J., LaChapell, and D., Lee. 2013. “I Trust It, but I don’t know why: effects of implicit attitudes toward automation on trust in an automated system.” Human Factors 55 (3): 520–534. doi: 10.1177/0018720812465081.
48. Merritt, S.M., and D.R., Ilgen. 2008. “ Not All Trust is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions.” Human Factors 50 (2): 194–210. doi: 10.1518/001872008X288574.
49. Miller, D., M., Johns, B., Mok, N., Gowda, D., Sirkin, K., Lee, and W., Ju. 2016. “ Behavioral Measurement of Trust in Automation: The Trust Fall.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60 (1): 1849–1853. doi: 10.1177/1541931213601422.
50. Mirnig, A.G., P., Wintersberger, C., Sutter, and J., Ziegler. 2016. “ A Framework for Analyzing and Calibrating Trust in Automated Vehicles.” Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct - Automotive’UI 16, 33–38. doi: 10.1145/3004323.3004326.
51. Molnar, L.J., L.H., Ryan, A.K., Pradhan, D.W., Eby, R.M., St. Louis, and J.S., Zakrajsek. 2018. “ Understanding Trust and Acceptance of Automated Vehicles: An Exploratory Simulator Study of Transfer of Control between Automated and Manual Driving.” Transportation Research Part F: Traffic Psychology and Behaviour 58: 319–328. doi: 10.1016/j.trf.2018.06.004.
52. Moray, N., and T., Inagaki. 1999. “ Laboratory Studies of Trust between Humans and Machines in Automated Systems.” Transactions of the Institute of Measurement and Control 21 (4-5): 203–211. doi: 10.1177/014233129902100408.
53. Morris, D.M., J.M., Erno, and J.J., Pilcher. 2017. “ Electrodermal Response and Automation Trust during Simulated Self-Driving Car Use.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 1759–1762. doi: 10.1177/1541931213601921.
54. Muir, Bonnie M., 1987. “ Trust between Humans and Machines, and the Design of Decision Aids.” International Journal of Man-Machine Studies 27 (5-6): 527–539. doi: 10.1016/S0020-7373(87)80013-5.
55. Muir, B.M., 1994. “ Trust in Automation: Part I. Theoretical Issues in the Study of Trust and Human Intervention in Automated Systems.” Ergonomics 37 (11): 1905–1922. doi: 10.1080/00140139408964957.
56. Muir, B.M., and N., Moray. 1996. “ Trust in Automation. Part II. Experimental Studies of Trust and Human Intervention in a Process Control Simulation.” Ergonomics 39 (3): 429–460. doi: 10.1080/00140139608964474.
57. Parasuraman, R., and D.H., Manzey. 2010. “ Complacency and Bias in Human Use of Automation: An Attentional Integration.” Human Factors 52 (3): 381–410. doi: 10.1177/0018720810376055.
58. Parasuraman, R., and V., Riley. 1997. “ Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (2): 230–253. doi: 10.1518/001872097778543886.
59. Payre, W., 2015. “ Conduite Complètement Automatisée: Acceptabilité, Confiance Et Apprentissage De La Reprise De Contrôle Manuel.” [Unpublished Doctoral Thesis]. Université Paris 8.
60. Payre, W., J., Cestac, N.-T., Dang, F., Vienne, and P., Delhomme. 2017. “ Impact of Training and in-Vehicle Task Performance on Manual Control Recovery in an Automated Car.” Transportation Research Part F: Traffic Psychology and Behaviour 46: 216–227. doi: 10.1016/j.trf.2017.02.001.
61. Payre, W., J., Cestac, and P., Delhomme. 2016. “ Fully Automated Driving: Impact of Trust and Practice on Manual Control Recovery.” Human Factors 58 (2): 229–241. doi: 10.1177/0018720815612319.
62. Rajaonah, B., F., Anceaux, and F., Vienne. 2006. “ Study of Driver Trust during Cooperation with Adaptive Cruise Control.” Le Travail Humain 69 (2): 99 -127. doi: 10.3917/th.692.0099.
63. Rempel, J.K., J.G., Holmes, and M.P., Zanna. 1985. “ Trust in Close Relationships.” Journal of Personality and Social Psychology 49 (1): 95–112. doi: 10.1037/0022-3514.49.1.95.
64. Rotter, J.B., 1967. “ A New Scale for the Measurement of Interpersonal trust1.” Journal of Personality 35 (4): 651–665. doi: 10.1111/j.1467-6494.1967.tb01454.x.
65. Rousseau, D.M., S.B., Sitkin, R.S., Burt, and C., Camerer. 1998. “ Not so Different after All: A Cross-Discipline View of Trust.” Academy of Management Review 23 (3): 393–404. doi: 10.5465/amr.1998.926617.
66. SAE International. 2016. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. (Surface Vehicle Recommended Practice: Superseding J3016 Jan 2014), SAE International, September 2016 doi: 10.4271/J3016_201609.
67. Schwarz, C., J., Gaspar, and T., Brown. 2019. “ The Effect of Reliability on Drivers’ Trust and Behavior in Conditional Automation.” Cognition, Technology & Work 21 (1): 41–54. doi: 10.1007/s10111-018-0522-y.
68. Sheridan, T.B., 1976. “ Toward a General Model of Supervisory Control.” In Monitoring Behavior and Supervisory Control, edited by T.B., Sheridan and G., Johannsen, 271–281. Boston, MA: Springer. doi: 10.1007/978-1-4684-2523-9_22.
69. Sonoda, K., and T., Wada. 2017. “ Displaying System Situation Awareness Increases Driver Trust in Automated Driving.” IEEE Transactions on Intelligent Vehicles 2 (3): 185–193. doi: 10.1109/TIV.2017.2749178.
70. Takayama, L, and C., Nass. 2008. “ Assessing the Effectiveness of Interactive Media in Improving Drowsy Driver Safety.” Human Factors: The Journal of the Human Factors and Ergonomics Society 50 (5): 772–781. doi: 10.1518/001872008X312341.
71. Techer, F., L., Ojeda, D., Barat, J.-Y., Marteau, F., Rampillon, S., Feron, and E., Dogan. 2019. “ Anger and Highly Automated Driving in Urban Areas: The Role of Time Pressure.” Transportation Research Part F: Traffic Psychology and Behaviour 64: 353–360. doi: 10.1016/j.trf.2019.05.016.
72. Van Der Laan, Jinke D, Adriaan, Heino, and Dick, De Waard. 1997. “ A Simple Procedure for the Assessment of Acceptance of Advanced Transport Telematics.” Transportation Research Part C: Emerging Technologies 5 (1): 1–10. doi: 10.1016/S0968-090X(96)00025-3.
73. Walker, F., J., Wang, M.H., Martens, and W.B., Verwey. 2019. “ Gaze Behaviour and Electrodermal Activity: Objective Measures of Drivers’ Trust in Automated Vehicles.” Transportation Research Part F: Traffic Psychology and Behaviour 64: 401–412. doi: 10.1016/j.trf.2019.05.021.
74. Walker, Francesco, A., Boelhouwer, T., Alkim, W.B., Verwey, and M.H., Martens. 2018. “ Changes in Trust after Driving Level 2 Automated Cars.” Journal of Advanced Transportation 2018: 1–9. doi: 10.1155/2018/1045186.
75. Waytz, A., J., Heafner, and N., Epley. 2014. “ The Mind in the Machine: Anthropomorphism Increases Trust in an Autonomous Vehicle.” Journal of Experimental Social Psychology 52: 113–117. doi: 10.1016/j.jesp.2014.01.005.
76. Wintersberger, P., and A., Riener. 2016. “ Trust in Technology as a.” Safety Aspect in Highly Automated Driving. I-Com 15 (3): 297–310. doi: 10.1515/icom-2016-0034.
77. Wintersberger, P., T., von Sawitzky, A.-K., Frison, and A., Riener. 2017. “ Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems.” Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter - CHItaly 17, 1–7. doi: 10.1145/3125571.3125600.
78. Xu, Z., K., Zhang, H., Min, Z., Wang, X., Zhao, and P., Liu. 2018. “ What Drives People to Accept Automated Vehicles? Findings from a Field Experiment.” Transportation Research Part C: Emerging Technologies 95: 320–334. doi: 10.1016/j.trc.2018.07.024.