Introduction matters: Manipulating trust in automation and reliance in automated driving

Applied Ergonomics

Volumn 66, Issue , 2018, Pages 18-31

  Körber, Moritz ^a   Baseler, Eva ^a   Bengler, Klaus ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Automated driving; Reliance; Trust in automation

Indexed keywords

BEHAVIORAL RESEARCH; ROADS AND STREETS;

AUTOMATED DRIVING; AUTOMATED DRIVING SYSTEMS; AUTOMATED SYSTEMS; AUTOMATED VEHICLES; INSTRUMENT CLUSTERS; KEY DETERMINANTS; RELIANCE; VISUAL ATTENTION;

AUTOMATION;

ADULT; AUTOMATION; CLINICAL ARTICLE; CONTROLLED STUDY; DRIVER; FEMALE; HIGHWAY; HUMAN; MALE; TRUST; VISUAL ATTENTION; ATTENTION; CAR; CAR DRIVING; CLINICAL TRIAL; MAN MACHINE INTERACTION; PSYCHOLOGY; REACTION TIME; TASK PERFORMANCE; YOUNG ADULT;

ADULT; ATTENTION; AUTOMATION; AUTOMOBILE DRIVING; AUTOMOBILES; FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; REACTION TIME; TASK PERFORMANCE AND ANALYSIS; TRUST; YOUNG ADULT;

EID: 85029816073     PISSN: 00036870     EISSN: 18729126     Source Type: Journal    
DOI: 10.1016/j.apergo.2017.07.006     Document Type: Article

References (87)

1. Abe, G., Itoh, M., Tanaka, K., Dynamics of drivers’ trust in warning systems. Basañez, L., (eds.) IFAC Proceedings Volumes, Proceedings of the 15th Triennial World Congress of the International Federation of Automatic Control, 2002, Elsevier, New York, NY, 363–368 https://doi.org/10.3182/20020721-6-ES-1901.01614.
2. Ajzen, I., Fishbein, M., Understanding Attitudes and Predicting Social Behavior. 1980, Prentice Hall, Englewood Cliffs NJ.
3. Bagheri, N., Jamieson, G.A., Considering subjective trust and monitoring behavior in assessing automation-induced “complacency”. Vincenzi, D.A., Mouloua, M., Hancock, P.A., (eds.) Human Performance, Situation Awareness, and Automation. Current Research and Trends HPSAA II, Volumes I and II, vol. 1, 2004, Lawrence Erlbaum Associates Inc, Mahwah, NJ, 54–59.
4. Bahner, J.E., Hüper, A.-D., Manzey, D., Misuse of automated decision aids: complacency, automation bias and the impact of training experience. Int. J. Human Comput. Stud. 66:9 (2008), 688–699 https://doi.org/10.1016/j.ijhcs.2008.06.001.
5. Bailey, N.R., Scerbo, M.W., Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust. Theor. Issues Ergon. Sci. 8:4 (2007), 321–348 https://doi.org/10.1080/14639220500535301.
6. Barg-Walkow, L.H., Rogers, W.A., The effect of incorrect reliability information on expectations, perceptions, and use of automation. Hum. Factors J. Hum. Factors Ergon. Soc. 58:2 (2016), 242–260 https://doi.org/10.1177/0018720815610271.
7. Beggiato, M., Krems, J.F., The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transp. Res. Part F Traffic Psychol. Behav. 18 (2013), 47–57 https://doi.org/10.1016/j.trf.2012.12.006.
8. Beggiato, M., Pereira, M., Petzoldt, T., Krems, J.F., Learning and development of trust, acceptance and the mental model of ACC. A longitudinal on-road study. Transp. Res. Part F Traffic Psychol. Behav. 35 (2015), 75–84 https://doi.org/10.1016/j.trf.2015.10.005.
9. Beller, J., Heesen, M., Vollrath, M., Improving the driver-automation interaction: an approach using automation uncertainty. Hum. Factors J. Hum. Factors Ergon. Soc. 55:6 (2013), 1130–1141 https://doi.org/10.1177/0018720813482327.
10. Biassoni, F., Ruscio, D., Ciceri, R., Limitations and automation. The role of information about device-specific features in ADAS acceptability. Saf. Sci. 85 (2016), 179–186 https://doi.org/10.1016/j.ssci.2016.01.017.
11. Carlson, M.S., Drury, J.L., Desai, M., Kwak, H., Yanco, H.A., Identifying factors that influence trust in automated cars and medical diagnosis systems. 2014 AAAI Spring Symposium Series. The Intersection of Robust Intelligence and Trust in Autonomous Systems, 2014, California, Palo Alto, 20–27.
12. Carsten, O., Lai, F., Barnard, Y., Jamson, A.H., Merat, N., Control task substitution in semiautomated driving: does it matter what aspects are automated?. Hum. Factors J. Hum. Factors Ergon. Soc. 54:5 (2012), 747–761 https://doi.org/10.1177/0018720812460246.
13. Casner, S.M., Hutchins, E.L., Norman, D.A., The challenges of partially automated driving. Commun. ACM 59:5 (2016), 70–77 https://doi.org/10.1145/2830565.
14. Choi, J.K., Ji, Y.G., Investigating the importance of trust on adopting an autonomous vehicle. Int. J. Human Comput. Interact. 31:10 (2015), 692–702 https://doi.org/10.1080/10447318.2015.1070549.
15. Christofferson, K., Woods, D.D., How to make automated systems team players. Advances in Human Performance and Cognitive Engineering Research. Advances in Human Performance and Cognitive Engineering Research Volume 2, vol. 2, 2002, Elsevier, 1–12, 10.1016/S1479-3601(02)02003-9.
16. Creaser, J.I., Fitch, G.M., Human factors considerations for the design of Level 2 and Level 3 automated vehicles. Meyer, G., Beiker, S., (eds.) Lecture Notes in Mobility. Road Vehicle Automation 2, 2015, Springer International Publishing, Cham, 81–89.
17. Dienes, Z., Bayesian versus orthodox statistics: which side are you on?. Perspect. Psychol. Sci. 6:3 (2011), 274–290 https://doi.org/10.1177/1745691611406920.
18. Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., Beck, H.P., The role of trust in automation reliance. Int. J. Human Comput. Stud. 58:6 (2003), 697–718, 10.1016/S1071-5819(03)00038-7.
19. European Commission, 2015 road safety statistics: What is behind the figures? (MEMO No. 16/864). Brüssel. Retrieved from European Commission website http://europa.eu/rapid/press-release_MEMO-16-864_en.htm, 2016.
20. Feuerberg, B.V., Bahner, J.E., Manzey, D., Interindividuelle Unterschiede im Umgang mit Automation – entwicklung eines Fragebogens zur Erfassung des Complacency-Potentials [Interindividual differences in the interaction with automation – development of a questionnaire to assess potential for complacency]. Urbas, L., Steffens, C., (eds.) Zustandserkennung und Systemgestaltung. 6. Berliner Werkstatt Mensch-Maschine-Systeme, 2005, VDI-Verlag, Düsseldorf, 199–202.
21. Gefen, D., Karahanna, E., Straub, D.W., Trust and TAM in online shopping: an integrated model. MIS Q. 27:1 (2003), 51–90.
22. Ghazizadeh, M., Lee, J.D., Boyle, L.N., Extending the technology acceptance model to assess automation. Cogn., Technol. Work 14:1 (2012), 39–49 https://doi.org/10.1007/s10111-011-0194-3.
23. Gold, C., Bengler, K., Taking over control from highly automated vehicles. Stanton, N.A., Landry, S., Di Bucchianico, G., Vallicelli, A., (eds.) Vol. [8]. Advances in Human Factors and Ergonomics 2014, Advances in Human Aspects of Transportation, Part II, 2014, AHFE Conference, Louisville, KY, 64–69.
24. Gold, C., Körber, M., Hohenberger, C., Lechner, D., Bengler, K., Trust in automation – before and after the experience of take-over scenarios in a highly automated vehicle. Procedia Manuf. 3 (2015), 3025–3032 https://doi.org/10.1016/j.promfg.2015.07.847.
25. Grissom, R.J., Kim, J.J., Effect Sizes for Research: Univariate and Multivariate Applications. second ed., 2012, Routledge, New York.
26. The Guardian, Tesla driver dies in first fatal crash while using autopilot mode. Retrieved from https://www.theguardian.com/technology/2016/jun/30/tesla-autopilot-death-self-driving-car-elon-musk, 2016.
27. Helldin, T., Falkman, G., Riveiro, M., Davidsson, S., Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. Terken, J., (eds.) Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2013, ACM, New York, NY, 210–217 https://doi.org/10.1145/2516540.2516554.
28. Hergeth, S., Lorenz, L., Vilimek, R., Krems, J.F., Keep your scanners peeled: gaze behavior as a measure of automation trust during highly automated driving. Hum. Factors J. Hum. Factors Ergon. Soc. 58:3 (2016), 509–519 https://doi.org/10.1177/0018720815625744.
29. Hoff, K.A., Bashir, M., Trust in automation: integrating empirical evidence on factors that influence trust. Hum. Factors J. Hum. Factors Ergon. Soc. 57:3 (2015), 407–434 https://doi.org/10.1177/0018720814547570.
30. Horberry, T., Anderson, J., Regan, M.A., Triggs, T.J., Brown, J., Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. Accid. Anal. Prev. 38:1 (2006), 185–191 https://doi.org/10.1016/j.aap.2005.09.007.
31. ISO 14198. (2012). PD ISO/TS 14198:2012-Road vehicles - Ergonomic aspects of transport information and control systems - Calibration tasks for methods which assess driver demand due to the use of in-vehicle systems: BSI.
32. ISO 15007-1 (2014, November 1). Road vehicles - Measurement of driver visual behaviour with respect to transport information and control systems - Part 1: Definitions and parameters. (ISO, 15007–1).
33. Jamil, T., Ly, A., Morey, R.D., Love, J., Marsman, M., Wagenmakers, E.-J., Default “Gunel and Dickey” Bayes factors for contingency tables. Behav. Res. methods, 2016 Advance online publication https://doi.org/10.3758/s13428-016-0739-8.
34. Keller, D., Rice, S., System-wide versus component-specific trust using multiple aids. J. General Psychol. 137:1 (2009), 114–128 https://doi.org/10.1080/00221300903266713.
35. Körber, M., Vertrauen in automation [trust in automation]. Retrieved from http://www.lfe.mw.tum.de/wp-content/uploads/2016/08/Vertrauen_In_Automation.pdf, 2015.
36. Körber, M., Bengler, K., Potential individual differences regarding automation effects in automated driving. González, C.S.G., Ordóñez, C.C., Fardoun, H., (eds.) Interacción 2014: Proceedings of the XV International Conference on Human Computer Interaction, 2014, ACM, New York, NY, USA, 152–158 https://doi.org/10.1145/2662253.2662275.
37. Körber, M., Gold, C., Lechner, D., Bengler, K., The influence of age on the take-over of vehicle control in highly automated driving. Transp. Res. Part F Traffic Psychol. Behav. 39 (2016), 19–32 https://doi.org/10.1016/j.trf.2016.03.002.
38. Körber, M., Radlmayr, J., Bengler, K., Bayesian highest density intervals of take-over times for highly automated driving in different traffic densities. Proc. Hum. Factors Ergon. Soc. (HFES) 60th Annu. Meet. 2016 60 (2016), 2009–2013 https://doi.org/10.1177/1541931213601457.
39. Kruschke, J.K., Doing Bayesian Data Analysis: a Tutorial with R, JAGS, and Stan. 2. ed., 2015, Academic Press, San Diego, CA.
40. Lee, J.D., Moray, N., Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35:10 (1992), 1243–1270 https://doi.org/10.1080/00140139208967392.
41. Lee, J.D., Moray, N., Trust, self-confidence, and operators’ adaptation to automation. Int. J. Human Comput. Stud. 40:1 (1994), 153–184 https://doi.org/10.1006/ijhc.1994.1007.
42. Lee, J.D., See, K.A., Trust in automation: designing for appropriate reliance. Hum. Factors J. Hum. Factors Ergon. Soc. 46:1 (2004), 50–80 https://doi.org/10.1518/hfes.46.1.50_30392.
43. Lee, M.D., Wagenmakers, E.-J., Bayesian Cognitive Modeling: a Practical Course. 2013, Cambridge University Press, Cambridge.
44. Llaneras, R., Salinger, J., Green, C., Human factors issues associated with limited ability autonomous driving systems: drivers’ allocation of visual attention to the forward roadway. Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, 2013, The University of Iowa, Public Policy Center, Iowa City, Iowa, 92–98.
45. Love, J., Selker, R., Verhagen, J., Marsman, M., Gronau, Q.F., Jamil, T., et al. Software to sharpen your stats. APS Obs. 28:3 (2015), 27–29.
46. Ly, A., Verhagen, J., Wagenmakers, E.-J., Harold Jeffreys's default Bayes factor hypothesis tests: explanation, extension, and application in psychology. J. Math. Psychol. 72 (2016), 19–32 https://doi.org/10.1016/j.jmp.2015.06.004.
47. Madhavan, P., Wiegmann, D.A., Cognitive anchoring on self-generated decisions reduces operator reliance on automated diagnostic aids. Hum. Factors J. Hum. Factors Ergon. Soc. 47:2 (2005), 332–341 https://doi.org/10.1518/0018720054679489.
48. Mahr, A., Müller, C., A schema of possible negative effects of advanced driver assistant systems. Proceedings of the 6th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, 2011, The University of Iowa, Public Policy Center, Iowa City, Iowa, 116–121.
49. Maurer, M., Gerdes, J.C., Lenz, B., Winner, H., Autonomes Fahren: Technische, rechtliche und gesellschaftliche Aspekte [Autonomous driving: Technical, legal, and societal aspects]. 2015, Springer Vieweg, Berlin.
50. Mayer, R.C., Davis, J.H., Schoorman, F.D., An integrative model of organizational trust. Acad. Manag. Rev. 20:3 (1995), 709–734 https://doi.org/10.5465/AMR.1995.9508080335.
51. Mayer, A.K., Sanchez, J., Fisk, A.D., Rogers, W.A., Don't let me down: the role of operator expectations in human-automation interaction. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 50:21 (2006), 2345–2349 https://doi.org/10.1177/154193120605002110.
52. Mayer, A.K., Rogers, W.A., Fisk, A.D., Understanding Technology Acceptance: Effects of User Expectancies on Human-automation Interaction. Technical Report HFA-TR-09–07). Atlanta, GA, 2009.
53. McGuirl, J.M., Sarter, N.B., Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Hum. Factors J. Hum. Factors Ergon. Soc. 48:4 (2006), 656–665 https://doi.org/10.1518/001872006779166334.
54. Merritt, S.M., Ilgen, D.R., Not all trust is created equal: dispositional and history-based trust in human-automation interactions. Hum. Factors J. Hum. Factors Ergon. Soc. 50:2 (2008), 194–210 https://doi.org/10.1518/001872008X288574.
55. Meyer, J., Effects of warning validity and proximity on responses to warnings. Hum. Factors J. Hum. Factors Ergon. Soc. 43:4 (2001), 563–572 https://doi.org/10.1518/001872001775870395.
56. Meyer, J., Conceptual issues in the study of dynamic hazard warnings. Hum. Factors J. Hum. Factors Ergon. Soc. 46:2 (2004), 196–204.
57. Morey, R.D., Rouder, J.N., BayesFactor: computation of Bayes factors for common designs. Retrieved from https://CRAN.R-project.org/package=BayesFactor, 2015.
58. Muir, B.M., Moray, N., Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics 39:3 (1996), 429–460 https://doi.org/10.1080/00140139608964474.
59. Naujoks, F., Totzke, I., Behavioral adaptation caused by predictive warning systems – the case of congestion tail warnings. Transp. Res. Part F Traffic Psychol. Behav. 26 (2014), 49–61 https://doi.org/10.1016/j.trf.2014.06.010.
60. Office of Defects Investigations, ODI Resume Investigation PE 16-007 (PE No. 16–1007. 2017.
61. Österreichische Automobil-, Motorrad- und Touringclub, Hochautomatisiertes fahren [highly automated driving]. Retrieved from http://tv.oeamtc.at/themen/auto/hochautomatisiertes-fahren.html, 2014.
62. Parasuraman, R., Riley, V., Humans and automation: use, misuse, disuse, abuse. Hum. Factors J. Hum. Factors Ergon. Soc. 39:2 (1997), 230–253 https://doi.org/10.1518/001872097778543886.
63. Payre, W., Cestac, J., Delhomme, P., Intention to use a fully automated car: attitudes and a priori acceptability. Transp. Res. Part F Traffic Psychol. Behav. 27 (2014), 252–263 https://doi.org/10.1016/j.trf.2014.04.009.
64. Payre, W., Cestac, J., Delhomme, P., Fully automated driving: impact of trust and practice on manual control recovery. Hum. Factors J. Hum. Factors Ergon. Soc. 58:2 (2016), 229–241 https://doi.org/10.1177/0018720815612319.
65. Plummer, M., JAGS: a program for analysis of Bayesian graphical models using Gibbs sampling. Hornik, Kurt, Leisch, Friedrich, & Achim Zeileis, (eds.) Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003), 2003 (Vienna, Austria).
66. Pop, V.L., Shrewsbury, A., Durso, F.T., Individual differences in the calibration of trust in automation. Hum. Factors J. Hum. Factors Ergon. Soc. 57:4 (2015), 545–556 https://doi.org/10.1177/0018720814564422.
67. R Core Team, R: a Language and Environment for Statistical Computing. 2016 Vienna, Austria. Retrieved from https://www.R-project.org.
68. Radlmayr, J., Gold, C., Lorenz, L., Farid, M., Bengler, K., How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 58:1 (2014), 2063–2067 https://doi.org/10.1177/1541931214581434.
69. Roberts, J., Hodgson, R., Dolan, P., “It's driving her mad”: gender differences in the effects of commuting on psychological health. J. Health Econ. 30:5 (2011), 1064–1076 https://doi.org/10.1016/j.jhealeco.2011.07.006.
70. Robson, K., Plangger, K., Kietzmann, J.H., McCarthy, I., Pitt, L., Is it all a game? Understanding the principles of gamification. Bus. Horizons 58:4 (2015), 411–420 https://doi.org/10.1016/j.bushor.2015.03.006.
71. Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., Iverson, G., Bayesian t tests for accepting and rejecting the null hypothesis. Psychon. Bull. Rev. 16:2 (2009), 225–237 https://doi.org/10.3758/PBR.16.2.225.
72. SAE International (2016, September 30). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicle. (Standard, J3016_201609).
73. Sauer, J., Chavaillaz, A., Wastell, D., Experience of automation failures in training: effects on trust, automation bias, complacency, and performance. Ergonomics, 2015, 1–28 https://doi.org/10.1080/00140139.2015.1094577.
74. Schaefer, K.E., Chen, J.Y.C., Szalma, J.L., Hancock, P.A., A meta-analysis of factors influencing the development of trust in automation: implications for understanding autonomy in future systems. Hum. Factors J. Hum. Factors Ergon. Soc. Adv. online Publ., 2016 https://doi.org/10.1177/0018720816634228.
75. Schönbrodt, F.D., Wagenmakers, E.-J., Bayes factor design analysis: planning for compelling evidence. Psychon. Bull. Rev., 2017 Advance online publication https://doi.org/10.3758/s13423-017-1230-y.
76. Schönbrodt, F.D., Wagenmakers, E.-J., Zehetleitner, M., Perugini, M., Sequential hypothesis testing with Bayes factors: efficiently testing mean differences. Psychol. Methods, 2015 Advance online publication https://doi.org/10.1037/met0000061.
77. Schoorman, F.D., Mayer, R.C., Davis, J.H., An integrative model of organizational trust: past, present, and future. Acad. Manag. Rev. 32:2 (2007), 344–354 https://doi.org/10.5465/AMR.2007.24348410.
78. Seppelt, B.D., Lee, J.D., Making adaptive cruise control (ACC) limits visible. Int. J. Human Comput. Stud. 65:3 (2007), 192–205 https://doi.org/10.1016/j.ijhcs.2006.10.001.
79. Shinar, D., Tractinsky, N., Compton, R., Effects of practice, age, and task demands, on interference from a phone task while driving. Accid. Anal. Prev. 37:2 (2005), 315–326 https://doi.org/10.1016/j.aap.2004.09.007.
80. Skitka, L.J., Mosier, K.L., Burdick, M., Rosenblatt, B., Automation bias and errors: are crews better than individuals?. Int. J. Aviat. Psychol. 10:1 (2000), 85–97 https://doi.org/10.1207/S15327108IJAP1001_5.
81. Stanton, N.A., Young, M.S., Vehicle automation and driving performance. Ergonomics 41:7 (1998), 1014–1028 https://doi.org/10.1080/001401398186568.
82. de Waard, D., van der Hulst, M., Hoedemaeker, M., Brookhuis, K., Driver behavior in an emergency situation in the automated highway system. Transport. Hum. Factors 1:1 (1999), 67–82 https://doi.org/10.1207/sthf0101_7.
83. Wagner, M., Koopman, P., A philosophy for developing trust in self-driving cars. Meyer, G., Beiker, S., (eds.) Lecture Notes in Mobility. Road Vehicle Automation 2, 2015, Springer International Publishing, Cham, 163–171.
84. Walker, G.H., Stanton, N.A., Salmon, P., Trust in vehicle technology. Int. J. Veh. Des., 70(2), 2016, 157 https://doi.org/10.1504/IJVD.2016.074419.
85. Wickens, C.D., Xu, X., Automation Trust, Reliability and Attention. (Technical Report No. AHFD-02–14/MAAD-02-2). Savoy, Illinois, 2002.
86. Wiegmann, D.A., McCarley, J.S., Kramer, A.F., Wickens, C.D., Age and automation interact to influence performance of a simulated luggage screening task. Aviat. space, Environ. Med. 77:8 (2006), 825–831.
87. Wilcox, R.R., Modern Statistics for the Social and Behavioral Sciences: a Practical Introduction. 2012, CRC Press/Chapman & Hall, Boca Raton, Fla.