From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction

Ergonomics

Volumn 61, Issue 10, 2018, Pages 1409-1427

  de Visser, Ewart J ^a,b   Pak, Richard ^c   Shaw, Tyler H ^a  

^a GEORGE MASON UNIVERSITY   (United States)

^b UNITED STATES AIR FORCE ACADEMY   (United States)

^c CLEMSON UNIVERSITY   (United States)

Author keywords

automation; autonomy; humanness; human machine teaming; Trust repair

Indexed keywords

AUTOMATION; ERGONOMICS; PHYSICAL THERAPY;

APPROPRIATE DESIGNS; AUTONOMOUS ENTITIES; AUTONOMY; FUTURE TECHNOLOGIES; HUMAN RELATIONSHIPS; HUMANNESS; INDUSTRIAL PSYCHOLOGY; TRUST REPAIRS;

REPAIR;

ARTICLE; AUTOMATION; HUMAN; HUMAN EXPERIMENT; MACHINE; PHYSICIAN; PSYCHOLOGY; TRUST; COMPUTER; MAN MACHINE INTERACTION; TECHNOLOGY;

COMPUTERS; HUMANS; MAN-MACHINE SYSTEMS; TECHNOLOGY; TRUST;

EID: 85045104296     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2018.1457725     Document Type: Article

References (167)

1. Ahmed, N., E., de Visser, T., Shaw, A., Mohamed-Ameen, M., Campbell, and R., Parasuraman. 2014. “Statistical Modelling of Networked Human–Automation Performance using Working Memory Capacity.” Ergonomics 57 (3): 295–318.10.1080/00140139.2013.855823
2. Akgun, M., K., Cagiltay, and D., Zeyrek. 2010. “The Effect of Apologetic Error Messages and Mood States on Computer Users’ Self-appraisal of Performance.” Journal of Pragmatics 42 (9): 2430–2448.10.1016/j.pragma.2009.12.011
3. Bagosi, T., K. V., Hindriks, and M. A., Neerincx. 2016. “Ontological Reasoning for Human-Robot Teaming in Search and Rescue Missions.” 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). Christchuch, New Zealand doi:10.1109/hri.2016.7451873.
4. Basu, C., Q., Yang, D., Hungerman, M., Singhal, and A. D., Dragan. 2017. “Do You Want Your Autonomous Car to Drive like You?” Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction–HRI ’17. Vienna, Austria. doi:10.1145/2909824.3020250.
5. Berg, J., J., Dickhaut, and K., McCabe. 1995. “Trust, Reciprocity, and Social History.” Games and Economic Behavior 10 (1): 122–142.10.1006/game.1995.1027
6. Bhuiyan, J., 2017. “A Federal Agency Says an Overreliance on Tesla’s Autopilot Contributed to a Fatal Crash.” Recode. https://www.recode.net/2017/9/12/16294510/fatal-tesla-crash-self-driving-elon-musk-autopilot.
7. Bickmore, T., and J., Cassell. 2001. “Relational Agents.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems–CHI ’01. Seattle, Washington. doi:10.1145/365024.365304.
8. Bonnefon, J.-F., A., Shariff, and I., Rahwan. 2016. “The Social Dilemma of Autonomous Vehicles.” Science 352 (6293): 1573–1576.10.1126/science.aaf2654
9. Bradfield, M., and K., Aquino. 1999. “The Effects of Blame Attributions and Offender Likableness on Forgiveness and Revenge in the Workplace.” Journal of Management 25 (5): 607–631.10.1177/014920639902500501
10. Breazeal, C., 2003. “Toward Sociable Robots.” Robotics and Autonomous Systems 42 (3–4): 167–175.10.1016/S0921-8890(02)00373-1
11. Brown, A. S., 2011. “Google’s Autonomous Car Applies Lessons Learned from Driverless Races.” Mechanical Engineering-CIME 133: 31–32.
12. Burns, C. M., 2017. “Automation and the Human Factors Race to Catch up.” Journal of Cognitive Engineering and Decision Making 12 (1): 83–85.
13. Byrne, E., 2017. “Knowing Behavior Helps Insure Models against Breakage: A Commentary on Kaber’s “Issues in Human–Automation Interaction Modeling”.” Journal of Cognitive Engineering and Decision Making 12 (1): 67–69.
14. Chen, J. Y. C., and M. J., Barnes. 2014. “Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues.” IEEE Transactions on Human–Machine Systems 44 (1): 13–29.10.1109/THMS.2013.2293535
15. Chen, J. Y. C., and M. J., Barnes. 2015. “Agent Transparency for Human–Agent Teaming Effectiveness.” 2015 IEEE International Conference on Systems, Man, and Cybernetics. doi:10.1109/smc.2015.245.
16. Chen, J. Y. C., K., Procci, M., Boyce, J., Wright, and A., Garcia. 2014. Situation Awareness-based Agent Transparency. Army Research Lab Technical Report. http://www.dtic.mil/docs/citations/ADA600351.
17. Chernoff, P. R., 1973. “Representations, Automorphisms, and Derivations of Some Operator Algebras.” Journal of Functional Analysis 12 (3): 275–289.10.1016/0022-1236(73)90080-3
18. Clare, A. S., M. L., Cummings, and N. P., Repenning. 2015. “Influencing Trust for Human–Automation Collaborative Scheduling of Multiple Unmanned Vehicles.” Human Factors: The Journal of the Human Factors and Ergonomics Society 57 (7): 1208–1218.10.1177/0018720815587803
19. Cummings, M., (missy). 2017. “Informing Autonomous System Design through the Lens of Skill-, Rule-, and Knowledge-based Behaviors.” Journal of Cognitive Engineering and Decision Making 12 (1): 58–61.
20. Dirks, K. T., P. H., Kim, D. L., Ferrin, and C. D., Cooper. 2011. “Understanding the Effects of Substantive Responses on Trust following a Transgression.” Organizational Behavior and Human Decision Processes 114 (2): 87–103.10.1016/j.obhdp.2010.10.003
21. Dirks, K. T., R. J., Lewicki, and A., Zaheer. 2009. Reparing Relationships within and between Organizations: Building a Conceptual Foundation. Academy of Management Review 34 (1): 68–84.10.5465/AMR.2009.35713285
22. van Dongen, K., and P.-P., van Maanen. 2013. “A Framework for Explaining Reliance on Decision Aids.” International Journal of Human–Computer Studies 71 (4): 410–424.10.1016/j.ijhcs.2012.10.018
23. Donmez, B., L. N., Boyle, and J. D., Lee. 2006. “The Impact of Distraction Mitigation Strategies on Driving Performance.” Human Factors: The Journal of the Human Factors and Ergonomics Society 48 (4): 785–804.10.1518/001872006779166415
24. Dorneich, M. C., P. M., Ververs, S., Mathan, S., Whitlow, and C. C., Hayes. 2012. “Considering Etiquette in the Design of an Adaptive System.” Journal of Cognitive Engineering and Decision Making 6 (2): 243–265.10.1177/1555343412441001
25. Duhigg, C., 2016. Smarter Faster Better: The Transformative Power of Real Productivity. New York: Random House.
26. Dzindolet, M. T., S. A., Peterson, R. A., Pomranky, L. G., Pierce, and H. P., Beck. 2003. “The Role of Trust in Automation Reliance.” International Journal of Human–Computer Studies 58 (6): 697–718.10.1016/S1071-5819(03)00038-7
27. Economist. 2017. Do Social Media Threaten Democracy? November 4. https://www.economist.com/news/leaders/21730871-facebook-google-and-twitter-were-supposed-save-politics-good-information-drove-out.
28. Endsley, M. R., 2017a. “From Here to Autonomy.” Human Factors: The Journal of the Human Factors and Ergonomics Society 59 (1): 5–27.10.1177/0018720816681350
29. Endsley, M. R., 2017b. “Level of Automation Forms a Key Aspect of Autonomy Design.” Journal of Cognitive Engineering and Decision Making 12 (1): 29–34.
30. Gao, F., M. L., Cummings, and E. T., Solovey. 2014. “Modeling Teamwork in Supervisory Control of Multiple Robots.” IEEE Transactions on Human–Machine Systems 44 (4): 441–453.10.1109/THMS.2014.2312391
31. Gao, F., M. L., Cummings, and E., Solovey. 2016. Designing for Robust and Effective Teamwork in Human–Agent Teams. Robust Intelligence and Trust in Autonomous Systems, 167–190. Springer US.10.1007/978-1-4899-7668-0
32. Gillespie, N., and G., Dietz. 2009. “Trust Repair after an Organization-level Failure.” Academy of Management Review 34 (1): 127–145.10.5465/AMR.2009.35713319
33. Goodall, N. J., 2014. Machine Ethics and Automated Vehicles. Lecture Notes in Mobility, 93–102. Springer International Publishing.10.1007/978-3-319-05990-7
34. Gottman, J. M., 2005. The Mathematics of Marriage: Dynamic Nonlinear Models. Cambridge, MA: MIT Press.
35. Gottman, J. M., and R. W., Levenson. 1992. “Marital Processes Predictive of Later Dissolution: Behavior, Physiology, and Health.” Journal of Personality and Social Psychology 63 (2): 221–233.10.1037/0022-3514.63.2.221
36. Graff, G. M., 2017. “How a Dorm Room Minecraft Scam Brought down the Internet.” Wired, December 13. https://www.wired.com/story/mirai-botnet-minecraft-scam-brought-down-the-internet/.
37. de Greeff, J., K., Hindriks, M. A., Neerincx, and I., Kruijff-Korbayova 2015. “Human–Robot Teamwork in USAR Environments.” Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts–HRI’15 Extended Abstracts. Portland, Oregon. doi:10.1145/2701973.2702031.
38. Gurney, J. K., 2013. “Sue My Car Not Me: Products Liability and Accidents Involving Autonomous Vehicles.” Journal of Jaw, Technology & Policy 2013 (2): 247–277.
39. Hancock, P. A., 2017. “Imposing Limits on Autonomous Systems.” Ergonomics 60 (2): 284–291.10.1080/00140139.2016.1190035
40. Hancock, P. A., D. R., Billings, K. E., Schaefer, J. Y. C., Chen, E. J., de Visser, and R., Parasuraman. 2011. “A Meta-analysis of Factors Affecting Trust in Human–Robot Interaction.” Human Factors: The Journal of the Human Factors and Ergonomics Society 53 (5): 517–527.10.1177/0018720811417254
41. Haslam, N., 2006. “Dehumanization: An Integrative Review.” Personality and Social Psychology Review 10 (3): 252–264.10.1207/s15327957pspr1003_4
42. Haslam, N., P., Bain, L., Douge, M., Lee, and B., Bastian. 2005. “More Human than You: Attributing Humanness to Self and Others.” Journal of Personality and Social Psychology 89 (6): 937–950.10.1037/0022-3514.89.6.937
43. Hayes, C. C., and C. A., Miller. 2016. Human–Computer Etiquette: Cultural Expectations and the Design Implications They Place on Computers and Technology. Boca Raton, FL: CRC Press.
44. Helldin, T., G., Falkman, M., Riveiro, A., Dahlbom, and M., Lebram. 2013. “Transparency of Military Threat Evaluation through Visualizing Uncertainty and System Rationale.” Lecture Notes in Computer Science, 263–272. Springer Berlin Heidelberg.10.1007/978-3-642-39354-9
45. Hoff, K. A., and M., Bashir. 2015. “Trust in Automation.” Human Factors: The Journal of the Human Factors and Ergonomics Society 57 (3): 407–434.10.1177/0018720814547570
46. Hoffman, R. R., M., Johnson, J. M., Bradshaw, and A., Underbrink. 2013. “Trust in Automation.” IEEE Intelligent Systems 28 (1): 84–88.10.1109/MIS.2013.24
47. Hoffman, R. R., J. D., Lee, D. D., Woods, N., Shadbolt, J., Miller, and J. M., Bradshaw. 2009. “The Dynamics of Trust in Cyberdomains.” IEEE Intelligent Systems 24 (6): 5–11.10.1109/MIS.2009.124
48. Humphreys, C., R., Cobb, D., Jacques, and J., Reeger. 2015. “Optimal Mission Path for the Uninhabited Loyal Wingman.” 16th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. Dallas, Texas. doi:10.2514/6.2015-2792.
49. Hutchins, A. R., M. L., Cummings, M., Draper, and T., Hughes. 2015. “Representing Autonomous Systems’ Self-confidence through Competency Boundaries.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 59 (1): 279–283.10.1177/1541931215591057
50. Inbar, O., and J., Meyer. 2015. “Manners Matter.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 59 (1): 185–189.10.1177/1541931215591038
51. Jamieson, G. A., and G., Skraaning. 2017. “Levels of Automation in Human Factors Models for Automation Design: Why We Might Consider Throwing the Baby out with the Bathwater.” Journal of Cognitive Engineering and Decision Making 12 (1): 42–49.
52. Johnson, D., J., Gardner, and J., Wiles. 2004. “Experience as a Moderator of the Media Equation: The Impact of Flattery and Praise.” International Journal of Human–Computer Studies 61 (3): 237–258.10.1016/j.ijhcs.2003.12.008
53. Johnson, M., J. M., Bradshaw, and P. J., Feltovich. 2017. “Tomorrow’s Human–Machine Design Tools: From Levels of Automation to Interdependencies.” Journal of Cognitive Engineering and Decision Making 12 (1): 77–82.
54. Jonsson, I.-M., C., Nass, J., Endo, B., Reaves, H., Harris, J., Le Ta, N., Chan, and S., Knapp. 2004. “Don’t Blame Me I Am Only the Driver.” Extended Abstracts of the 2004 Conference on Human Factors and Computing Systems–CHI ’04. doi:10.1145/985921.986028.
55. Jung, M. F., 2017. “Affective Grounding in Human-Robot Interaction.” Proceedings of the 2017 ACM/IEEE International Conference on Human–Robot Interaction–HRI ’17. Vienna, Austria. doi:10.1145/2909824.3020224.
56. Jung, M. F., N., Martelaro, and P. J., Hinds. 2015. “Using Robots to Moderate Team Conflict.” Proceedings of the Tenth Annual ACM/IEEE International Conference on Human–Robot Interaction–HRI ’15. Portland, Oregon. doi:10.1145/2696454.2696460.
57. Kaber, D. B., 2017a. “A Conceptual Framework of Autonomous and Automated Agents.” Theoretical Issues in Ergonomics Science 28 (3): 1–25.10.1080/1463922X.2017.1363314
58. Kaber, D. B., 2017b. “Issues in Human–Automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and Levels of Automation.” Journal of Cognitive Engineering and Decision Making 12 (1): 7–24.
59. Kim, P. H., K. T., Dirks, and C. D., Cooper. 2009. “The Repair of Trust: A Dynamic Bilateral Perspective and Multilevel Conceptualization.” Academy of Management Review 34 (3): 401–422.10.5465/AMR.2009.40631887
60. Kim, P. H., K. T., Dirks, C. D., Cooper, and D. L., Ferrin. 2006. “When More Blame is Better than Less: The Implications of Internal Vs. External Attributions for the Repair of Trust after a Competence- Vs. Integrity-based Trust Violation.” Organizational Behavior and Human Decision Processes 99 (1): 49–65.10.1016/j.obhdp.2005.07.002
61. Kim, P. H., D. L., Ferrin, C. D., Cooper, and K. T., Dirks. 2004. “Removing the Shadow of Suspicion: The Effects of Apology versus Denial for Repairing Competence- versus Integrity-based Trust Violations.” Journal of Applied Psychology 89 (1): 104–118.10.1037/0021-9010.89.1.104
62. Kirlik, A., 2017. “Automation and Adaptive Behavior.” Journal of Cognitive Engineering and Decision Making 12 (1): 70–73.
63. Klein, G., D. D., Woods, J. M., Bradshaw, R. R., Hoffman, and P. J., Feltovich. 2004. “Ten Challenges for Making Automation a ‘Team Player’ in Joint Human–Agent Activity.” IEEE Intelligent Systems 19 (6): 91–95.10.1109/MIS.2004.74
64. Koo, J., J., Kwac, W., Ju, M., Steinert, L., Leifer, and C., Nass. 2014. “Why Did My Car Just Do That? Explaining Semi-autonomous Driving Actions to Improve Driver Understanding, Trust, and Performance.” International Journal on Interactive Design and Manufacturing 9 (4): 269–275.
65. Kramer, R. M., and R. J., Lewicki. 2010. “Repairing and Enhancing Trust: Approaches to Reducing Organizational Trust Deficits.” The Academy of Management Annals 4 (1): 245–277.10.1080/19416520.2010.487403
66. Kraus, J. M., J., Sturn, J. E., Reiser, and M., Baumann. 2015. “Anthropomorphic Agents, Transparent Automation and Driver Personality.” Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications–Automotive UI ’15. doi:10.1145/2809730.2809738.
67. Kurzweil, R., 2005. The Singularity is near: When Humans Transcend Biology. London: Penguin.
68. Kushner, D., 2013. “The Real Story of Stuxnet.” IEEE Spectrum 50 (3): 48–53.10.1109/MSPEC.2013.6471059
69. Kwiatkowska, M., and M., Lahijanian. 2016. “Social Trust: A Major Challenge for the Future of Autonomous Systems.” AAAI Fall Symposium on Cross-disciplinary Challenges for Autonomous Systems, AAAI Fall Symposium. AAAI, September. Arlington, VA.
70. Lee, J. D., 2017. “Perspectives on Automotive Automation and Autonomy.” Journal of Cognitive Engineering and Decision Making 12 (1): 53–57.
71. Lee, J. D., and N., Moray. 1992. “Trust, Control Strategies and Allocation of Function in Human–Machine Systems.” Ergonomics 35 (10): 1243–1270.10.1080/00140139208967392
72. Lee, N., J., Kim, E., Kim, and O., Kwon. 2017. “The Influence of Politeness Behavior on User Compliance with Social Robots in a Healthcare Service Setting.” International Journal of Social Robotics 9 (5): 727–743.10.1007/s12369-017-0420-0
73. Lewicki, R. J., E. C., Tomlinson, and N., Gillespie. 2006. “Models of Interpersonal Trust Development: Theoretical Approaches, Empirical Evidence, and Future Directions.” Journal of Management 32 (6): 991–1022.10.1177/0149206306294405
74. Lin, P., 2016. “Why Ethics Matters for Autonomous Cars.” In Autonomous Driving, 69–85. Berlin: Springer.
75. Long, S. K., N. D., Karpinsky, and J. P., Bliss. 2017. “Trust of Simulated Robotic Peacekeepers among Resident and Expatriate Americans.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 2091–2095.10.1177/1541931213602005
76. Lyons, J. B., 2013. “Being Transparent about Transparency: A Model for Human–Robot Interaction.” 2013 AAAI Spring Symposium Series. Arlington, VA. http://www.aaai.org/ocs/index.php/SSS/SSS13/paper/viewPaper/5712.
77. Madhavan, P., and D. A., Wiegmann. 2004. “A New Look at the Dynamics of Human–Automation Trust: Is Trust in Humans Comparable to Trust in Machines?” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 48 (3): 581–585.10.1177/154193120404800365
78. Madhavan, P., and D. A., Wiegmann. 2007a. “Effects of Information Source, Pedigree, and Reliability on Operator Interaction with Decision Support Systems.” Human Factors: The Journal of the Human Factors and Ergonomics Society 49 (5): 773–785.10.1518/001872007X230154
79. Madhavan, P., and D. A., Wiegmann. 2007b. “Similarities and Differences between Human–Human and Human–Automation Trust: An Integrative Review.” Theoretical Issues in Ergonomics Science 8 (4): 277–301.10.1080/14639220500337708
80. Marinaccio, K., S., Kohn, R., Parasuraman, and E. J., de Visser. 2015. “A Framework for Rebuilding Trust in Social Automation across Health-care Domains.” Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care 4 (1): 201–205.10.1177/2327857915041036
81. McCullough, M. E., E. L., Worthington, J., Maxey, and K. C., Rachal. 1997. “Gender in the Context of Supportive and Challenging Religious Counseling Interventions.” Journal of Counseling Psychology 44 (1): 80–88.10.1037/0022-0167.44.1.80
82. McGuirl, J. M., and N. B., Sarter. 2006. “Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information.” Human Factors: The Journal of the Human Factors and Ergonomics Society 48 (4): 656–665.10.1518/001872006779166334
83. McIntyre, R. M., and E., Salas. 1995. “Measuring and Managing for Team Performance: Emerging Principles from Complex Environments.” In Team Effectiveness and Decision Making in Organizations, edited by R., Guzzo and E., Salas, 149–203. San Francisco, CA: Jossey-Bass.
84. McKendrick, R., T., Shaw, E., de Visser, H., Saqer, B., Kidwell, and R., Parasuraman. 2013. “Team Performance in Networked Supervisory Control of Unmanned Air Vehicles.” Human Factors: The Journal of the Human Factors and Ergonomics Society 56 (3): 463–475.
85. Mercado, J. E., M. A., Rupp, J. Y. C., Chen, M. J., Barnes, D., Barber, and K., Procci. 2016. “Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management.” Human Factors: The Journal of the Human Factors and Ergonomics Society 58 (3): 401–415.10.1177/0018720815621206
86. Merritt, S. M., and D. R., Ilgen. 2008. “Not All Trust is Created Equal: Dispositional and History-based Trust in Human–Automation Interactions.” Human Factors: The Journal of the Human Factors and Ergonomics Society 50 (2): 194–210.10.1518/001872008X288574
87. Meyer, J., H., Becker, P. M., Bösch, and K. W., Axhausen. 2017. “Autonomous Vehicles: The Next Jump in Accessibilities?” Research in Transportation Economics 62 (Supplement C): 80–91.10.1016/j.retrec.2017.03.005
88. Meyer, J., C., Miller, P. A., Hancock, E. J., de Visser, and M., Dorneich. 2016. “Politeness in Machine–Human and Human–Human Interaction.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60 (1): 279–283.10.1177/1541931213601064
89. Meyerson, D., K. E., Weick, and R. M., Kramer. 1996. “Swift Trust and Temporary Groups.” In Trust in Organizations: Frontiers of Theory and Research, 166–195. Thousand Oaks, CA: Sage.
90. Miller, C. A., 2017. “The Risks of Discretization: What is Lost in (Even Good) Levels-of-Automation Schemes.” Journal of Cognitive Engineering and Decision Making 12 (1): 74–76.
91. Mittu, R., D., Sofge, A., Wagner, and W. F., Lawless. 2016. Robust Intelligence and Trust in Autonomous Systems. Boston, MA: Springer.10.1007/978-1-4899-7668-0
92. Morita, P. P., and C. M., Burns. 2012. “Understanding ‘Interpersonal Trust’ from a Human Factors Perspective: Insights from Situation Awareness and the Lens Model.” Theoretical Issues in Ergonomics Science 15 (1): 88–110.
93. Muir, B. M., 1987. “Trust between Humans and Machines, and the Design of Decision Aids.” International Journal of Man–Machine Studies 27 (5–6): 527–539.10.1016/S0020-7373(87)80013-5
94. Muir, B. M., and N., Moray. 1996. “Trust in Automation. Part II. Experimental Studies of Trust and Human Intervention in a Process Control Simulation.” Ergonomics 39 (3): 429–460.10.1080/00140139608964474
95. Naikar, N., 2017. “Human–Automation Interaction in Self-organizing Sociotechnical Systems.” Journal of Cognitive Engineering and Decision Making 12 (1): 62–66.
96. Nakayachi, K., and M., Watabe. 2005. “Restoring Trustworthiness after Adverse Events: The Signaling Effects of Voluntary ‘Hostage Posting’ on Trust.” Organizational Behavior and Human Decision Processes 97 (1): 1–17.10.1016/j.obhdp.2005.02.001
97. Nass, C., B. J., Fogg, and Y., Moon. 1996. “Can Computers be Teammates?” International Journal of Human–Computer Studies 45 (6): 669–678.10.1006/ijhc.1996.0073
98. Nass, C., I.-M., Jonsson, H., Harris, B., Reaves, J., Endo, S., Brave, and L., Takayama. 2005. “Improving Automotive Safety by Pairing Driver Emotion and Car Voice Emotion.” CHI ’05 Extended Abstracts on Human Factors in Computing Systems–CHI '05. Portland, Oregon. doi:10.1145/1056808.1057070.
99. Nass, C., and K. M., Lee. 2001. “Does Computer-synthesized Speech Manifest Personality? Experimental Tests of Recognition, Similarity-attraction, and Consistency-attraction.” Journal of Experimental Psychology. Applied 7 (3): 171–181.10.1037/1076-898X.7.3.171
100. Nass, C., Y., Moon, B. J., Fogg, B., Reeves, and C., Dryer. 1995. “Can Computer Personalities be Human Personalities?” Conference Companion on Human Factors in Computing Systems–CHI ’95. Denver, Colorado. doi:10.1145/223355.223538.
101. Nass, C., J., Steuer, and E. R., Tauber. 1994. “Computers are Social Actors.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Celebrating Interdependence–CHI ’94. Boston, Massachusetts. doi:10.1145/191666.191703.
102. National Highway Traffic Safety Administration. 2016. Federal Automated Vehicles Policy: Accelerating the Next Revolution in Roadway Safety. http://www.nhtsa.gov/nhtsa/av/pdf/Federal_Automated_Vehicles_Policy.pdf.
103. Nelson, E. S., 2007. “The Face Symbol: Research Issues and Cartographic Potential.” Cartographica: The International Journal for Geographic Information and Geovisualization 42 (1): 53–64.10.3138/carto-v42-1-053
104. Norman, D. A., 1988. The Psychology of Everyday Things. New York: Basic Books.
105. Onnasch, L., C. D., Wickens, H., Li, and D., Manzey. 2014. “Human Performance Consequences of Stages and Levels of Automation.” Human Factors: The Journal of the Human Factors and Ergonomics Society 56 (3): 476–488.10.1177/0018720813501549
106. Pak, R., N., Fink, M., Price, B., Bass, and L., Sturre. 2012. “Decision Support Aids with Anthropomorphic Characteristics Influence Trust and Performance in Younger and Older Adults.” Ergonomics 55 (9): 1059–1072.10.1080/00140139.2012.691554
107. Pak, R., A. C., McLaughlin, W., Leidheiser, and E., Rovira. 2017. “The Effect of Individual Differences in Working Memory in Older Adults on Performance with Different Degrees of Automated Technology.” Ergonomics 60 (4): 518–532.10.1080/00140139.2016.1189599
108. Pak, R., E., Rovira, A. C., McLaughlin, and N., Baldwin. 2016. “Does the Domain of Technology Impact User Trust? Investigating Trust in Automation across Different Consumer-oriented Domains in Young Adults, Military, and Older Adults.” Theoretical Issues in Ergonomics Science 18 (3): 199–220.
109. Parasuraman, R., and P., Hancock. 1999. “Using Signal Detection Theory and Bayesian Analysis to Design Parameters for Automated Warning Systems.” In Automation, Technology and Human Performance, edited by Scerbo M. W., Mouloua, 63–67. Mahwah, NJ: Erlbaum.
110. Parasuraman, R., and C. A., Miller. 2004. “Trust and Etiquette in High-criticality Automated Systems.” Communications of the ACM 47 (4): 51–55.10.1145/975817
111. Parasuraman, R., and V., Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (2): 230–253.10.1518/001872097778543886
112. Parasuraman, R., T. B., Sheridan, and C. D., Wickens. 2000. “A Model for Types and Levels of Human Interaction with Automation.” IEEE Transactions on Systems, Man, and Cybernetics–Part A: Systems and Humans 30 (3): 286–297.10.1109/3468.844354
113. Pelegrini Morita, P., P. P., Morita, and C. M., Burns. 2014. “Trust Tokens in Team Development.” Team Performance Management: An International Journal 20 (1/2): 39–64.10.1108/TPM-03-2013-0006
114. Quinn, D. B., R., Pak, and E. J., de Visser. 2017. “Testing the Efficacy of Human–Human Trust Repair Strategies with Machines.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 1794–1798.10.1177/1541931213601930
115. Rice, S., and K., Geels. 2010. “Using System-wide Trust Theory to Make Predictions about Dependence on Four Diagnostic Aids.” The Journal of General Psychology 137 (4): 362–375.10.1080/00221309.2010.499397
116. Riek, L. D., T.-C., Rabinowitch, B., Chakrabarti, and P., Robinson. 2009. “How Anthropomorphism Affects Empathy toward Robots.” Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction–HRI ’09. San Diego, CA. doi:10.1145/1514095.1514158.
117. Riva, P., S., Sacchi, and M., Brambilla. 2015. “Humanizing Machines: Anthropomorphization of Slot Machines Increases Gambling.” Journal of Experimental Psychology. Applied 21 (4): 313–325.10.1037/xap0000057
118. Robinette, P., A. M., Howard, and A. R., Wagner. 2015. “Timing is Key for Robot Trust Repair.” Lecture Notes in Computer Science, 574–583. Springer International Publishing.10.1007/978-3-319-25554-5
119. Robinette, P., A. M., Howard, and A. R., Wagner. 2017. “Effect of Robot Performance on Human–Robot Trust in Time-critical Situations.” IEEE Transactions on Human–Machine Systems: 1–12.
120. Rocco, E., 1998. “Trust Breaks down in Electronic Contexts but Can Be Repaired by Some Initial Face-to-Face Contact.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems–CHI ’98. Los Angeles, CA. doi:10.1145/274644.274711.
121. Roemer, N., S., Jones, M., Marino, S., Hyland, and G., Southwood. 2017. “Electric Autonomous Vehicle Case Study Analysis.” https://kb.osu.edu/dspace/handle/1811/80713.
122. Rousseau, D. M., S. B., Sitkin, R. S., Burt, and C., Camerer. 1998. “Not so Different After All: A Cross-discipline View of Trust.” Academy of Management Review 23 (3): 393–404.10.5465/AMR.1998.926617
123. Rovira, E., R., Pak, and A., McLaughlin. 2016. “Effects of Individual Differences in Working Memory on Performance and Trust with Various Degrees of Automation.” Theoretical Issues in Ergonomics Science 18 (6): 573–591.
124. Salas, E., and J. A., Cannon-Bowers. 2001. “The Science of Training: A Decade of Progress.” Annual Review of Psychology 52 (1): 471–499.10.1146/annurev.psych.52.1.471
125. Salas, E., N. J., Cooke, and M. A., Rosen. 2008. “On Teams, Teamwork, and Team Performance: Discoveries and Developments.” Human Factors: The Journal of the Human Factors and Ergonomics Society 50 (3): 540–547.10.1518/001872008X288457
126. Salas, E., D. E., Sims, and C. S., Burke. 2005. “Is There a ‘Big Five’ in Teamwork?” Small Group Research 36 (5): 555–599.10.1177/1046496405277134
127. Salonen, A. O., 2018. “Passenger’s Subjective Traffic Safety, in-Vehicle Security and Emergency Management in the Driverless Shuttle Bus in Finland.” Transport Policy 61 (Supplement C): 106–110.10.1016/j.tranpol.2017.10.011
128. Sarter, N. B., and D. D., Woods. 1997. “Team Play with a Powerful and Independent Agent: Operational Experiences and Automation Surprises on the Airbus A-320.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (4): 553–569.10.1518/001872097778667997
129. Satterfield, K., C., Baldwin, E., de Visser, and T., Shaw. 2017. “The Influence of Risky Conditions in Trust in Autonomous Systems.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 324–328.10.1177/1541931213601562
130. Schaefer, K. E., J. Y. C., Chen, J. L., Szalma, and P. A., Hancock. 2016. “A Meta-analysis of Factors Influencing the Development of Trust in Automation.” Human Factors: The Journal of the Human Factors and Ergonomics Society 58 (3): 377–400.10.1177/0018720816634228
131. Schaefer, K. E., E. R., Straub, J. Y. C., Chen, J., Putney, and A. W., Evans. 2017. “Communicating Intent to Develop Shared Situation Awareness and Engender Trust in Human–Agent Teams.” Cognitive Systems Research 46: 26–39.10.1016/j.cogsys.2017.02.002
132. Schilke, O., M., Reimann, and K. S., Cook. 2013. “Effect of Relationship Experience on Trust Recovery following a Breach.” Proceedings of the National Academy of Sciences 110 (38): 15236–15241.10.1073/pnas.1314857110
133. Schweitzer, M., J., Hershey, and E., Bradlow. 2006. “Promises and Lies: Restoring Violated Trust.” Organizational Behavior and Human Decision Processes 101 (1): 1–19.10.1016/j.obhdp.2006.05.005
134. Seeger, A.-M., and A., Heinzl. 2017. “Human versus Machine: Contingency Factors of Anthropomorphism as a Trust-inducing Design Strategy for Conversational Agents.” Lecture Notes in Information Systems and Organisation, 129–139.
135. Semigran, H. L., D. M., Levine, S., Nundy, and A., Mehrotra. 2016. “Comparison of Physician and Computer Diagnostic Accuracy.” JAMA Internal Medicine 176 (12): 1860–1861.10.1001/jamainternmed.2016.6001
136. Seo, S. H., K., Griffin, J. E., Young, A., Bunt, S., Prentice, and V., Loureiro-Rodríguez. 2017. “Investigating People’s Rapport Building and Hindering Behaviors When Working with a Collaborative Robot.” International Journal of Social Robotics 10 (1): 147–161.
137. Sheridan, T. B., 2016. “Human–Robot Interaction.” Human Factors: The Journal of the Human Factors and Ergonomics Society 58 (4): 525–532.10.1177/0018720816644364
138. Sheridan, T. B., 2017. “Comments on ‘Issues in Human–Automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and Levels of Automation’ by David B. Kaber.” Journal of Cognitive Engineering and Decision Making 12 (1): 25–28.
139. Singh, I. L., R., Molloy, and R., Parasuraman. 1993. “Individual Differences in Monitoring Failures of Automation.” The Journal of General Psychology 120 (3): 357–373.10.1080/00221309.1993.9711153
140. Slovic, P., 1993. “Perceived Risk, Trust, and Democracy.” Risk Analysis 13 (6): 675–682.10.1111/risk.1993.13.issue-6
141. Slovic, P., 1999. “Trust, Emotion, Sex, Politics, and Science: Surveying the Risk-assessment Battlefield.” Risk Analysis: An Official Publication of the Society for Risk Analysis 19 (4): 689–701.
142. Smith, P. J., 2017. “Conceptual Frameworks to Guide Design.” Journal of Cognitive Engineering and Decision Making 12 (1): 50–52.
143. Sorkin, R. D., B. H., Kantowitz, and S. C., Kantowitz. 1988. “Likelihood Alarm Displays.” Human Factors: The Journal of the Human Factors and Ergonomics Society 30 (4): 445–459.10.1177/001872088803000406
144. Srinivasan, V., and L., Takayama. 2016. “Help Me Please.” Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems–CHI ’16. San Jose, CA. doi:10.1145/2858036.2858217.
145. Szalma, J. L., 2014. “On the Application of Motivation Theory to Human Factors/Ergonomics.” Human Factors: The Journal of the Human Factors and Ergonomics Society 56 (8): 1453–1471.10.1177/0018720814553471
146. Szalma, J. L., and G. S., Taylor. 2011. “Individual Differences in Response to Automation: The Five Factor Model of Personality.” Journal of Experimental Psychology. Applied 17 (2): 71–96.10.1037/a0024170
147. Thielmann, I., and B. E., Hilbig. 2015. “Trust: An Integrative Review from a Person–Situation Perspective.” Review of General Psychology 19 (3): 249–277.10.1037/gpr0000046
148. Tomlinson, E. C., B. R., Dineen, and R. J., Lewicki. 2004. “The Road to Reconciliation: Antecedents of Victim Willingness to Reconcile following a Broken Promise.” Journal of Management 30 (2): 165–187.10.1016/j.jm.2003.01.003
149. Tomlinson, E. C., and R. C., Mayer. 2009. The Role of Causal Attribution Dimensions in Trust Repair. Academy of Management Review 34 (1): 85–104.
150. Torrey, C., S. R., Fussell, and S., Kiesler. 2013. “How a Robot Should Give Advice.” 2013 8th ACM/IEEE International Conference on Human–Robot Interaction (HRI). Tokyo, Japan. doi:10.1109/hri.2013.6483599.
151. Tzeng, J.-Y., 2004. “Toward a More Civilized Design: Studying the Effects of Computers That Apologize.” International Journal of Human-Computer Studies 61 (3): 319–345.10.1016/j.ijhcs.2004.01.002
152. de Visser, E. J., M., Cohen, A., Freedy, and R., Parasuraman. 2014. “A Design Methodology for Trust Cue Calibration in Cognitive Agents.” Lecture Notes in Computer Science, 251–262. Springer International Publishing. 10.1007/978-3-319-07458-0
153. de Visser, E. J., S. S., Monfort, K., Goodyear, L., Lu, M., O’Hara, M. R., Lee, R., Parasuraman, and F., Krueger. 2017. “A Little Anthropomorphism Goes a Long Way.” Human Factors: The Journal of the Human Factors and Ergonomics Society 59 (1): 116–133.10.1177/0018720816687205
154. de Visser, E. J., S. S., Monfort, R., McKendrick, M. A. B., Smith, P. E., McKnight, F., Krueger, and R., Parasuraman. 2016. “Almost Human: Anthropomorphism Increases Trust Resilience in Cognitive Agents.” Journal of Experimental Psychology. Applied 22 (3): 331–349.10.1037/xap0000092
155. de Visser, E. J., R., Pak, and M. A., Neerincx. 2017. “Trust Development and Repair in Human–Robot Teams.” Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction–HRI ’17. Vienna, Austria. doi:10.1145/3029798.3038409.
156. de Visser, E. J., and R., Parasuraman. 2011. “Adaptive Aiding of Human–Robot Teaming.” Journal of Cognitive Engineering and Decision Making 5 (2): 209–231.10.1177/1555343411410160
157. de Visser, E. J., R., Parasuraman, A., Freedy, E., Freedy, & G., Weltman. (2006, October). A Comprehensive Methodology for Assessing Human-Robot Team Performance for Use in Training and Simulation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 50, No. 25, pp. 2639–2643). Los Angeles, CA: SAGE Publications.
158. Walliser, J. C., 2017. “Social Interactions with Autonomous Agents: Team Perception and Team Development Improve Teamwork Outcomes.” PhD, George Mason University.
159. Walliser, J. C., E. J., de Visser, and T. H., Shaw. 2016. “Application of a System-wide Trust Strategy When Supervising Multiple Autonomous Agents.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60 (1): 133–137.10.1177/1541931213601031
160. Waytz, A., J., Heafner, and N., Epley. 2014. “The Mind in the Machine: Anthropomorphism Increases Trust in an Autonomous Vehicle.” Journal of Experimental Social Psychology 52: 113–117.10.1016/j.jesp.2014.01.005
161. Wickens, C., 2017. “Automation Stages & Levels, 20 Years after.” Journal of Cognitive Engineering and Decision Making 12 (1): 35–41.
162. Wiese, E., T., Shaw, D., Lofaro, and C., Baldwin. 2017. “Designing Artificial Agents as Social Companions.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 1604–1608.10.1177/1541931213601764
163. Winter, R., 2016. “Using System-wide Trust Theory to Make Predictions about Trust in Transportation Automation.” Journal of Technologies and Human Usability 12 (2): 1–11.10.18848/2381-9227/CGP
164. Woods, D. D., 2016. “The Risks of Autonomy.” Journal of Cognitive Engineering and Decision Making 10 (2): 131–133.10.1177/1555343416653562
165. Woods, D. D., N., Leveson, and E., Hollnagel. 2012. Resilience Engineering: Concepts and Precepts. Aldershot, UK: Ashgate Publishing.
166. Yang, X. J., X., Jessie Yang, V. V., Unhelkar, K., Li, and J. A., Shah. 2017. “Evaluating Effects of User Experience and System Transparency on Trust in Automation.” Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction–HRI ’17. doi:10.1145/2909824.3020230.
167. Zuk, T., and S., Carpendale. 2007. “Visualization of Uncertainty and Reasoning.” In Smart Graphics, 164–177. Berlin, Heidelberg: Springer.10.1007/978-3-540-73214-3