Situation awareness-based agent transparency and human-autonomy teaming effectiveness

Theoretical Issues in Ergonomics Science

Volumn 19, Issue 3, 2018, Pages 259-282

  Chen, Jessie Y C ^a   Lakhmani, Shan G ^b   Stowers, Kimberly ^b   Selkowitz, Anthony R ^a   Wright, Julia L ^a   Barnes, Michael ^a  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

autonomy; bidirectional communication; human autonomy teaming; human robot interaction; Transparency

Indexed keywords

EID: 85042744985     PISSN: 1463922X     EISSN: 1464536X     Source Type: Journal    
DOI: 10.1080/1463922X.2017.1315750     Document Type: Article

References (70)

1. Allen, J. E., C. I., Guinn, and E., Horvtz. Sep./Oct. 1999. “Mixed-Initiative Interaction.” IEEE Intelligent Systems and their Applications 14(5): 14–23. doi: 10.1109/5254.796083.
2. Barnes, M. J., J. Y. C., Chen, and F., Jentsch. 2015. “Designing for Mixed-Initiative Interactions between Human and Autonomous Systems in Complex Environments.” 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Hong Kong: IEEE. 1386–1390. doi: 10.1109/SMC.2015.246.
3. Barrett, S., P., Stone, S., Kraus, and A., Rosenfeld (2012). “Learning Teammate Models for ad hoc Teamwork.” In AAMAS Adaptive Learning Agents (ALA) Workshop, Valencia. 57–63.
4. Bass, E. J., L. A., Baumgart, and K. K., Shepley. 2013. “The Effect of Information Analysis Automation Display Content on Human Judgment Performance in Noisy Environments.” Journal of Cognitive Engineering and Decision Making 7(1): 49–65.
5. Behymer, K. J., M. J., Patzek, C. D., Rothwell, and H. A., Ruff. Forthcoming. Initial Evaluation of the Intelligent Multi-UXV Planner with Adaptive Collaborative/Control Technologies (IMPACT). Technical Report: AFRL-RH-WP-TR-2016-TBD, Wright-Patterson AFB, OH: Air Force Research Lab.
6. Beller, J., M., Heesen, and M., Vollrath. 2013. “Improving the Driver-Automation Interaction: An Approach Using Automation Uncertainty.” Human Factors: The Journal of the Human Factors and Ergonomics Society 55(6): 1130–1141. doi: 10.1177/0018720813482327.
7. Bitan, Y., and J., Meyer. 2007. “Self-Initiated and Respondent Actions in a Simulated Control Task.” Ergonomics 50(5): 763–788. doi: 10.1080/00140130701217149.
8. Bradshaw, J. M., P. J., Feltovich, and M., Johnson. 2012. “Human-Agent Interaction.” In The Handbook of Human-Machine Interaction: A Human-Centered Design Approach, edited by G. A., Boy, 283–299. Surrey: Ashgate Publishing Ltd.
9. Bruni, S., J. J., Marquez, A., Brzezinski, C., Nehmeand, Y., Boussemart. 2007, June. “Introducing a Human-Automation Collaboration Taxonomy (HACT) in Command and Control Decision-Support Systems." In Proceedings of the 12th International Command and Control Research and Technology Symposium. Newport, RI.
10. Calhoun, G. L, H. A., Ruff, K. J., Behymer, and E. M., Mersch. 2017. “Operator-Autonomy Teaming Interfaces to Support Multi-Unmanned Vehicle Missions.” In Advances in Human Factors in Robots and Unmanned Systems, edited by P., Savage-Knepshield and J. Y. C., Chen, 113–126. Warsaw: Springer International Publishing.
11. Cannon-Bowers, J., E., Salas, and S., Converse. 1993. “Shared Mental Models in Expert Team Decision Making.” In Individual and Group Decision Making: Current Issues, edited by N. J., Castellan, 221–246. Hillsdale, NJ: Erlbaum.
12. Chen, J. Y. C., and M. J., Barnes. 2010. “Supervisory Control of Robots Using RoboLeader.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting. San Francisco, CA: Sage. 1483–1487. doi: 10.1177/154193121005401927.
13. Chen, J. Y. C., and M. J., Barnes. 2012a. “Supervisory Control of Multiple Robots Effects of Imperfect Automation and Individual Differences.” Human Factors: The Journal of the Human Factors and Ergonomics Society 54(2): 157–174. doi: 10.1177/0018720811435843.
14. Chen, J. Y. C., and M. J., Barnes. 2012b. “Supervisory Control of Multiple Robots in Dynamic Tasking Environments.” Ergonomics 55(9): 1043–1058. doi: 10.1080/00140139.2012.689013.
15. Chen, J. Y. C., and M. J., Barnes. 2014. “Human-Agent Teaming for Multirobot Control: A Review of Human Factors Issues.” IEEE Transactions on Human-Machine Systems 44(1) 13–29. doi: 10.1109/THMS.2013.2293535.
16. Chen, J. Y. C., and M. J., Barnes. 2015. “Agent Transparency for Human-Agent Teaming Effectiveness.” 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Hong Kong: IEEE Press. 1381–1385. doi: 10.1109/SMC.2015.245.
17. Chen, J. Y. C., M. J., Barnes, A. R., Selkowitz, K., Stowers, S. G., Lakhmani, and N., Kasdaglis. 2016. “Human-Autonomy Teaming and Agent Transparency.” Companion Publication of the 21st International Conference on Intelligent User Interfaces. Sonoma, CA: ACM. 28–31. doi: 10.1145/2876456.2879479.
18. Chen, J. Y. C., K., Procci, M., Boyce, J., Wright, A., Garcia, and M., Barnes. 2014. Situation Awareness-Based Agent Transparency. Report No. ARL-TR-6905, Aberdeen Proving Ground, MD, U.S. Army Research Laboratory.
19. Cook, M. B., and H. S., Smallman. 2008. “Human Factors of the Confirmation Bias in Intelligence Analysis: Decision Support from Graphical Evidence Landscapes.” Human Factors: The Journal of the Human Factors and Ergonomics Society 50(5): 745–754. doi: 10.1518/001872008X354183.
20. de Visser, E. J., M., Cohen, A., Freedy, and R., Parasuraman. 2014. “A Design Methodology for Trust Cue Calibration in Cognitive Agents,” In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, edited by R. Shumaker, S., Lackey, 251–262. Cham, Swtizerland: Springer International Publishing. doi: 10.1007/978-3-319-07458-0_24.
21. DeChurch, L. A., and J. R., Mesmer-Magnus. 2010. “The Cognitive Underpinnings of Effective Teamwork: a Meta-Analysis.” Journal of Applied Psychology 95(1): 32–53. doi: 10.1037/a0017328.
22. Defense Science Board. 2016. DefenseScience Board Summer Study on Autonomy, Washington, DC: Under Secretary of Defense.
23. Department of Defense. 2013. “Autonomy Research Pilot Initiative Web Feature.” Last modified June 14. http://www.acq.osd.mil/chieftechnologist/arpi.html.
24. Endsley, M. R., 1995. "Toward a Theory of Situation Awareness in Dynamic Systems." Human Factors: The Journal of the Human Factors and Ergonomics Society 37(1): 32–64. doi: 10.1518/001872095779049543.
25. Fern, L., and R. J., Shively. 2009. “A Comparison of Varying Levels of Automation on the Supervisory Control of Multiple UASs.” Proceedings of AUVSIs Unmanned Systems North America. New York, NY: Curran Associates Inc. 10–13. https://www.researchgate.net/profile/Lisa_Fern/publication/257645042_A_COMPARISON_OF_VARYING_LEVELS_OF_AUTOMATION_ON_THE_SUPERVISORY_CONTROL_OF_MULTIPLE_UASs/links/004635258b5a8ed6b7000000.pdf.
26. Fong, T. W., I., Nourbakhsh, C., Kunz, L., Flueckiger, J., Schreiner, R., Ambrose, R., Burridge, et al. 2005. “The Peer-to-Peer Human-Robot Interaction Project.” AIAA Space 2005. Long Beach, CA: American Institute of Aeronautics and Astronautics. doi: 10.2514/6.2005-6750.
27. Fong, T. W., C., Thorpe, and C., Baur. 2003. “Robot, Asker of Questions.” Robotics and Autonomous Systems 42(3): 235–243. doi: 10.1016/S0921-8890(02)00378-0.
28. Gillespie, K., M., Molineaux, M.W., Floyd, S. S., Wattam, and D. W., Aha. 2015. “Goal Reasoning for an Autonomous Squad Member," Technical Report GT-IRIM-CR-2015-001, In Goal Reasoning: Papers from the ACS Workshop, edited by D. W., Aha, 52–67. Atlanta, GA: Georgia Institute of Technology, Institute for Robotics and Intelligent Machines.
29. Goodrich, M. A., 2013. “Multitasking and Multi-Robot Management.” In Oxford Handbook of Cognitive Engineering, edited by J. D., Lee and A., Kirklik, 379–394. New York, NY: Oxford University Press. doi: 10.1093/oxfordhb/9780199757183.013.0025.
30. Gunning, D., 2016. Explainable Artificial Intelligence. http://www.darpa.mil/program/explainable-artificial-intelligence.
31. Hayes, B., and B., Scassellati. 2013. “Challenges in Shared-Environment Human-Robot Collaboration.” Paper presented at the 8th ACM/IEEE International Conference on Human-Robot Interaction, Workshop on Collaborative Manipulation. Tokyo, Japan, March 3-6. http://bradhayes.info/papers/hayes_challenges_HRI_collab_2013.pdf.
32. Helldin, T., 2014. “Transparency for Future Semi-Automated Systems.” PhD diss., Orebro University.
33. Helldin, T., U., Ohlander, G., Falkman, and M., Riveiro. 2014. “Transparency of Automated Combat Classification.” Engineering Psychology and Cognitive Ergonomics 22–33. doi: 10.1007/978-3-319-07515-0_3.
34. Jones, D. G., and Kaber, D. B., 2004. “Situation Awareness Measurement and the Situation Awareness Global Assessment Technique.” Handbook of Human Factors and Ergonomics Methods, edited by N. A., Stanton, A., Hedge, K., Brookhuis, E., Salas, and H. W., Hendrick, 42–1-42-8. London: Taylor & Francis.
35. Kaupp, T., A., Makarenko, and H., Durrant-Whyte. 2010. “Human-Robot Communication for Collaborative Decision Making—A Probabilistic Approach.” Robotics and Autonomous Systems 58(5): 444–456. doi: 10.1016/j.robot.2010.02.003.
36. Koola, P. M., S., Ramachandran, and K., Vadakkeveedu. (2016). “How Do We Train a Stone to Think? A Review of Machine Intelligence and its Implications.” Theoretical Issues in Ergonomics Science 17(2): 211–238. doi: 10.1080/1463922X.2015.1111462.
37. Lee, J. D., 2012. “Trust, Trustworthiness, and Trustability.” Presented at the Workshop on Human Machine Trust for Robust Autonomous Systems. Ocala, FL, (2012 Jan–Feb).
38. Lee, J. D., and K. A., See. 2004 “Trust in Automation: Designing for Appropriate Reliance.” Human Factors: The Journal of the Human Factors and Ergonomics Society 46(1): 50–80. doi: 10.1518/hfes.46.1.50_30392.
39. Linegang, M. P., H. A., Stoner, M. J., Patterson, B. D., Seppelt, J. D., Hoffman, Z. B., Crittendon, and J. D., Lee. 2006. “Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological Approach.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 50(23): 2482–2486. doi: 10.1177/154193120605002304.
40. Lyons, J. B., 2013. “Being Transparent About Transparency: A Model For Human-Robot Interaction." Technical Report SS-13-07. In Trust and Autonomous Systems: Papers fromtheAAAI Spring Symposium, D., Sofge, G., Kruijff, W.F., Lawless, pp. 48–53. doi: https://pdfs.semanticscholar.org/bf51/f5448981d985e082f2d9511d276ca6519944.pdf.
41. Lyons, J. B., and P. R., Havig. 2014. “Transparency in a Human-Machine Context: Interface Approaches for Fostering Shared Awareness/Intent." In Virtual,Augmentedand MixedReality.Designing and Developing Virtual and Augmented Environments, edited by R., Shumaker, S., Lackey, pp. 181–190. Cham, Swtizerland: Springer International Publishing. doi: 10.1007/978-3-319-07458-0_18.
42. Lyons, J. B., G. G., Sadler, K., Koltai, H., Battiste, N. T., Ho, L. C., Hoffmann, D., Smith, W., Johnson, and R., Shively. 2017. “Shaping Trust Through Transparent Design: Theoretical and Experimental Guidelines.” In Advances in Human Factors in Robots and Unmanned Systems, pp. 127–136, Cham, Switzerland: Springer International Publishing.
43. Mathieu, J. E., T. S., Heffner, G. F., Goodwin, E., Salas, and J. A., Cannon-Bowers. 2000. “The Influence of Shared Mental Models on Team Process and Performance.” Journal of Applied Psychology 85(2): 273–283. doi: 10.1037/0021-9010.85.2.273.
44. McGuirl, J. M., and N. B., Sarter. 2006. “Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information.” Human Factors: The Journal of the Human Factors and Ergonomics Society 48(4): 656–665. doi: 10.1518/001872006779166334.
45. Mercado, J. E., M. A., Rupp, J. Y. C., Chen, M. J., Barnes, D., Barber, and K., Procci. 2016. “Intelligent Agent Transparency in Human-Agent Teaming for Multi-UxV Management.” Human Factors: The Journal of the Human Factors and Ergonomics Society 58.3(2016): 401–415. doi: 10.1177/0018720815621206.
46. Meyer, J., and J. D., Lee. 2013. “Trust, Reliance, and Compliance.” In The Oxford Handbook of Cognitive Engineering, edited by J. D., Lee and A., Kirlik, pp.109–124. New York, NY: Oxford University Press. doi: 10.1093/oxfordhb/9780199757183.013.0007.
47. Neyedli, H. F., J. G., Hollands, and G. A., Jamieson. 2009. “Human Reliance on an Automated Combat ID System: Effects of Display Format.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Sage Publications) 53(4): 212–216. doi: 10.1177/154193120905300411.
48. Parasuraman, R., M., Barnes, and K., Cosenzo. 2007. “Adaptive Automation For Human-Robot Teaming in Future Command and Control Systems.” International Journal of Command and Control 1(2): 43–68.
49. Parasuraman, R., and C. A., Miller. 2004. “Trust and Etiquette in High-Criticality Automated Systems.” Communications of the ACM 47(4): 51–55. doi: 10.1145/975817.975844.
50. Parasuraman, R., R., Molloy, and I. L., Singh. 1993. “Performance Consequences of Automation-Induced ‘Complacency’ ”. The International Journal of Aviation Psychology 3(1): 1–23. doi: 10.1207/s15327108ijap0301_1.
51. Parasuraman, R., and V., Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39(2): 230–253. doi: 10.1518/001872097778543886.
52. Rao, A. S., and M. P., Georgeff. 1995. “BDI Agents: From Theory to Practice.” Proceedings of the First International Conference on Multiagent Systems. Palo Alto, CA: Association for the Advancement of Artificial Intelligence Press, 312–319.
53. Russell, S., and P., Norvig. 2009. Artificial Intelligence: A Modern Approach. 3rd ed. Upper Saddle River, NJ: Prentice Hall Press.
54. Selkowitz, A. R., S. G., Lakhmani, C. N., Larios, and J. Y. C., Chen. 2016. “Agent Transparency and the Autonomous Squad Member.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60(1): 1319–1323. doi: 10.1177/1541931213601305
55. Selkowitz, A. R., C. N., Larios, S. G., Lakhmani, and J. Y. C., Chen. 2017. “Displaying Information to Support Transparency for Autonomous Platforms.” Advances in Human Factors in Robots and Unmanned Systems. Orlando, FL: Springer International Publishing, 161. doi: 10.1007/978-3-319-41959-6_14.
56. Seppelt, B. D., and J. D., Lee. 2007. “Making Adaptive Cruise Control (ACC) Limits Visible.” International Journal of Human-Computer Studies 65(3): 192–205. doi: 10.1016/j.ijhcs.2006.10.001.
57. Shattuck, L. G., 2015. “Transitioning to Autonomy: A Human Systems Integration Perspective.” Presented at Transitioning to Autonomy: Changes in the role of humans in air transportation, Moffett Field, CA, 10–12 March 2015. https://human-factors.arc.nasa.gov/workshop/autonomy/download/presentations/Shaddock%20.pdf.
58. Singh, P., B., Barry, and H., Liu. 2004. “Teaching Machines About Everyday Life.” BT Technology Journal 22(4): 227–240. doi: 10.1023/B:BTTJ.0000047601.53388.74.
59. Smith, P. J., C. E., McCoy, and C., Layton. 1997. “Brittleness in the design of cooperative problem-solving systems: The effects on user performance.” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 27(3): 360–371. doi: 10.1109/3468.568744.
60. Stanton, N. A., M. S., Young, and G. H., Walker. 2007. “The Psychology of Driving Automation: a Discussion with Professor Don Norman.” International Journal of Vehicle Design 45(3): 289–306. doi: 10.1504/IJVD.2007.014906.
61. Stowers, K., J. Y. C., Chen, N., Kasdaglis, O., Newton, M., Rupp, and M., Barnes. Forthcoming. Effects of Situation Awareness-Based Agent Transparency Information on Human Agent Teaming for Multi-UxVManagement, Report No. ARL-TR-XX, Aberdeen Proving Ground, MD: Army Research Lab.
62. Stubbs, K., D., Wettergreen, and P. H., Hinds. 2007. “Autonomy and Common Ground in Human-Robot Interaction: A Field Study.” IEEE Intelligent Systems 22(2): 42–50. doi: 10.1109/MIS.2007.21.
63. Sycara, K., and G., Sukthankar. 2006. “Literature review of teamwork models.” Report No. CMU-RI-TR-06-50. Pittsburgh, PA: Robotics Institute, Carnegie Mellon University.
64. Thomaz, A. L., and C., Breazeal. 2006. “Transparency and Socially Guided Machine Learning.” Paper presented at the 5th International Conference on Development and Learning (ICDL), Bloomington, IN, May 31-June 3.
65. Tufte, E. R., 2001. The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press.
66. Warner Norcross and Judd. 2015. Trucking, Mining Industries Blazing a Path to Vehicle Autonomy. January 14. http://www.wnj.com/Publications/Trucking-Mining-Industries-Blazing-a-Path-to-Vehic.
67. Wooldridge, M., and N. R., Jennings. 1995. “Intelligent Agents: Theory and Practice.” The Knowledge Engineering Review 10(2): 115–152. doi: 10.1017/S0269888900008122.
68. Wright, J. L., J. Y. C., Chen, P. A., Hancock, I., Yi, and M. J., Barnes. Forthcoming. “Transparency of Agent Reasoning and its Effect on Automation-Induced Complacency.” Report No. ARL-TR-XX, Aberdeen Proving Ground, MD: Army Research Lab.
69. Wright, J. L., J. Y. C., Chen, S. A., Quinn, and M. J., Barnes. 2013. “The Effects of Level of Autonomy on Human-Agent Teaming for Multi-Robot Control and Local Security Maintenance ” Report No: ARL-TR-6724, Aberdeen Proving Ground, MD:, Army Research Laboratory.
70. Zhou, J., and F., Chen. 2015. “Making Machine Learning Useable.” International Journal of Computational Science and Engineering 14(2): 91–109. doi: 10.1504/IJISTA.2015.074069.