Intelligent Agent Transparency in Human-Agent Teaming for Multi-UxV Management

Human Factors

Volumn 58, Issue 3, 2016, Pages 401-415

  Mercado, Joseph E ^a   Rupp, Michael A ^b   Chen, Jessie Y C ^a   Barnes, Michael J ^a   Barber, Daniel ^b   Procci, Katelyn ^b  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

human agent teaming; intelligent agent transparency; multi UxV management

Indexed keywords

BINARY ALLOYS; HUMAN RESOURCE MANAGEMENT; INTELLIGENT AGENTS; VANADIUM ALLOYS;

ADDITIONAL COSTS; EXTERNAL INFORMATIONS; HUMAN-AGENT TEAMING; MULTIROBOTS; OPERATOR PERFORMANCE; PERCEIVED USABILITY;

TRANSPARENCY;

ARMY; CALIBRATION; COMPUTER INTERFACE; HUMAN; HUMAN EXPERIMENT; INTELLIGENCE; RESPONSE TIME; TRUST; WORKLOAD; ADULT; ARTIFICIAL INTELLIGENCE; AUTOMATION; COMPUTER SIMULATION; FEMALE; MALE; MAN MACHINE INTERACTION; TASK PERFORMANCE; YOUNG ADULT;

ADULT; ARTIFICIAL INTELLIGENCE; AUTOMATION; COMPUTER SIMULATION; FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; YOUNG ADULT;

EID: 84962858665     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720815621206     Document Type: Article

References (47)

1. Ahmed N., de Visser E., Shaw T., Mohamed-Ameen A., Campbell M., Parasuraman R., (2014). Statistical modeling of networked human-automation performance using working memory capacity. Ergonomics, 57, 295-318.
2. Bevan N., Macleod M., (1994). Usability measurement in context. Behaviour & Information Technology, 13, 132-145.
3. Bradshaw J. M., Feltovich P. J., Johnson M., Bunch L., Breedy M. R., Eskridge T. C., Uszok A., (2008). Coordination in human-agent-robot teamwork. In International Symposium on Collaborative Technology and Systems (pp. 467-476). Piscataway, NJ: IEEE.
4. Brooke J., (1996). SUS: A quick and dirty usability scale. In Jordan P. W., Thomas B., Weerdmeester B. A., McClelland I. L., (Eds.), Usability evaluation in industry (pp. 189-194). London, UK: Taylor & Francis.
5. Chen J. Y., Barnes M. J., Harper-Sciarini M., (2011). Supervisory control of multiple robots: Human-performance issues and user-interface design. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 41, 435-454.
6. Chen J. Y. C., Barnes M. J., (2014). Human-agent teaming for multi-robot control: A review of human factors issues. IEEE Transactions on Human-Machine Systems, 44, 13-29.
7. Chen J. Y. C., Procci K., Boyce M., Wright J., Garcia A., Barnes M., (2014). Situation awareness-based agent transparency (No. ARL-TR-6905). Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
8. Conway A. R. A., Kane M. J., Bunting M. F., Hambrick Z. D., Willhelm O., Engle R., (2005). Working Memory Span Tasks: A Methodological Review and User's Guide. Psychonomic Bulletin & Review, 12, 769-786.
9. Cook M., Smallman H., (2008). Human factors of the confirmation bias in intelligence analysis: Decision support from graphical evidence landscapes. Human Factors, 50, 745-754.
10. Cummings M. L., Mitchell P. J., (2008). Predicting controller capacity in supervisory control of multiple UAVs. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 38, 451-460.
11. de Visser E., Krueger F., McKnight P., Scheid S., Smith M., Chalk S., Parasuraman R., (2012). The world is not enough: Trust in cognitive agents. In Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting (pp. 263-267). Santa Monica, CA: Human Factors and Ergonomics Society.
12. Douglass S., (2013). Learner models in the large-scale cognitive modeling initiative. In Sottilare R., Graesser A., Hu X., Holden H., (Eds.), Design recommendations for adaptive intelligent tutoring systems learner modeling (Vol. 1, pp. 111-126). Orlando, FL: U.S. Army Research Laboratory.
13. Draper M, H,. (2013). Realizing autonomy via intelligent adaptive hybrid control: Adaptable autonomy for achieving UxV RSTA team decision superiority [Funding proposal]. Arlington, VA: Office of the Assistant Secretary of Defense for Research and Engineering.
14. Dzindolet M. T., Peterson S. A., Pomranky R. A., Pierce L. G., Beck H. P., (2003). The role of trust in automation reliance. International Journal of Human-Computer Studies, 58, 697-718.
15. Ekstrom R. B., French J. W., Harman H. H., (1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Service.
16. Endsley M. R., (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37, 32-64.
17. Freedy E., DeVisser E., Weltman G., Coeyman N., (2007,). Measurement of trust in human-robot collaboration. In Proceedings of IEEE International Symposium on Collaborative Technologies and Systems (pp. 106-114). Piscataway, NJ: IEEE.
18. Groom V., Nass C., (2007). Can robots be teammates? Benchmarks in human-robot teams. Interaction Studies, 8, 483-500.
19. Gugerty L., Brooks J., (2004). Reference-frame misalignment and cardinal direction judgments: Group differences and strategies. Journal of Experimental Psychology: Applied, 10, 75-88.
20. Hardin B., Goodrich M. A., (2009,). On using mixed-initiative control: A perspective for managing large-scale robotic teams. In Proceedings of the 4th ACM/IEEE International Conference on Human-Robot Interaction (pp. 165-172). New York, NY: ACM.
21. Hart S., Staveland L., (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock P., Meshkati N., (Eds.), Human mental workload (pp. 139-183). Amsterdam, Netherlands: Elsevier.
22. Hegarty M., Waller D., (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32, 175-191.
23. Helldin T., (2014). Transparency for future semi-automated systems (Doctoral dissertation). Örebro University, Örebro, Sweden.
24. Hoffman J. E., Subramaniam B., (1995). The role of visual attention in saccadic eye movements. Perception & Psychophysics, 57, 787-795.
25. Hwang S. L., Yau Y. J., Lin Y. T., Chen J. H., Huang T. H., Yenn T. C., Hsu C. C., (2008). Predicting work performance in nuclear power plants. Safety Science, 46, 1115-1124.
26. Jian J., Bisantz A. M., Drury C. G., (2000). Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4, 53-71.
27. Lee J. D., See K. A., (2004). Trust in technology: Designing for appropriate reliance. Human Factors, 46, 50-80.
28. Levine T. R., Hullett C. R., (2002). Eta squared, partial eta squared, and misreporting of effect size in communication research. Human Communication Research, 28, 612-625.
29. Lewis M., (2013). Human interaction with multiple remote robots. Reviews of Human Factors and Ergonomics, 9, 131-174.
30. Linegang M., Stoner H. A., Patterson M. J., Seppelt B. D., Hoffman J. D., Crittendon Z. B., Lee J. D., (2006). Human-automation collaboration in dynamic mission planning: A challenge requiring an ecological approach. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 2482-2486). Santa Monica, CA: Human Factors and Ergonomics Society.
31. Lyons J. B., Havig P. R., (2014). Transparency in a human-machine context: Approaches for fostering shared awareness/intent. In Shumaker R., Lackey S., (Eds.), Virtual, augmented and mixed reality: Designing and developing virtual and augmented environments (pp. 181-190). Berlin, Germany: Springer.
32. Miller C. A., Parasuraman R., (2007). Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors, 49, 57-75.
33. Neyedli H., Hollands J., Jamieson G., (2011). Beyond identity: Incorporating system reliability information into an automated combat identification system. Human Factors, 53, 338-355.
34. Oduor K. F., Wiebe E. N., (2008,). The effects of automated decision algorithm modality and transparency on reported trust and task performance. In Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting (pp. 302-306). Santa Monica, CA: Human Factors and Ergonomics Society.
35. Paas F. G., Van Merriënboer J. J., (1994). Instructional control of cognitive load in the training of complex cognitive tasks. Educational Psychology Review, 6, 351-371.
36. Parasuraman R., Riley V., (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230-253.
37. Parasuraman R., Sheridan T. B., Wickens C. D., (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 30, 286-297.
38. Poole A., Ball L. J., (2006). Eye tracking in HCI and usability research. Encyclopedia of Human-Computer Interaction, 1, 211-219.
39. Quayle J. D., Ball L. J., (2000). Working memory, metacognitive uncertainty, and belief bias in syllogistic reasoning. Quarterly Journal of Experimental Psychology: Section A, 53, 1202-1223.
40. Rayner K., (2009). Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology, 62, 1457-1506.
41. Riek L. D., (2012). Wizard of Oz studies in HRI: A systematic review and new reporting guidelines. Journal of Human-Robot Interaction, 1 (1).
42. Russell S. J., Norvig P., (2009). Artificial intelligence: A modern approach (3rd ed.) Upper Saddle River, NJ: Prentice Hall.
43. Sarter N. B., Woods D. D., (1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors, 37, 5-19.
44. Spriggs S., Boyer J., Bearden G., (2014). Fusion system overview. Lecture given at Wright Patterson Air Force Base, OH.
45. Wang L., Jamieson G. A., Hollands J. G., (2009). Trust and reliance on an automated combat identification system. Human Factors, 51, 281-291.
46. Wickens C. D., Dixon S. R., (2007). The benefits of imperfect diagnostic automation: A synthesis of the literature. Theoretical Issues in Ergonomics Science, 8, 201-212.
47. Zuk T., Carpendale S., (2007). Visualization of uncertainty and reasoning. In Butz A., Fisher B., Krüger A., Olivier P., Owada S., (Eds.), Smart graphics (pp. 164-177). Berlin, Germany: Springer.