Supervisory control of multiple robots in dynamic tasking environments

Ergonomics

Volumn 55, Issue 9, 2012, Pages 1043-1058

  Chen, Jessie Y C ^a   Barnes, Michael J ^a  

^a U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

human robot interaction; individual differences; intelligent agent; level of autonomy; military; supervisory control

Indexed keywords

DETECTION TASKS; INDIVIDUAL DIFFERENCES; LEVEL OF AUTONOMY; MILITARY; MOVING TARGETS; MULTIPLE ROBOT; PRIMARY TASK; RE-TASKING; SECONDARY TARGET; SITUATION AWARENESS; SPATIAL ABILITIES; SUPERVISORY CONTROL; WORKLOAD ASSESSMENT;

HUMAN COMPUTER INTERACTION; INTELLIGENT AGENTS; INTELLIGENT ROBOTS; ROBOTICS; VISUALIZATION;

ROBOT PROGRAMMING;

ADULT; ARTICLE; COMPUTER INTERFACE; ENVIRONMENT; EVALUATION; EXECUTIVE FUNCTION; FEMALE; HUMAN; MALE; MAN MACHINE INTERACTION; PERSONAL AUTONOMY; PHYSIOLOGY; QUESTIONNAIRE; ROBOTICS; TASK PERFORMANCE; WORKLOAD;

ENVIRONMENT; EXECUTIVE FUNCTION; FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; PERSONAL AUTONOMY; QUESTIONNAIRES; ROBOTICS; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; WORKLOAD; YOUNG ADULT;

EID: 84865070448     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2012.689013     Document Type: Article

References (64)

1. Baber, C. 2011. Multimodal control of sensors on multiple simulated unmanned vehicles. Ergonomics, 54: 792-805.
2. Baldwin, C. L. and Reagan, I. 2009. Individual differences in route-learning strategy and associated working memory resources. Human Factors, 51: 368-377.
3. Barber, D. The Mixed Initiative Experimental (MIX) testbed for human robot interactions with varied levels of automation. Proceedings of the 26th Army Science Conference. 1-4 December 2008 Orlando, FL. Available from: http://www.dtic.mil/cgi-bin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA505701 [Accessed 24 March 2011]
4. Barnes, M. J. and Evans, A. W. III. 2010. "Soldier-robot teams in future battlefields: an overview". In Human-robot interactions in future military operations, Edited by: Barnes, M. J. and Jentsch, F. 9-29. Farnham Surrey, UK: Ashgate.
5. Bleckley, M. K. 2003. Individual differences in working memory capacity predict visual attention allocation. Psychonomic Bulletin & Review, 10: 884-889.
6. Cassenti, D. N. The effects of communication style on robot navigation performance. Proceedings of Human Factors and Ergonomics Society 53rd Annual Meeting. October19-232009, San Antonio, TX. pp.359-363. TX. Santa Monica, CA: HFES.
7. Chappelle, W. L. Psychological profile of USAF unmanned aerial systems Predator & Reaper pilots. Proceedings of the aerospace medical association 81st annual scientific meeting. May9-132010, Phoenix, AZ. pp.339AZ. Alexandria, VA: Aerospace Medical Association.
8. Chappelle, W. L. Critical psychological attributes of U.S. Air Force (USAF) Predator & Reaper sensor operators according to subject matter experts. Proceedings of the aerospace medical association 81st annual scientific meeting. May9-132010, Phoenix, AZ. pp.253AZ. Alexandria, VA: Aerospace Medical Association.
9. Chen, C., Czerwinski, M. and Macredie, R. 2000. Individual differences in virtual environments-Introduction and overview. Journal of the American Society for Information Science, 51: 499-507.
10. Chen, J. Y.C. 2010. UAV-guided navigation for ground robot teleoperation in a military reconnaissance environment. Ergonomics, 53: 940-950.
11. Chen, J. Y.C. and Barnes, M. J. 2012. Supervisory control of multiple robots: effects of imperfect automation and individual differences. Human Factors, 54: 157-174.
12. Chen, J. Y.C., Barnes, M. J. and Harper-Sciarini, M. 2011a. Supervisory control of multiple robots: human performance issues and user interface design. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 41: 435-454.
13. Chen, J. Y.C., Barnes, M. J. and Qu, Z. 2011b. RoboLeader: dynamic re-tasking for persistence surveillance in an urban environment using robot-to-robot control (ARL Memorandum Report ARL-MR-0761) [online]. Aberdeen Proving Ground, MD: U.S.Army Research Laboratory. Available from: http://www.dtic.mil/cgi-bin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA534897 [Accessed 24 March 2011]
14. Chen, J. Y.C. 2008. Human robot interaction in the context of simulated route reconnaissance missions. Military Psychology, 20: 135-149.
15. Chen, J. Y.C., Haas, E. C. and Barnes, M. J. 2007. Human performance issues and user interface design for teleoperated robots. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 37: 1231-1245.
16. Chen, J. Y.C. and Joyner, C. T. 2009. Concurrent performance of gunner's and robotic operator's tasks in a multitasking environment. Military Psychology, 21: 98-113.
17. Chen, J. Y.C. and Terrence, P. I. 2008. Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment. Ergonomics, 51: 1137-1152.
18. Chen, J. Y.C. and Terrence, P. I. 2009. Effects of imperfect automation on concurrent performance of military and robotics tasks in a simulated multi-tasking environment. Ergonomics, 52: 907-920.
19. Cosenzo, K. A., Parasuraman, R. and De Visser, E. 2010. "Automation strategies for facilitating human interaction with military unmanned vehicles". In Human-robot interactions in future military operations, Edited by: Barnes, M. J. and Jentsch, F. 103-123. Farnham, Surrey, UK: Ashgate.
20. Cummings, M. L., Bruni, S. and Mitchell, P. J. 2010. Human supervisory control challenges in network-centric operations. Reviews of Human Factors and Ergonomics, 6: 34-78.
21. Derryberry, D. and Reed, M. 2002. Anxiety-related attentional biases and their regulation by attentional control. Journal of Abnormal Psychology, 111: 225-236.
22. Dzindolet, M. 2001. Predicting misuse and disuse of combat identification systems. Military Psychology, 13: 147-164.
23. Dux, P. E. 2009. Training improves multitasking performance by increasing the speed of information processing in human prefrontal cortex. Neuron, 63: 127-138.
24. Endsley, M. and Kiris, E. 1995. The out-of-the-loop performance problem and level of control in automation. Human Factors, 37: 381-394.
25. Ekstrom, R. B., French, J. W. and Harman, H. H. 1976. Kit of factor referenced cognitive tests, Princeton, NJ: Educational Testing Service.
26. Feldman Barrett, L., Tugade, M. M. and Engle, R. W. 2004. Individual differences in working memory capacity and dual-process theories of the mind. Psychological Bulletin, 130: 553-573.
27. Fern, L. and Shively, R. J. A comparison of varying levels of automation on the supervisory control of multiple UASs. Proceedings of AUVSI's Unmanned Systems North America. August10-132009. Washington, DC. Arlington, VA: Association for Unmanned Vehicle Systems International.
28. Goodrich, M. A. 2010. "On maximizing fan-out: Towards controlling multiple unmanned vehicles". In Human-robot Interactions in future military operations, Edited by: Barnes, M. J. and Jentsch, F. 375-395. Farnham, Surrey, UK: Ashgate.
29. Green, C. S. and Bavelier, D. 2006. Enumeration versus multiple object tracking: The case of action video game players. Cognition, 101: 217-245.
30. Greenemeier, L. 2010. Robot pack mule to carry loads for G.I.s on the move. Scientific American [online] Available from: http://www.scientificamerican.com/article.cfm?id=boston-dynamics-ls3 [Accessed 24 March 2011]
31. Gugerty, L. and Brooks, J. 2004. Reference-frame misalignment and cardinal direction judgments: group differences and strategies. Journal of Experimental Psychology: Applied, 10: 75-88.
32. Hart, S. and Staveland, L. 1988. "Development of NASA TLX (Task Load Index): results of empirical and theoretical research". In Human mental workload, Edited by: Hancock, P. and Meshkati, N. 139-183. Amsterdam: Elsevier.
33. Hubert-Walllander, B., Green, C. S. and Bavelier, D. 2010. Stretching the limits of visual attention: the case of action video games. WIREs Cognitive Science, 2 (DOI: 10.1002/wcs.116) [online]. Available from: http://www.bcs.rochester.edu/people/daphne/VisionPDF/hubertwallander.pdf [Accessed 24 March 2011]
34. Jian, J., Bisantz, A. and Drury, C. 2000. Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4: 53-71.
35. Kahneman, D., Ben-Ishai, R. and Lotan, M. 1973. Relation of a test of attention to road accidents. Journal of Applied Psychology, 58: 113-115.
36. Lathan, C. E. and Tracey, M. 2002. The effects of operator spatial perception and sensory feedback on human-robot teleoperation performance. Presence: Teleoperators and Virtual Environments, 11: 368-377.
37. Lewis, M. 2010. Choosing autonomy modes for multirobot search. Human Factors, 52: 225-233.
38. th Human Factors & Ergonomics Society Annual Meeting. October16-202006, San Francisco, CA. pp.2482-2486. Santa Monica, CA: HFES.
39. McKinley, A., Mcintire, L. and Funke, M. Operator selection for unmanned aerial vehicles: a comparison of video game players and manned aircraft pilots. Proceedings of the Aerospace Medical Association 81st Annual Scientific Meeting. May9-132010, Phoenix, AZ. pp.336AZ. Alexandria, VA: Aerospace Medical Asso.
40. Miller, G. 1956. The magical number 7 plus or minus two: some limits on our capacity for processing information. Psychological Review, 63: 81-97.
41. Miller, C. and Parasuraman, R. 2007. Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Human Factors, 49: 57-75.
42. Noyes, J. M. and Bruneau, D. P. 2007. A self-analysis of the NASA-TLX workload measure. Ergonomics, 50: 514-519.
43. Osborn, K. 2011. Army building smarter robots. Army AL&T Magazine, [online web-exclusive article]. Available from: http://www.usaasc.info/alt_online/article.cfm?iID=1101&aid=07
44. Parasuraman, R., Barnes, M. J. and Cosenzo, K. A. 2007. Adaptive automation for human-robot teaming in future command and control systems. The International C2 Journal, 1: 43-68.
45. Parasuraman, R. and Manzey, D. H. 2010. Complacency and bias in human use of automation: an attentional integration. Human Factors, 52: 381-410.
46. Parasuraman, R. and Riley, V. 1997. Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39: 230-253.
47. Parasuraman, R., Sheridan, T.B. and Wickens, C. D. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 30: 286-297.
48. Porat, T. "Castling Rays" a decision support tool for UAV-switching tasks. Proceedings of the 28th of the International Conference on Human Factors in Computing Systems (CHI'10). April10-15, Atlanta, GA. New York: ACM,. pp.3589-3594.
49. Purdy, E. M. 2008. The increasing role of robots in national security. Defense AT&L, 5 (May-June 2008, 26-29 [online]. Available from: http://www.dau.mil/pubscats/PubsCats/atl/new/may-june08.pdf [Accessed 24 March 2011]
50. Robertson, G. 2009. Selected human factors issues in information visualization. Reviews of Human Factors and Ergonomics, 5: 41-81.
51. Rubinstein, J., Meyer, D. and Evans, J. 2001. Executive control of cognitive processes in task switching. Journal of Experimental Psychology: Human Perception and Performance, 27: 763-797.
52. Schumacher, E. 2001. Virtually perfect time sharing in dual-task performance: uncorking the central cognitive bottleneck. Psychological Science, 12: 101-108.
53. Schurr, N. 2007. Toward human-multiagent teams, Unpublished Dissertation, University of Southern California.
54. Singer, P. W. 2010. War of the machines. Scientific American, 303: 56-63.
55. Spain, R. D. and Bliss, J. P. The effect of sonification display pulse rate and reliability on operator trust and perceived workload during a simulated patient monitoring task. Ergonomics, 51, 1320-1337. Proceedings of the Human Factors and Ergonomics Society 52th Meeting. September22-262008, New York City. pp.1335-1339. Santa Monica, CA: HFES.
56. Spain, R.D., Bustamante, E.A. and Bliss, J. P. 2008. Towards an empirically developed scale for system trust:, Take two.
57. Squire, P. N. and Parasuraman, R. 2010. Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment. Ergonomics, 53: 951-961.
58. Stanney, K. M. and Salvendy, G. 1995. Information visualization: assisting low spatial individuals with information access tasks through the use of visual mediators. Ergonomics, 38: 1184-1198.
59. rd ACM/IEEE International Conference on Human-Robot Interaction. March12-152008. pp.375-382. Amsterdam, the Netherlands New York: ACM Press.
60. Thomas, L. and Wickens, C. D. Eye-tracking and individual differences in off-normal event detection when flying with a synthetic vision system display. Proceedings of the Human Factors and Ergonomics Society 48th Meeting. September20-242004, New Orleans, LA. pp.223-227. Santa Monica, CA: HFES.
61. Triplett, J. 2008. The effects of commercial video game playing: a comparison of skills and abilities for the Predator UAV [online] Unpublished thesis. US Air Force: Air University. Available from: http://www.dtic.mil/cgi-bin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA483256 [Accessed 24 March 2011]
62. Wang, H. How search and its subtasks scale in N robots. Proceedings of the 4th ACM/IEEE International Conference on Human-Robot Interaction. March11-132009, La Jolla, CA. pp.141-147. New York: ACM Press.
63. Wang, H. Human teams for large scale multirobot control. Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics. October11-14, San Antonio, TX. pp.1306-1311. TX. Piscataway, NJ: IEEE Press.
64. Young, M. S. and Stanton, N. A. 2007. What's skill got to do with it? Vehicle automation and driver mental workload. Ergonomics, 50: 1324-1339.