Human Factors in UAV

Sense and Avoid in UAS: Research and Applications

Volumn , Issue , 2012, Pages 119-142

  Cahillane, Marie ^a   Baber, Chris ^b   Morin, Caroline ^a  

^a CRANFIELD UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Attentional control and automation; Automation and multitasking; Control of multiple unmanned vehicles; Human factors in UAV; Multimodal interaction with unmanned vehicles; Sense of direction; Spatial ability; Task switching; Teleoperation of UAVs; Video games experience

Indexed keywords

EID: 84886227396     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781119964049.ch5     Document Type: Chapter

References (94)

1. Cooper, J.L. and Goodrich, M.A., "Towards combining UAV and sensor operator roles in UAVenabled visual search", in Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, pp. 351-358, 2008.
2. Finn, A. and Scheding, S., Developments and Challenges for Autonomous Unmanned Vehicles: A Compendium, Springer-Verlag, Berlin, 2010.
3. Schulte, A., Meitinger, C. and Onken, R., "Human factors in the guidance of uninhabited vehicles: oxymoron or tautology? The potential of cognitive and co-operative automation", Cognition, Technology and Work, 11, 71-86, 2009.
4. Zuboff, S., In the Age of the Smart Machine: The Future of Work and Power, Basic Books, New York, 1988.
5. Alexander, R.D., Herbert, N.J. and Kelly, T.P., "The role of the human in an autonomous system", 4th IET International Conference on System Safety incorporating the SaRS Annual Conference (CP555), London, October 26-28, 2009.
6. Johnson, C.W., "Military risk assessment in counter insurgency operations: a case study in the retrieval of a UAV Nr Sangin, Helmand Province, Afghanistan, 11th June", Third IET Systems Safety Conference, Birmingham, 2008.
7. Bainbridge, L., "Ironies of automation", in J. Rasmussen, K. Duncan and J. Leplat (eds), New Technology and Human Error, John Wiley&Sons, New York, 1987.
8. Ballard, J.C., "Computerized assessment of sustained attention: a review of factors affecting vigilance", Journal of Clinical and Experimental Psychology, 18, 843-863, 1996.
9. Defense Science Study Board, Unmanned Aerial Vehicles and Uninhabited Combat Aerial Vehicles, Office of the Under Secretary of Defense for Acquisition, Technology and Logistics, Washington, DC, 20301-3140, 2004.
10. Wickens, C.D., Engineering Psychology and Human Performance,Harper-Collins, NewYork, 1992.
11. Wiener, E.L. and Curry, E.R., "Flight deck automation: problems and promises", Ergonomics, 23, 995-1012, 1980.
12. Duggan, G.B., Banbury, S., Howes, A., Patrick, J. and Waldron, S.M., "Too much, too little or just right: designing data fusion for situation awareness", in Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, CA, HFES, 528-532, 2004.
13. Sheridan, T.B., "Forty-five years of man-machine systems: history and trends", in G. Mancini, G. Johannsen and L. Martensson (eds), Analysis, design and evaluation of man-machine systems. Proceedings of the 2nd IFAC/IFIP/FORS/ IEA Conference, Pergamon Press, Oxford, pp. 1-9, 1985.
14. Baber, C., Grandt, M. and Houghton, R.J., "Human factors of mini unmanned aerial systems in network-enabled capability", in P.D. Bust (ed.), Contemporary Ergonomics, Taylor and Francis, London, pp. 282-290, 2009.
15. Dekker, S. and Wright, P.C., "Function allocation: a question of task transformation not allocation", in ALLFN"97: Revisiting the Allocation of Functions Issue, IEA Press, pp. 215-225, 1997.
16. Andes, R.C., "Adaptive aiding automation for system control: challenges to realization", in Proceedings of the Topical Meeting on Advances in Human Factors Research on Man/Computer Interactions: Nuclear and Beyond, American Nuclear Society, LaGrange Park, IL, pp. 304-310, 1990.
17. Ruff, H.A., Narayanan, S. and Draper, M.H., "Human interaction with levels of automation and decision-aid fidelity in the supervisory control of multiple simulated unmanned air vehicles", Presence, 11, 335-351, 2002.
18. Ruff, H.A., Calhoun, G.L., Draper, M.H., Fontejon, J.V. and Guilfoos, B.J., "Exploring automation issues in supervisory control of multiple UAVs", paper presented at 2nd Human Performance, Situation Awareness, and Automation Conference (HPSAA II), Daytona Beach, FL, 2004.
19. Cummings, M.L. and Guerlain, S., "Developing operator capacity estimates for supervisory control of autonomous vehicles", Human Factors, 49, 1-15, 2007.
20. Miller, C., "Modeling human workload limitations on multiple UAV control", Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, New Orleans, LA, pp. 526-527, September 20-24, 2004.
21. Galster, S.M., Knott, B.A. and Brown, R.D., "Managing multiple UAVs: are we asking the right questions?", Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA, pp. 545-549, October 16-20, 2006.
22. Taylor, R.M., "Human automation integration for supervisory control of UAVs", Virtual Media for Military Applications, Meeting Proceedings Rto-Mp-Hfm-136, Paper 12, Neuilly-Sur-Seine, France, 2006.
23. Cummings, M.L., Bruni, S., Mercier, S. and Mitchell, P.F., "Automation architectures for single operator, multiple UAV command and control", The International C2 Journal, 1, 1-24, 2007.
24. Liu, D., Wasson, R. and Vincenzi, D.A., "Effects of system automation management strategies and multi-mission operator-to-vehicle ratio on operator performance in UAV systems", Journal of Intelligent Robotics Systems, 54, 795-810, 2009.
25. Mitchell, D.K. and Chen, J.Y.C., "Impacting system design with human performance modelling and experiment: another success story", Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA, pp. 2477-2481, 2006.
26. Pashler, H., "Attentional limitations in doing two tasks at the same time", Current Directions in Psychological Science, 1, 44-48, 1992.
27. Pashler, H., Carrier, M. and Hoffman, J., 1993, "Saccadic eye-movements and dual-task interference", Quarterly Journal of Experimental Psychology, 46A, 51-82, 1993.
28. Monsell, S., "Task switching", Trends in Cognitive Sciences, 7, 134-140, 2003.
29. Rubinstein, J.S., Meyer, D.E. and Evans, J.E., "Executive control of cognitive processes in task switching", Journal of Experimental Psychology: Human Perception and Performance, 27, 763-797, 2001.
30. Schumacher, E.H., Seymour, T.L., Glass, J.M., Fencsik, D.E., Lauber, E.J., Kieras, D.E. and Meyer, D.E., "Virtually perfect time sharing in dual-task performance: uncorking the central cognitive bottleneck", Psychological Science, 12, 101-108, 2001.
31. Squire, P., Trafton, G. and Parasuraman, R., "Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times", Proceedings of ACM Conference on Human-Robot Interaction, Salt Lake City, UT, pp. 26-32, March 2-4, 2006.
32. Chadwick, R.A., "Operating multiple semi-autonomous robots: monitoring, responding, detecting", Proceedings of The Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA, pp. 329-333, 2006.
33. Cummings, M.L., "The need for command and control instant message adaptive interfaces: lessons learned from tactical Tomahawk human-in-the-loop simulations", CyberPsychology and Behavior, 7, 653-661, 2004.
34. Dorneich, M.C., Ververs, P.M., Whitlow, S.D., Mathan, S., Carciofini, J. and Reusser, T., "Neurophysiologically-driven adaptive automation to improve decision making under stress", Proceedings of the Human Factors and Ergonomics Society, 50th Annual Meeting, San Francisco, CA, pp. 410-414, October 16-20, 2006.
35. Parasuraman, R., Cosenzo, K.A. and De Visser, E., "Adaptive automation for human supervision of multiple uninhabited vehicles: effects on change detection, situation awareness, and mental workload", Military Psychology, 21, 270-297, 2009.
36. Chen, J.Y.C., Barnes, M.J. and Harper-Sciarini, M., Supervisory Control of Unmanned Vehicles, Technical Report ARL-TR-5136, US Army Research Laboratory, Aberdeen Proving Ground, MD, 2010.
37. Cummings, M.L., Brzezinski, A.S. and Lee, J.D., "The impact of intelligent aiding for multiple unmanned aerial vehicle schedule management", IEEE Intelligent Systems, 22, 52-59, 2007.
38. Dixon, S.R. andWickens, C.D., "Control of multiple-UAVs: aworkload analysis", 12th International Symposium on Aviation Psychology, Dayton, OH, 2003.
39. Maza, I., Caballero, F., Molina, R., Pena, N. and Ollero, A., "Multimodal interface technologies for UAV ground control stations: a comparative analysis", Journal of Intelligent and Robotic Systems, 57, 371-391, 2009.
40. Trouvain, B. and Schlick, C.M., "A comparative study of multimodal displays for multirobot supervisory control", in D. Harris (ed.), Engineering Psychology and Cognitive Ergonomics, Springer-Verlag, Berlin, pp. 184-193, 2007.
41. Wickens, C.D., Dixon, S. and Chang, D., "Using interference models to predict performance in a multiple-task UAV environment", Technical Report AHFD-03-9/Maad-03-1, 2003.
42. Helleberg, J., Wickens, C.D. and Goh, J., "Traffic and data link displays: Auditory? Visual? Or Redundant? A visual scanning analysis", 12th International Symposium on Aviation Psychology, Dayton, OH, 2003.
43. Donmez, B., Cummings, M.L. and Graham, H.D., "Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles", Human Factors, 51, 718-729, 2009.
44. Chen, J.Y.C., Drexler, J.M., Sciarini, L.W., Cosenzo, K.A., Barnes, M.J. and Nicholson, D., "Operatorworkload and heart-rate variability during a simulated reconnaissance mission with an unmanned ground vehicle", Proceedings of the 2008 Army Science Conference, 2008.
45. Luck, J.P., McDermott, P.L., Allender, L. and Russell, D.C., "An investigation of real world control of robotic assets under communication", Proceedings of 2006 ACM Conference on Human-Robot Interaction, pp. 202-209, 2006.
46. Chen, J.Y.C., "Concurrent performance of military and robotics tasks and effects of cueing in a simulated multi-tasking environment", Presence, 18, 1-15, 2009.
47. Draper, M., Calhoun, G., Ruff, H., Williamson, D. and Barry, T., "Manual versus speech input for unmanned aerial vehicle control station operations", Proceedings of the 47th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, CA, pp. 109-113, 2003.
48. Chen, J.Y.C., Durlach, J.P., Sloan, J.A. and Bowens, L.D., "Human robot interaction in the context of simulated route reconnaissance missions", Military Psychology, 20, 135-149, 2008.
49. Baber, C., Morin, C., Parekh, M., Cahillane, M. and Houghton, R.J., "Multimodal human-computer interaction in the control of payload on multiple simulated unmanned vehicles", Ergonomics, 54, 792-805, 2011.
50. Parasuraman, R., Barnes, M. and Cosenzo, K., "Decision support for network-centric command and control", The International C2 Journal, 1, 43-68, 2007.
51. Crocoll, W.M. and Coury, B.G., "Status or recommendation: selecting the type of information for decision adding", Proceedings of the Human Factors Society, 34th Annual Meeting, Santa Monica, CA, pp. 1524-1528, 1990.
52. Rovira, E., McGarry, K. and Parasuraman, R., "Effects of imperfect automation on decision making in a simulated command and control task", Human Factors, 49, 76-87, 2007.
53. Parasuraman, R. and Riley, V.A., "Humans and automation: use, misuse, disuse, abuse", Human Factors, 39, 230-253, 1997.
54. Parasuraman, R., "Designing automation for human use: empirical studies and quantitative models", Ergonomics, 43, 931-951, 2000.
55. Scerbo, M., "Adaptive automation", in W. Karwowski (ed.), International Encyclopedia of Ergonomics and Human Factors, Taylor and Francis, London, pp. 1077-1079, 2001.
56. Parasuraman, R. and Miller, C., "Delegation interfaces for human supervision of multiple unmanned vehicles: theory, experiments, and practical applications", in N. Cooke, H.L. Pringle, H.K. Pedersen and O. Conner (eds), Human Factors of Remotely Operated Vehicles, Advances in Human Performance and Cognitive Engineering, Vol. 7, Elsevier, Oxford, pp. 251-266, 2006.
57. Barnes, M., Parasuraman, R. and Cosenzo, K., "Adaptive automation for military robotic systems", in RTO-TR-HFM-078 Uninhabited Military Vehicles: Human factors issues in augmenting the force, NATO Technical Report, NATO Research and Technology Organization, Brussels, pp. 420-440, 2006.
58. Parasuraman, R., Galster, S., Squire, P., Furukawa, H. and Miller, C.A., "A flexible delegation interface enhances system performance in human supervision of multiple autonomous robots: empirical studies with RoboFlag", IEEE Transactions on Systems, Man&Cybernetics - Part A: Systems and Humans, 35, 481-493, 2005.
59. Wilson, G. and Russell, C.A., "Performance enhancement in a UAV task using psychophysiologically determined adaptive aiding", Human Factors, 49, 1005-1018, 2007.
60. Miller, C. and Parasuraman, R., "Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control", Human Factors, 49, 57-75, 2007.
61. Mitchell, D.K., "Soldier workload analysis of the Mounted Combat System (MCS) platoon"s use of unmanned assets", Technical Report ARL-TR-3476, US Army Research Laboratory, Aberdeen Proving Ground, MD, 2005.
62. Kaber, D.B., Endsley, M.R. and Onal, E., "Design of automation for telerobots and the effect on performance, operator situation awareness and subjective workload", Human Factors and Ergonomics in Manufacturing, 10, 409-430, 2000.
63. Parasuraman, R., Sheridan, T.B. and Wickens, C.D., "A model for types and levels of human interaction with automation", IEEE Transactions on Systems, Man&Cybernetics - Part A: Systems and Humans, 30, 286-297, 2000.
64. Sheridan, T. and Parasuraman, R., "Human-automation interaction", Reviews of Human Factors and Ergonomics, 1, 89-129, 2006.
65. Chen, J.Y.C. and Terrence, P.I., "Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment", Ergonomics, 51, 1137-1152, 2008.
66. Chen, J.Y.C. and Joyner, C.T., "Concurrent performance of gunner"s and robotic operator"s tasks in a multitasking environment", Military Psychology, 21, 98-113, 2009.
67. Wickens, C.D., Dixon, S.R., Goh, J. and Hammer, B., "Pilot dependence on imperfect diagnostic automation in simulated UAV flights: an attentional visual scanning analysis", Technical Report AHFD-05-02/MAAD-05-02, University of Illinois, Urbana-Champaign, IL, 2005.
68. Levinthal, B.R. and Wickens, C.D., "Management of multiple UAVs with imperfect automation", Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA, pp 1941-1944, 2006.
69. Dixon, S.R., Wickens, C.D. and McCarley, J., "On the independence of compliance and reliance: are automation false alarms worse than misses?", Human Factors, 49, 564-572, 2007.
70. Derryberry, D. and Reed, M., "Anxiety-related attentional biases and their regulation by attentional control", Journal of Abnormal Psychology, 111, 225-236, 2002.
71. Chen, J.Y.C. and Terrence, P.I., "Effects of imperfect automation and individual differences on concurrent performance of military and robotics tasks in a simulated multitasking environment", Ergonomics, 52, 907-920, 2009.
72. Ekstrom, R.B., French, J.W., Harman, H. and Dermen, D., "Kit of factor-referenced cognitive tests", Educational Testing Service, Princeton, NJ, 1976.
73. Pak, R., Rogers,W.A. and Fisk, A.D., "Spatial ability subfactors and their influences on a computerbased information search task", Human Factors, 48, 154-165, 2006.
74. Kozhevnikov, M. and Hegarty, M., "A dissociation between object-manipulation and perspectivetaking spatial abilities", Memory&Cognition, 29, 745-756, 2001.
75. Pellegrino, J.W., Alderton, D.L. and Shute, V.J., "Understanding spatial ability", Educational Psychologist, 19, 239-253, 1984.
76. Alderton, D.L., Wolfe, J.H. and Larson, G.E., "The ECAT battery", Military Psychology, 9, 5-37, 1997.
77. Stanney, K.M. and Salvendy, G., "Information visualization: assisting low spatial individuals with information access tasks through the use of visual mediators", Ergonomics, 38, 1184-1198, 1995.
78. Chen, C., Czerwinski, M. and Macredie, R., "Individual differences in virtual environments - introduction and overview", Journal of American Society for Information Science, 51, 499-507, 2000.
79. Eyal, R. and Tendick, F., "Spatial ability and learning the use of an angled laparoscope in a virtual environment", in Proceedings of Medicine Meets Virtual Reality (MMVR), IOS Press, pp. 146-153, 2001.
80. Menchaca-Brandan, M.A., Liu, A.M., Oman, C.M. and Natapoff, A., "Influence of perspectivetaking and mental rotation abilities in space teleoperation", Proceedings of the 2007 ACM Conference on Human-Robot Interaction, Washington, DC, pp. 271-278, March 8-11, 2007.
81. Lathan, C.E. and Tracey, M., "The effects of operator spatial perception and sensory feedback on human-robot teleoperation performance", Presence, 11, 368-377, 2002.
82. Educational Testing Service, Cube Comparison Test, 2005.
83. Gugerty, L. and Brooks, J., "Reference-frame misalignment and cardinal direction judgments: group differences and strategies", Journal of Experimental Psychology: Applied, 10, 75-88, 2004.
84. Hegarty, M. and Waller, D., "A dissociation between mental rotation and perspective-taking spatial abilities", Intelligence, 32, 175-191, 2004.
85. Chen, J.Y.C., "UAV-guided navigation for ground robot teleoperation in a military reconnaissance environment", Ergonomics, 53, 940-950, 2010.
86. Neumann, J., "Effect of operator control configuration on unmanned aerial system trainability", Doctoral dissertation, University of Central Florida, 2006.
87. Hegarty, M., Richardson, A.E., Montello, D.R., Lovelace, K. and Subbiah, I., "Development of a self-report measure of environmental spatial ability", Intelligence, 30, 425-447, 2002.
88. Kozlowski, L.T. and Bryant, K.J., "Sense of direction, spatial orientation, and cognitive maps", Journal of Experimental Psychology: Human Perception and Performance, 3, 590-598, 1977.
89. Baldwin, C.L. and Reagan, I., "Individual differences in route-learning strategy and associated working memory resources", Human Factors, 51, 368-377, 2009.
90. Takeuchi, Y., "Sense of direction and its relationship with geographical orientation, personality traits and mental ability", Japanese Journal of Educational Psychology, 40, 47-53, 1992.
91. Kato, Y. and Takeuchi, Y., "Individual differences in wayfinding strategies", Journal of Environmental Psychology, 23, 171-188, 2003.
92. Cooper, L.A. and Shepard, R.N., "Chronometric studies of the rotation of mental images", in W.G. Chase (ed.), Visual Information Processing, Academic Press, New York, pp. 75-176, 1973.
93. De Lisi, R. and Cammarano, D.M., "Computer experience and gender differences in undergraduate mental rotation performance", Computers in Human Behavior, 12, 351-361, 1996.
94. Chen, J.Y.C., Haas, E.C. and Barnes, M.J., "Human performance issues and user interface design for teleoperated robots", IEEE Transactions on Systems, Man&Cybernetics - Part C: Applications and Reviews, 37, 1231-1245, 2007.