Multimodal control of sensors on multiple simulated unmanned vehicles

Ergonomics

Volumn 54, Issue 9, 2011, Pages 792-805

  Baber, C ^a   Morin, C ^b   Parekh, M ^a   Cahillane, M ^b   Houghton, R J ^c  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b CRANFIELD UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Multimodal interaction; Speech recognition; Unmanned vehicles

Indexed keywords

LOAD INDEX; MULTI-MODAL; MULTI-MODAL INTERACTIONS; NUMBER OF VEHICLES; OBJECTIVE MEASURE; SIMULATED ENVIRONMENT; SPATIAL ABILITIES; SPATIAL ORIENTATIONS; SUBJECTIVE RATING;

NASA; SENSORS; SPEECH RECOGNITION;

UNMANNED VEHICLES;

ADULT; ARTICLE; AUTOMATIC SPEECH RECOGNITION; AUTOMATION; COMPUTER INTERFACE; COMPUTER SIMULATION; EQUIPMENT DESIGN; FEMALE; HUMAN; MALE; MOTOR VEHICLE; SAFETY; TASK PERFORMANCE; WORKLOAD;

ADULT; AUTOMATION; COMPUTER SIMULATION; EQUIPMENT DESIGN; FEMALE; HUMANS; MALE; MOTOR VEHICLES; SAFETY; SPEECH RECOGNITION SOFTWARE; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; WORKLOAD; YOUNG ADULT;

EID: 80053114571     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2011.597516     Document Type: Article

References (41)

1. Baber, C, 1997. Beyond the desktop: Designing and using interaction devices. San Diego, CA: Academic Press.
2. Baber, C. and Mellor, B., 2001. Using critical path analysis to model multi-modal human-computer interaction. International Journal of Human-Computer Studies, 54, 613-636.
3. Baddeley, A.D., 1998. The central executive: a concept and some misconceptions. Journal of the International Neuropsychological Society, 4, 523-526.
4. Baddeley, A.D., 2007. Working memory, thought and action. Oxford: Oxford University Press.
5. Biermann, A.W., Fineman, L., and Heidlage, J.F., 1992. A voice and touch driven natural language editor and its performance. International Journal of Man-Machine Studies, 37, 1-21.
6. Bolt, R.A., 1980. Put-that-there: voice and gesture at the graphics interface. Computer Graphics, 14, 262-270.
7. Bolt, R.A., 1984. The human interface: Where people and computers meet. Boston: Lifelong Learning Publications.
8. Byers, J.C., Bittner, A.C., and Hill, S.G., 1989. Traditional and raw Task Load Index (TLX) correlations: are paired comparisons necessary? In: A. Mital, ed. Advances in industrial ergonomics and safety 1. London: Taylor and Francis, 481-485.
9. Chen, J.Y.C., 2008. UAV-guided navigation for ground robot tele-operations in a military reconnaissance environment. Ergonomics, 53, 940-950.
10. Chen, J.Y.C., 2009. Concurrent performance of military and robotics tasks and effects of cueing in a simulated multi-tasking environment. Presence, 18, 1-15.
11. Chen, J.Y.C., Haas, E.C., and Barnes, M.J., 2007. Human performance issues and user interface design for teleoperated robots. IEEE Transactions on Systems, Man and Cybernetics-Part C: Applications and Reviews, 37, 1231-1245.
12. Cohen, P.R., et al., 1997. Quickset: multimodal interaction for distributed applications. 5th ACM conference on Multimedia. New York: ACM, 31-40.
13. Cohen, P.R., et al., 2002. Multimodal interaction for 2D and 3D environments. IEEE Computer Graphics and Applications, 19, 10-13.
14. Cummings, M.L., et al., 2007. Automation architectures for single operator, multiple UAV command and control. The International C2 Journal, 1, 1-24.
15. Dixon, S.R. and Wickens, C.D., 2003. Control of multiple-UAVs: a workload analysis. 12th international symposium on aviation psychology. Dayton, OH: Association for Aviation Psychology.
16. Donmez, B., Cummings, M.L., and Graham, H.D., 2009. Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles. Human Factors, 51, 718-729.
17. Draper, M., et al., 2003. Manual versus speech input for unmanned aerial vehicle control station operations. In: Proceedings of the 47th annual meeting of the Human Factors and Ergonomics Society, Santa Monica, CA: HFES, 109-113.
18. Finn, A. and Scheding, S., 2010. Developments and challenges for autonomous unmanned vehicles: a compendium. Berlin: Springer-Verlag.
19. Hart, S.G. and Staveland, L.E., 1988. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: P.A. Hancock and N. Meshkati, eds. Human mental workload. Amsterdam: Elsevier, 139-183.
20. Hauptmann, A.G. and McAvinney, P., 1993. Gestures with speech for graphic manipulation. International Journal of Man-Machine Studies, 38, 231-249.
21. Hegarty, M. and Waller, D., 2004. Dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32, 175-191.
22. Helleberg, J., Wickens, C.D., and Goh, J., 2003. Traffic and data link displays: auditory? Visual? Or redundant? A visual scanning analysis. 12th international symposium on aviation psychology. Dayton, OH: Association for Aviation Psychology.
23. Kahneman, D., 1973. Attention and effort. Englewood Cliffs, NJ: Prentice-Hall.
24. Kozhevnikov, M. and Hegarty, M., 2001. A dissociation between object manipulation spatial ability and spatial orientation ability. Memory and Cognition, 29, 745-756.
25. Liu, D., Wasson, R., and Vincenzi, D.A., 2009. Effects of system automation management strategies and multimission operator-to-vehicle ratio on operator performance in UAV systems. Journal of Intelligent Robotics Systems, 54, 795-810.
26. Luck, J.P., et al., 2006. An investigation of real world control of robotic assets under communication. In: Proceedings of 2006 ACM conference on human-robot interaction. New York: ACM Press, 202-209.
27. Martin, G.L., 1989. The utility of speech input for user computer interfaces. International Journal of Man-Machine Studies, 30, 355-375.
28. Maza, I., et al., 2009. Multimodal interface technologies for UAV ground control stations:a comparative analysis. Journal of Intelligent and Robotic Systems, 57, 371-391.
29. Moroney, W.F., et al., 1995. Some measurement and methodological considerations in the application of subjective workload measurement techniques. The International Journal of Aviation Psychology, 5, 87-106.
30. Nygren, T.E., 1991, Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Human Factors, 33, 17-33.
31. Oviatt, S., Deangelli, A., and Kuhn, K., 1997. Integration and synchronization of input modes during multimodal human-computer interaction. CHI'97. New York: ACM, 415-422.
32. Oviatt, S.L., et al., 2000. Designing the user interface for multimodal speech and gesture applications: state-of-the-artsystems and research directions. Human-Computer Interaction, 15, 263-322.
33. Schmandt, C., et al., 1990. Observations of using speech input for window management. In: D. Diaper, D. Gilmore, C. Cockton, and B. Shackel, eds. Interact'90. Amsterdam: IOS, 787-793.
34. Taylor, R.M., 2006. Human automation integration for supervisory control of UAVs. In: Virtual media for military applications, meeting proceedings Rto-Mp-Hfm-136, Paper 12. Neuilly-Sur-Seine, France: RTO.
35. Thorisson, K.R., Koons, D.R., and Bolt, R.A., 1992. Multimodal natural dialogue. CHI'92. New York: ACM, 653-654.
36. Trouvain, B. and Schlick, C.M., 2007. A comparative study of multimodal displays for multirobot supervisory control. In: D. Harris, ed. Engineering psychology and cognitive ergonomics. Berlin: Springer-Verlag, 184-193.
37. Wickens, C.D., Dixon, S., and Chang, D., 2003a. Using interference models to predict performance in a multiple-task UAV environment. Technical Report AHFD-03-9/Maad-03-1. Savoy, IL: Aviation Human Factors Division, Institute of Aviation, University of Illinois at Urbana-Champaign.
38. Wickens, C., Wickens, D., and Liu, Y., 1988. Codes and modalities in multiple resources: a success and a qualification. Human Factors, 30, 599-616.
39. Wickens, C.D. and McCarley, J., 2008. Applied attention theory. Boca-Raton, FL: Taylor and Francis.
40. Wickens, C.D., Sandry, D., and Vidulich, M., 1983. Compatibility and resource competition between modalities of input, output, and central processing. Human Factors, 25, 227-248.
41. Wickens, C.D., et al., 2003b. Attentional models of multi-task pilot performance using advanced display technology. Human Factors, 45, 360-380.