Multimodal research for human robot interactions

Human-Robot Interactions in Future Military Operations

Volumn , Issue , 2010, Pages 271-292

  Haas, Ellen C ^a   van Erp, Jan B F ^b  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b TNO   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953774406     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (75)

1. Abbott, J.J., Marayong, P., & Okamura, A.M. (2005). Haptic virtual fixtures for robot-assisted manipulation. Proceedings of the 12th International Symposium of Robotics Research. Retrieved from http://www.haptics.me.jhu.edu/publications/isrr05-abbott.pdf.
2. Albery, W.B. (2007). Multisensory cueing for enhancing orientation information during flight. Aviation Space Environmental Medicine, May, 78 (5 Suppl) B 186-90.
3. Aretz, D., Andre, T., Self, B., & Brenaman, C. (2006). Effect of tactile feedback on unmanned aerial vehicle landings. Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL.
4. Baier, H., Buss, M., Freyberger, F., & Schmidt, G. (2000). Benefits of combined active stereo vision and haptic telepresence. Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Munich, Germany, 702-7.
5. Bakker, N.H., Werkhoven, P.J. & Passenier, P.O. (1999). The effects of proprioceptive and visual feedback on geographical orientation in virtual environments. Presence, 8(1), 36-53.
6. Barnes, D. & Counsell, M. (2003). Haptic communication for mobile robot operations. Industrial Robot: An International Journal, 30(6), 552-63.
7. Begault, D.R., Wenzel, E.M., & Anderson, M.R., (2001). Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual sound source. Journal of the Audio Engineering Society, 49, 904-15.
8. Benson, A.J. (2003). Technical evaluation report. Spatial disorientation in military vehicles: Causes, consequences and cures. RTO Meeting Proceedings 86 (pp. T1-T7). Neuilly-sur-Seine, France: NATO Research and Technology Organization.
9. Braithwaite, M.G., Durnford, S.J., Crowley, J.S., Rosado, N.R., & Albano, J.P. (1998). Spatial disorientation in US Army rotary-wing operations. Aviation Space and Environmental Medicine, 69(11), 1031-7.
10. Brown, L.M., Brewster, S.A., & Purchase, H.C. (2006). Multidimensional tactons for non-visual information presentation in mobile devices. MobileHCI, 231-8.
11. Calhoun, G., Fontejon, J., Draper, M., Ruff, H., & Guilfoos, B. (2004). Tactile versus aural redundant alert cues for UAV control applications. Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, 137-41.
12. Carlander, O. & Eriksson, L. (2006). Uni- and bi-modal threat cueing with vibrotactile and 3D audio technologies in a combat vehicle. Proceedings of the HFES 50th Annual Meeting, 1552-6.
13. Cholewiak, R.W. & Collins, A.A. (2000). The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode, Perception and Psychophysics, 62, 1220-35.
14. Chong, N.Y., Kotoku, T., Ohba, K., Sasaki, H., Komoriya, K., & Tanie, K. (2002). Multioperator teleoperation of multirobot systems with time delay. II-Testbed description. Presence: Teleoperators and Virtual Environments, 11(3), 292-303.
15. Chou W. & Wang, T. The design of multimodal human-machine interface for teleoperation. Proceedings of the 2001 IEEE International Conference on Systems, Man, and Cybernetics, 5, 3187-92.
16. Collins, H.L. & Harrison, G. (1995). Spatial disorientation episodes among F-15- C pilots during Operation Desert Storm. Journal of Vestibular Research, 5(6), 405-10.
17. De Vries, S.C. (2001). Head-slaved control versus joystick control of a remote camera. TNO-Report TM-01-B008, Soesterberg, the Netherlands: TNO Human Factors Research.
18. De Vries, S.C. & Jansen, C. (2002). Situational awareness of UAV operators onboard moving platforms. In: S. Chatty, J. Hansman, & G. Boy (eds), Proceedings of the International Conference on Human-Computer Interaction in Aeronautics, HCI-Aero 2002. Cambridge, MA, 23-25 October, pp. 144-7.
19. Dobbins, T. & Samway, S. (2002). The use of tactile navigation cues in high-speed craft operations. Proceedings of the RINA Conference on High Speed Craft: Technology and Operation. London: Royal Institution of Naval Architects, pp. 13-20.
20. Draper, M.H., Viire, E.S., Furness, T.A., & Gawron, V.J. (2001). Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human Factors, 43(1), 129-46.
21. Duistermaat, M., Elliott, L.R., van Erp, J.B.F., & Redden, E.S. (2007). Tactile land navigation for dismounted soldiers. In D. de Waard, G.R.J. Hockey, P.Nickel, and K.A. Brookhuis (eds), Human Factors Issues in Complex System Performance, Maastricht, the Netherlands: Shaker Publishing, pp. 43-53.
22. Encarta World English Dictionary [North American Edition] (2007). Redmond, WA: Microsoft Corporation.
23. Fitch, G.M., Kiefer, R. J., Hankey, J.M. & Kleiner, B.M. (2007). Toward developing an approach for alerting drivers to the direction of a crash threat. Human Factors, 49(4) 710-20.
24. Gemperle, F., Ota, N., & Siewiorek, D. (2001). Design of a wearable tactile display. Proceedings of the 5th IEEE International Symposium on Wearable Computers, 5-12.
25. Griffin, M.J. & Lewis, C.H. (1978). A review of the effects of vibration on visual acuity and continuous manual control, part I: Visual acuity. Journal of Sound and Vibration, 56, 383-413.
26. Gunn, D.V., Warm, J.S., Nelson, W.T., Bolia, R.S., Schumsky, D.A., & Corcoran, K.J. (2005). Target acquisition with UAVs: Vigilance displays and advanced cuing interfaces. Human Factors, 47, 488-97.
27. Haas, E.C. & Edworthy, J. (2006), An introduction to auditory warnings and alarms. In M.S. Wogalter (ed.), Handbook of Warnings. London: Lawrence Erlbaum Associates, pp. 189-220.
28. Haas, E.C., Pillalamarri, R.S., Stachowiak, C.C., and Lattin, M.A. (2005). Auditory cues to assist visual search in robotic system operator control unit displays. ARL-TR-3632. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
29. Haas, E.C. & Stachowiak, C. (2007). Multimodal displays to enhance humanrobot interaction on the move. Proceedings of the Performance Metrics for Intelligent Systems Workshop. Gaithersburg, MD: National Institute of Standards and Technology.
30. Haas, E.C., Stachowiak, C., White, T., Feng, T., & Pillalamarri, K. (2008). Enhancing human-robot interaction with multimodal cues while on the move. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
31. Hoggan, E. & Brewster, S. (2006). Crossmodal spatial location: Initial experiments. NordiCHI 2660: Changing Roles, 469-72.
32. Ishitake, T., Ando, H., Miyazaki, Y., & Matoba, F. (1998). Changes of visual performance induced by exposure to whole-body vibration. Kurume Medical Journal, 45(1), 59-62.
33. ISO (International Organization for Standardization) (1998). ISO 14915: Multimedia User Interface Design Software Ergonomic Requirements, Part 3: Media Combination and Selection.
34. ISO/DIS (2007). Ergonomics of human-system interaction: Guidance on tactile and haptic interactions. Draft International Standard 9241-920.
35. Jansen, C. (2006). Telepresence Binoculars (TBI): a technology demonstrator for a telepresence control unit of unmanned vehicles. Proceedings of the NATO HFM Symposium Human Factors of Uninhabited Military Vehicles as Force Multipliers. Biarritz, France. RTO-MP-HFM-135; Neuilly-sur-Seine Cedex, France: NATO RTO.
36. Jansen, C., de Vries, S.C., & Duistermaat, M. (2005). Presenting images from an unmanned aerial vehicle in an attack helicopter cockpit. Report DV3 2005-A16. Soesterberg, the Netherlands: TNO Human Factors Research.
37. Kappé, B., van Erp, J., & Korteling, J.E. (1999). Effects of head-slaved and peripheral displays on lane-keeping performance and spatial orientation. Human Factors, 41(3), 453-66.
38. Korteling, J.E. & van der Borg, W. (1997). Partial camera automation in an unmanned air vehicle. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 27(2), 256-62.
39. Korteling, J.E. & van Emmerik, M.L. (1998). Continuous haptic information in target tracking from a moving platform. Human Factors, 40(2), 198-208.
40. Krausman, A. & White, T. (2006). Tactile Displays and Detectability of Vibrotactile Patterns as Combat Assault Maneuvers are Being Performed (ARL-TR-3998). Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
41. Krausman, A. & White, T. (2008). Detection and Localization of Vibrotactile Signals in Moving Vehicles (Technical Report). Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
42. Kumagai, J.K. & Tack, D.W. (2005). Alternative display modalities in support of wayfinding (DRDC-Toronto-CR-2005-093). Defence R&D Canada, Toronto, 1 July.
43. Lathan, C. & Tracey, M. (2002). The effects of operator spatial perception and sensory feedback on human-robot teleoperator performance. Presence: Teleoperation and Virtual Environments, 11(4), 368-77.
44. Macedo, J.A., Kaber, D.B., Endsley, M.R., Powanusorn, P., & Myung, S. (1998). The effect of automated compensation for incongruent axes on teleoperator performance. Human Factors, 40(4) 541-53.
45. Marin, R., Sanz, P.J., Nebot, P., & Wirz, R. (2005). A multimodal interface to control a robot arm via the web: A case study on remote programming. IEEE Transactions on Industrial Electronics, 52(6), 1506-20.
46. Massimino, M. & Sheridan, T. (1992). Sensory substitution of force feedback for the human-machine interface in space teleoperation, 43rd Congress of the International Astronautical Federation, World Space Congress, IAF/iAA-92-0246.
47. Morphew, M.E., Shively, J.R., and Casey, D. (2004). Helmet mounted displays for unmanned aerial vehicle control. In C.E. Rash & C.E. Reese (eds), Proceedings of SPIE, Vol. 5442. Helmet- and Head-Mounted Displays IX: Technologies and Applications, 93-103.
48. NATO (2007). Uninhabited military vehicles (UMVs): Human factors issues in augmenting the force. NATO Research & Technology Organisation Report AC/323(HFM-078)TP/69. Neuilly-sur-Seine Cedex, France: NATO RTO.
49. Olson, W.A., DeLauer, E.H., & Fale, C.A. (2006). Spatial disorientation in uninhabited aerial vehicles - A preliminary empirical study. In N.J. Cooke (ed.), Human Factors of UAVs Workshop, Retrieved from http://www.cerici.org/pjcts&ws/workshops/uavws06.html.
50. Oving, A.B. & Schaap, E. (2002). Motion Sickness When Driving with a Headslaved Camera System (TM-02-A046). Soesterberg, the Netherlands: TNO Human Factors Research.
51. Oving, A.B. & van Erp, J.B.F. (2001). Armoured Vehicle Driving with a Headslaved Indirect Viewing System: Field Experiments (Report TM-01-A008). Soesterberg, the Netherlands: TNO Human Factors Research.
52. Oving, A.B. & van Erp, J.B.F. (2002). Head Movement When Driving with a Headslaved Camera System (Report TM-02-A045). Soesterberg, the Netherlands: TNO Human Factors Research.
53. Pettitt, R.A.; Redden, E.S.; & Carstens, C.C.A. (2006). Comparison of Hand and Arm Signals to a Covert Tactile Communication System in a Dynamic Environment (ARL-TR-3838). Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
54. Redden, E.S. (2007). Findings from a multi-year investigation of tactile and multimodal displays. Proceedings of the Human Factors and Ergonomics 51st Society Annual Meeting, 1697-700.
55. Ruff, H.A., Narayanan, S., & Draper, M.H. (2002). Human interaction with levels of automation and decision aid fidelity in the supervisory control of multiple simulated unmanned aerial vehicles. Presence, 11, 335-51.
56. Sarter, N.B. (2006). Multimodal information presentation: Design guidance and research challenges. In A.M. Bisantz (ed.), Cognitive Engineering Insights for Human Performance and Decision Making, International Journal of Industrial Ergonomics, 439-45.
57. Self, B.P., Ercoline, W.R., Olson, W.A., & Tvarynanas, A.P (2006). Spatial disorientation in uninhabited aerial vehicles. In N.J. Cooke (ed.), Advances in Human Performance and Cognitive Engineering Research, 7, pp. 133-46.
58. Self, B.P., Ercoline, W.R., Olson, W.A., & Tvarynanas, A.P. (2002). Virtual auditory displays. In K. Stanney (ed.), Handbook of Virtual Environments (pp. 65-92). Mahwah, NJ: Lawrence Erlbaum Associates.
59. Simpson, B.D., Bolia, R.S., & Draper, M.H. (2004). Spatial auditory display concepts supporting situation awareness for operators of unmanned aerial vehicles. In D.A. Vincenzi, M. Mouloua, & P.A. Hancock (eds), Human Performance, Situation Awareness, and Automation: Current Research and Trends (pp. 61-5). Mahwah, NJ: Lawrence Erlbaum AssociatesRX.
60. Sklar, A.E. & Sarter, N.B. (1999). Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors, 41(4), 543-52.
61. Sutcliffe, A. (2003). Multimedia and Virtual Reality: Designing Multisensory User Interfaces. Mahwah, NJ: Lawrence Erlbaum Associates.
62. Tachi, S., Komoriya, S., Sawada, K., Nishiyama, T., Itoko, T., & Kobayashi, M. (2003). Telexistence cockpit for humanoid robot control, Advanced Robotics, 17(3) 199-217.
63. Van Erp, J.B.F. (2002). Guidelines for the use of vibro-tactile displays in human computer interaction, Proceedings of Eurohaptics, Edinburgh, 18-22.
64. Van Erp, J.B.F. (2005). Presenting directions with a vibro-tactile torso display. Ergonomics, 48, 302-13.
65. Van Erp, J.B.F. (2006). Tactile displays: Spin-off from the military cockpit to uninhabited vehicles. Proceedings of the NATO HFM Symposium Human Factors of Uninhabited Military Vehicles as Force Multipliers (RTO-MPHFM-135). Biarritz, France.
66. Van Erp, J.B.F., Eriksson, L., Levin, B., Carlander, O., Veltman, J.E., & Vos, W.K. (2007). Tactile cueing effects on performance in simulated aerial combat with high acceleration. Aviation, Space and Environmental Medicine, 78, 1128-34.
67. Van Erp, J.B.F. & Kappé, B. (1997). Ecological display design for the control of unmanned airframes. In M.J. Smith, G. Salvendy, & R.J. Koubek (eds), Advances in Human Factors/Ergonomics, 21B Design of Computing Systems: Social and Ergonomics Considerations, (pp. 267-70). Amsterdam: Elsevier.
68. Van Erp, J.B.F. & Oving, A.B. (2002). Control performance with three translational degrees of freedom. Human Factors, 44(1) 144-55.
69. Van Erp, J.B.F. & van Breda, L. (1999). Human Factors Issues and Advanced Interface Design in Maritime Unmanned Aerial Vehicles: A Project Overview 1995-1998 (Report TM-99-A004). Soesterberg, the Netherlands: TNO Human Factors Research.
70. Van Erp, J.B.F. & van den Dobbelsteen, J.J. (1998). Head Slaved Camera Control, Time Delays, and Situation Awareness in UAV Operation (Report 1998 A 075). Soesterberg, the Netherlands: TNO Human Factors Research.
71. Van Erp, J.B.F., van Veen, H.A.H.C., Jansen, C., & Dobbins, T. (2005). Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception, 2(2), 106-17.
72. Van Erp, J.B.F., Veltman, J.A. & van Veen, H.A.H.C. (2003). A tactile cockpit instrument to support altitude control. Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting, 114-18.
73. Veronneau S.J. & Evans, R.H. (2004). Spatial disorientation mishap classification. In Zacharan (ed.), Spatial Disorientation in Aviation, Progress in Astronautics and Aeronautics (pp. 197-241). Reston, VA: American Institute of Aeronautics and Astronautics, Inc.
74. Wildzunas, R.M., Barron, T.L., & Wiley, R.W. (1996). Visual display delay effects on pilot performance. Aviation, Space, and Environmental Medicine, 67(3), 214-21.
75. Worringham, C.J. & Beringer, D.B. (1998). Directional stimulus-response compatibility: A test of three alternative principles. Ergonomics, 41(6), 864-80.