Human performance issues and user interface design for teleoperated robots

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 6, 2007, Pages 1231-1245

  Chen, Jessie Y C ^a   Haas, Ellen C ^a   Barnes, Michael J ^a  

^a U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

Human computer interaction; Human robot interaction; Multimodal displays and input controls; Robotic control; Robots; Teleoperation; User interface design; User interfaces

Indexed keywords

DECISION SUPPORT SYSTEMS; HUMAN COMPUTER INTERACTION; REMOTE CONTROL; USER INTERFACES;

HUMAN-ROBOT INTERACTION; ROBOTIC CONTROL; TELEOPERATED ROBOTS; USER INTERFACE DESIGN;

ROBOTICS;

EID: 36248956961     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2007.905819     Document Type: Article

References (151)

1. C. Bulich, A. Klein, R. Watson, and C. Kitts, "Characterization of delay-induced piloting instability for the Triton undersea robot," in Proc. 2004 IEEE Aerospace Conf., 2004, vol. 1, p. 423.
2. Casper and R. R. Murphy, "Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center," IEEE Trans. Syst. Man, Cybern. B: Cybern., vol. 33, no. 3, pp. 367-385, Jun.2003.
3. L. A. Nguyen, M. Bualat, L. J. Edwards, L. Flueckiger, C. Neveu, K. Schwehr, M. Wagner, and E. Zbinden, "Virtual reality interfaces for visualization and control of remote vehicles," Auton. Robots, vol. 11, no. 1, pp. 59-68, 2001.
4. J. Johnston, R. Wilson, and M. Birch, "Training for the operation of semi-autonomous systems-Interim report," Human Syst. Inform. Anal. Center, Wright Patterson AFB, OH, Tech. Rep. HSIAC-TR-2002-002, 2002.
5. T. Fong, C. Thorpe, and B. Glass. (2003). PdaDriver: A handheld system for remote driving. presented at IEEE Int. Conf. Adv. Robot., [Online]. Available: http://imtsgl4.epfl.ch/papers/ICAR03-TF.pdf
6. A. Sekmen, A. B. Koku, and S. Zein-Sabatto, "Human robot interaction via cellular phones," in Proc. 2003 IEEE Int. Conf. Syst., Man, Cybern., 2003, vol. 4, pp. 3937-3942.
7. G. Kamsickas, "Future combat systems (FCS) concept and technology development (CTD) phase - Unmanned combat demonstration - Final report," Boeing Company, Seattle, WA, Tech. Rep. D786-1006102, 2003.
8. T. Fong and C. Thorpe, "Vehicle teleoperation interfaces," Auton. Robots, vol. 11, pp. 9-18, 2001.
9. H. K. Keskinpala and J. A. Adams, "Objective data analysis for a PDA-based human robot interface," in Proc. 2004 IEEE Int. Conf. Syst., Man, Cybern., 2004, vol. 3, pp. 2809-2814.
10. A. A. Malcolm and J. S. G. Lim. (2003). Teleoperation control for a heavy-duty tracked vehicle. [Online]. Available: http://www.simtech. astar.edu.sg/Research[TechnicalReports/TR0369.pdf.
11. M. J. Barnes, J. Y. C. Chen, K. A. Cosenzo, and D. K. Mitchell, "Human robot teams as soldier augmentation in future battlefields: An overview," in Proc. IIth Int. Conf. Hum.-Comput. Interact., vol. 11, 2005.
12. S. P. Schipani. (2003). An evaluation of operator workload during partially-autonomous vehicle operations. presented at Proc. PerMIS. [Online]. Available: http://www.isd.mel.nist.gov/research areas/ research_engineering/Performance_Metrics/PerMIS_2003/Proceedings/ Schipani.pdf
13. M. J. Barnes, R. Parasuraman, and K. A. Cosenzo, "Adaptive automation for military robotic systems,2: In Uninhabited Military Vehicles: Human Factor Issues in Augmenting the Force, NATO Tech. Rep. RTO-TRHFM-078, 2006, pp. 420-440.
14. A. Steinfeld, T. Fong, D. Kaber, M. Lewis, J. Scholtz, A. Schultz, and M. Goodrich, "Common metrics for human-robot interaction," in Proc. 2006 ACM Conf. Hum.-Robot Interact., 2006, pp. 33-40.
15. T. Fong, C. Thorpe, and C. Baur, "Multi-robot remote driving with collaborative control," IEEE Trans. Ind. Electron., vol. 54, no. 4, pp. 699-704, Aug. 2003.
16. D. D. Woods, J. Tittle, M. Feil, and A. Roesler, "Envisioning human-robot coordination in future operations," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 34, no. 2, pp. 210-218, May 2004.
17. J. S. Tittle, A. Roesler, and D. D. Woods, "The remote perception problem," in Proc. Hum. Factors Ergonom. Soc. 46th Annu. Meet., 2002, pp.260-264.
18. A. K. Kanduri, G. Thomas, N. Cabrol, E. Grin, and R. C. Anderson, "The (in)accuracy of novice rover operators' perception of obstacle height from monoscopic images," IEEE Trans. Syst. Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 505-512, Jul. 2005.
19. D. Drascic, "An investigation of monoscopic and stereoscopic video for teleoperation," M.S. thesis, Univ. Toronto, Toronto, ON, Canada, 1991.
20. R. P. Darken, K. Kempster, and B. Peterson, "Effect of streaming video quality of service on spatial comprehension in a reconnaissance task," in Proc. 23rd Army Sci. Conf., 2001, pp. 391-400.
21. R. R. Murphy, "Human robot interaction in rescue robotics," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 34, no. 2, pp. 138-153, May 2004.
22. J. Carlson and R. R. Murphy. (2004). How UGVs physically fail in the field. [Online]. Available: http://crasar.csee.usf.edu/research/ Publications/CRASAR-TR2004-16.pdf.
23. L. C. Thomas and C. D. Wickens, "Effects of display frames of reference spatial judgments and change detection," Univ. Illinois. Urbana-Champaign, Tech. Rep. ARL-00 14/FED-LAB-00-4, 2000.
24. B. G. Witmer and W. J. Sadowski, "Nonvisually guided locomotion to a previously viewed target in real and virtual environments," Hum. Factors, vol. 40, pp. 478-488, 1998.
25. J. B. F. Van Erp and P. Padmos, "Image parameters for driving with indirect viewing systems," Ergonomics, vol. 46, pp. 1471-1499, 2003.
26. M. F. Land and D. Lee, "Where we look when we steer," Nature, vol. 369, pp. 742-744, 1994.
27. A. B. Oving and J. B. F. Van Erp, "Driving with a head-slaved camera system," in Proc. Hum. Factors Ergonom. Soc. 45th Annu. Meet., 2001, pp. 1372-1376.
28. C. C. Smyth, V. Paul, A. M. Meldrum, and K. McDowell, "Examining alternative display configurations for an indirect vision driving interface," unpublished.
29. D. R. Scribner and J. W. Gombash, "The effect of stereoscopic and wide field of view conditions on teleoperator performance," U.S. Army Res. Lab., Aberdeen Proving Ground, MD, Tech. Rep. ARL-TR-1598, 1998.
30. M. Voshell, D. D. Woods, and F. Phillips, "Overcoming the keyhole in human robot coordination: Simulation and evaluation," in Proc. Hum. Factors Ergonom. Soc. 49th Meet., 2005, pp. 442-446.
31. C. C. Smyth, J. W. Gombash, and P. M. Burcham, "Indirect vision driving with fixed flat panel displays for near-unity, wide, and extended fields of camera view," U.S. Army Res. Lab., Aberdeen Proving Ground, MD, Tech. Rep. ARL-TR-2511, 2001.
32. A. J. Aretz, "The design of electronic map displays," Hum. Factors vol. 33, pp. 85-101, 1991.
33. S. M. Casner, "The effect of GPS and moving map displays on navigational awareness while flying under VFR," J. Appl. Aviation Stud., vol. 5, no. 1, pp. 153-165, 2005.
34. R. P. Darken and H. Cevik, "Map usage in virtual environments: Orientation issues," in Proc. IEEE Virtual Reality Conf., 1999, pp. 133-140.
35. M. C. Lohrenz, M. L. Gendron, S. S. Edwards, S. A. Myrick, and M. E. Trenchard, "Demonstration of a moving-map system for improved precise lane navigation of amphibious vehicles and landing craft," Sea Technol., pp. 39-43, 2004.
36. W. Wang, "Human navigation performance using 6 DOF dynamic viewpoint tethering in virtual environments," Ph.D., dissertation, Univ. Toronto, Toronto, ON, Canada, 2004.
37. S. Werner, "Cognitive reference systems and their role in designing spatial information displays," KI, vol. 16, no. 4, pp. 10-13, 2002.
38. U.S. Department of Transportation. (2006). Human factors design guidelines for advanced traveler information systems (ATIS) and commercial vehicle operations (CVO). [Online]. Available: http:// www.fhwa. dot.gov/tfhrc/safety/Pubs/atis/ch05/
39. S. M. Casner, "Mitigating the loss of navigational awareness while flying with GPS and moving map displays under VFR," Int. J. Appl. Aviation Stud., vol. 6, no. 1, pp. 121-129, spring 2006.
40. T. Heath-Pastore, "Improved operator awareness of teleoperated land vehicle attitude," SPAWAR, San Diego, CA, Tech. Rep. 1659, 1994.
41. D. E. McGovern, "Experience and results in teleoperation of land vehicles," in Pictorial Communication in Virtual and Real Environments, S. R. Ellis, M. K. Kaiser, and A. C. Grunwald, Eds. London, U.K.: Taylor and Francis, 1991, pp. 182-195.
42. W. A. Aviles, T. W. Hughes, H. R. Everett, A. Y. Umeda, S. W. Martin, A. H. Koyamatsu, M. Solorzano, R. Laird, and S. McArthur, "Issues in mobile robotics: The unmanned ground vehicle program teleoperated vehicle (TOV)," in Proc. SPIE (Mobile Robots V), vol. 1388, pp. 587-597, 1991.
43. M. Lewis, J. Wang, J. Manojlovich, S. Hughes, and X. Liu, "Experiments with attitude: Attitude displays for teleoperations," in Proc. 2003 IEEE Int. Conf. Syst., Man, Cybern., 2003, vol. 2, pp. 1345-1349.
44. J. Wang, M. Lewis, and S. Hughes, "Gravity-referenced attitude display for teleoperation of mobile robots," in Proc. Hum. Factors Ergonom. Soc. 48th Annu. Meet., 2004, pp. 2662-2666.
45. C. Shoemaker, "Robotics CTA," presented at the 2004 Collaborative Technol. Alliances Conf., Washington, DC.
46. J. L. Drury, H. A. Yanco, W. Howell, B. Minten, and J. Casper, "Changing shape: Improving situation awareness for a polymorphic robot," in Proc. 2006 ACM Conf. Hum. Robot Interact., 2006, pp. 72-79.
47. A. Rastogi, "Design of an interface for teleoperation in unstructured environments using augmented reality displays," M.S. thesis, Univ. Toronto, Toronto, ON, Canada, 1996.
48. S. B. Hughes and M. Lewis, "Task-driven camera operations for robotic exploration," IEEE Trans. Syst. Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 513-522, Jul. 2005.
49. D. R. Olsen and M. A. Goodrich. (2003). "Metrics for evaluating human-robot interactions," presented at Per MIS. [Online]. Available: http://www.isd.mel.nist.gov/research_areas/ research_engineering/Performance_Metrics/PerMIS_2003/Proceedings/ Olsen.pdf
50. D. T. Levin and D. J. Simons, "Failure to detect changes to attended objects in motion pictures," Psychonom. Bull. Rev., vol. 4, no. 4, pp. 501-506, 1997.
51. J. Luck, P. L. McDermott, L. Allender, and A. Fisher, "Advantages of co-location for effective human to human communication of information provided by an unmanned vehicle," in Proc. Hum. Factors Ergonom. Soc. 50th Annu. Meet., 2006, pp. 550-554.
52. O. Olmos, C. D. Wickens, and A. Chudy, "Tactical displays for combat awareness: An examination of dimensionality and frame of reference concepts and the application of cognitive engineering," Int.J. Aviation Psychol., vol. 10, no. 3, pp. 247-271, 2000.
53. L. C. Thomas and D. C. Wickens, "Visual displays and cognitive tunneling: Frames of reference effects on spatial judgments and change detection," in Proc. Hum. Factors Ergonom. Soc. 45th Annu. Meet., 2001, pp. 336-340.
54. D. D. Woods, "Visual momentum: A concept to improve the cognitive coupling of person and computer," Int.J. Man-Mach. Stud., vol. 21, pp. 229-244, 1984.
55. C. A. Johnson, J. A. Adams, and K. Kawamura, "Evaluation of an enhanced human-robot interface," in Proc. 2003 IEEE Int. Conf. Syst., Man, Cybern., 2003, vol. 1, pp. 900-905.
56. D. R. Lampton, M. J. Singer, D. McDonald, and J. P. Bliss, "Distance estimation in virtual environments," in Proc. Hum. Factors Ergonom. Soc. 39th Annu. Meet., 1995, pp. 1268-1272.
57. B. G. Witmer and P. Kline, "Judging perceived and traversed distance in virtual environments," Presence: Teleoperators Virtual Environ., vol. 7, no.2,pp.144-167,1998.
58. J. L. Marble, D. J. Bruemmer, and D. A. Few, "Lessons learned from usability tests with a collaborative cognitive workspace for human-robot teams," in Proc. 2003 IEEE Conf. Syst Man, Cybern., vol. 1, pp. 448-453.
59. J. V. Draper, S. Handel, and C. C. Hood, "Three experiments with stereoscopic television: When it works and why," in Proc. 1991 IEEE Int. Conf. Syst., Man, Cybern., 1991, vol. 2, pp. 1047-1052.
60. P. Fitts, "The information capacity of the human motor system in controlling the amplitude of movement," J. Exp. Psychol., vol. 47, pp. 381-391, 1954.
61. L. B. Rosenberg, "The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks," in Proc. 1993 IEEE Virtual Reality Annu. Int. Symp., pp. 27-32.
62. J. Green, E. Dougherty, and E. Savacool, "Stereovision system for shipboard cranes," in Proc. Interservice/Ind. Training, Simul., Educ. Conf., 2003.
63. D. Drascic and J. Grodski, "Defense teleoperation and stereoscopic video," in Proc. SPIE, vol. 1915, pp. 58-69, 1993.
64. J. O. Merritt, V. G. CuQlock-Knopp, M. Kregel, J. Smoot, and W. Monaco, "Perception of terrain drop-offs as a function of L-R viewpoint separation in stereoscopic video," inProc. SPIE, vol. 5800, pp. 169-176, 2005.
65. B. Vaughan. U.S. Army Research Lab., Aberdeen Proving Ground, MD, private communication, Mar. 2006.
66. J. French, T. G. Ghirardelli, and J. Swoboda, "The effect of bandwidth on operator control of an unmanned ground vehicle," in Proc. Interservice/Ind. Training, Simul., Educ. Conf., 2003.
67. R. P. Darken and B. Peterson, "Spatial orientation, wayfinding, and representation," in Handbook of Virtual Environment Technology, K. Stanney, Ed. Mahwah, NJ: Erlbaum, 2002, pp. 493-518.
68. T. B. Sheridan, Telerobotics, Automation, and Human Supervisory Control. Cambridge, MA: MIT Press, 1992.
69. B. Watson, N. Walker, W. Ribarsky, and V. Spaulding, "Effects of variation in system responsiveness on user performance in virtual environments," Hum. Factors, vol. 40, pp. 403-414, 1998.
70. M. Massimino and T. B. Sheridan, "Teleoperator performance with varying force and visual feedback," Hum. Factors, vol. 36, pp. 145-157, 1994.
71. J. Y. C. Chen, P. J. Durlach, J. A. Sloan, and L. D. Bowens, "Human robot interaction in the context of simulated route reconnaissance missions," Military Psychol., to be published.
72. J. E. Thropp and J. Y C. Chen, "Effects of slow frame rates on human performance," U.S. Army Res. Lab., Aberdeen Proving Ground, MD, Tech. Rep. ARL-TR-3813, 2006.
73. B. Watson, V. Spaulding, N. Walker, and W. Ribarsky, "Evaluation of the effects of frame rate variation on VR task performance," in Proc. 1997 Virtual Reality Annu. Int. Symp., pp. 38-44.
74. P. Richard, G. Birebent, P. Coiffet, G. Burdea, D. Gomez, and N. Langrana, "Effect of frame rate and force feedback on virtual object manipulation," Presence: Teleop. Virtual Environ., vol. 5, no. 1, pp.95-108,1996.
75. M. Baker, R. Casey, B. Keyes, and H. A. Yanco, "Improved interfaces for human-robot interaction in urban search and rescue," in Proc. 2004 IEEE Int. Conf. Syst., Man, Cybern., vol. 3, pp. 2960-2965.
76. G. L. Calhoun and M. H. Draper, "Multi-sensory interfaces for remotely operated vehicles," in Human Factors of Remotely Operated Vehicles N. J. Cooke, H. L. Pringle, H. K. Pedersen, and O. Connor, Eds. Oxford, U.K.: Elsevier, 2006, pp. 149-163.
77. T. H. J. Collett and B. A. MacDonald, "Developer oriented visualization of a robot program: An augmented reality approach," in Proc. 2006 ACM Conf. Hum.-Robot Interact., pp. 49-56.
78. M. Daily, Y. Cho, K. Martin, and D. Payton, "World embedded interfaces for human-robot interaction," in Proc. 36th Hawaii Int. Conf. Syst. Sci., 2003, pp. 125-130.
79. C. W. Nielsen and M. A. Goodrich, "Comparing the usefulness of video and map information in navigation tasks," in Proc. 2006 ACM Conf. Hum.-Robot Interact., pp. 95-101.
80. D. Tufano, Automotive HUDs: The overlooked safety issues. Hum. Factors, vol. 39, pp. 303-311, 1997.
81. C. D. Wickens. "Attentional tunneling and task management," University of Illinois, Urbana-Champaign, IL, Tech. Rep. AHFD-05-23/NASA-05-10, 2005.
82. S. MacKenzie and C. Ware, "Lag as a determinant of human performance in interactive systems," in Proc. SIGCHI Conf. Hum. Factors Comput. Syst., 1993, pp. 488-493.
83. S. R. Ellis, K. Mania, B. D. Adelstein, and M. Hill, "Generalizability of latency detection in a variety of virtual environments," in Proc. Hum. Factors Ergonom. Soc. 48th Annu. Meet., 2004, pp. 2632-2636.
84. J. C. Lane, C. R. Carignan, B. R. Sullivan, D. L. Akin, T. Hunt, and R. Cohen, "Effects of time delay on telerobotic control of neutral buoyancy vehicles," in Proc. 2002 IEEE Int. Conf. Robot. Autom., 2002,vol. 3, pp. 2874-2879.
85. T. B. Sheridan and W. R. Ferrell, "Remote manipulative control with transmission delay," IEEE Trans. Hum. Factors Electron., vol. 4, no. 1, pp. 25-29, Sep. 1963.
86. T. B. Sheridan, Humans and Automation: System Design and Research Issues. Hoboken, NJ: Wiley, 2002.
87. R. Held, A. Efstathiou, and M. Greene, "Adaptation to displaced and delayed visual feedback from the hand," J. Exp. Psychol., vol. 72, pp. 887-891, 1966.
88. L. H. Frank, J. G. Casali, and W. W. Wierville, "Effects of visual display and motion system delays on operator performance and uneasiness in a driving simulator," Hum. Factors, vol. 30, pp. 201-217, 1988.
89. K. W. Arthur, K. S. Booth, and C. Ware, "Evaluating 3D task performance for fish tank virtual worlds," ACM Trans. Inf. Syst., vol. 11, no. 3, pp. 239-265, 1993.
90. S. R. Ellis, B. D. Adelstein, S. Baumeler, G. J. Jense, and R. H. Jacoby, "Sensor spatial distortion, visual latency, and update rate effects on 3D tracking in virtual environments," in Proc. Virtual Reality Conf., 1999, pp. 218 221.
91. J. P. Luck, P. L. McDermott, L. Allender, and D. C. Russell, "An investigation of real world control of robotic assets under communication latency," in Proc. 2006 ACM Conf. Hum. Robot Interact. 2006, pp. 202-209.
92. K. M. Stanney, R. R. Mourant, and R. S. Kennedy, "Human factors issues in virtual environments: A review of the literature," Presence: Teleop. Virtual Environ., vol. 7, pp. 327-351, 1998.
93. E. M. Kolasinski, "Simulator sickness in virtual environments," U.S. Army Res. Inst., Alexandria, VA, Tech. Rep. 1027, 1995.
94. D. B. Kaber, J. M. Riley, R. Zhou, and J. Draper, "Effects of visual interface design, and control mode and latency on performance, telepresence and workload in a teleoperation task," in Proc. Hum. Factors Ergonom. Soc. 44th Annu. Meet., 2000, pp. 503-506.
95. J. V. Draper, D. B. Kaber, and J. M. Usher, "Telepresence," Hum. Factors, vol. 40, pp. 354-375, 1998.
96. B. G. Witmer and M. J. Singer, "Measuring immersion in virtual environments," U.S. Army Res. Inst., Alexandria, VA, Tech. Rep. 1014, 1994.
97. J. V. Draper, D. B. Kaber, and J. M. Usher, "Speculations on the value of telepresence," Cyber Psychol. Behav., vol. 2, no. 4, pp. 349-362, 1999.
98. A. Kheddar, R. Chellali, and P. Coiffet, "Virtual environment-assisted teleoperation," in Handbook of Virtual Environment Technology, K. Stanney, Ed. Mahwah, NJ: Erlbaum, 2002, pp. 959-997.
99. Z. Deng and M. Jagersand. (2003). Predictive display system for tele-manipulation using image-based modeling and rendering. [Online]. Available: http://www.cs.ualberta.ca/~jag/research/papers/ iros03predSys.pdf
100. B. Ricks, C. W. Nielsen, and M. A. Goodrich, "Ecological displays for robot interaction: A new perspective," in Proc. IROS 2004, vol. 3, pp. 2855-2860.
101. P. S. Cowings, W. B. Toscano, C. DeRoshia, and R. A. Tauson, "Effects of command and control vehicle (C2 V) operational environment on soldier health and performance," NASA Ames, Moffet Field, CA, Tech. Rep. NASA/TM-1999-208786, 1999.
102. S. G. Hill, C. Stachowiak, and R. A. Tauson, "Soldier performance in the enclosed compartment of a moving vehicle," presented at the NATO Appl. Veh. Technol. Panel Symp., Habitability Combat Transp. Veh.: Noise, Vibration Motion, Paper RTO-MP-AVT-110, 2004.
103. S. P. Schipani, R. S. Bruno, M. A. Lattin, B. M. King, and D. J. Patton, "Quantification of cognitive process degradation while mobile, attributable to the environmental stressors endurance, vibration, and noise," U.S. Army Res. Lab., Aberdeen Proving Ground, MD, Paper ARL-TR-1603, 1998.
104. S. G. Hill and R. A. Tauson. (2005). Soldier performance issues in C2 'On the move'. presented at 10th Int. Command Control Res. Technol. Symp., [Online]. Available: http://www.dodccrp.org/events/10th_ICCRTS/ CD/Papers/074.pdf
105. R. R. Murphy and J. L. Burke, "Up from the rubble: Lessons learned about HRI from search and rescue," in Proc. Hum. Factors Ergonom. Soc. 49th Annu. Meet., 2005, 437-441.
106. C. E. Lathan and M. Tracey, "The effects of operator spatial perception and sensory feedback on human-robot teleoperation performance," Presence: Teleoperators Virtual Environ., vol. 11, no. 4, pp. 368-377, 2002.
107. G. Burdea, P. Richard, and P. Coiffet, "Multimodal virtual reality: Input-output devices, system integration, and human factors," Int. J. Hum.- Comput. Interact., vol. 8, no. 1, pp. 5-24, 1996.
108. G. V. Popescu, G. C. Burdea, and H. Trefftz, "Multimodal interaction modeling," in Handbook of Virtual Environments, K. Stanney, Ed. Mahwah, NJ: Erlbaum, 2002, pp. 65-92.
109. G. Calhoun, M. Draper, H. Ruff, and J. Fontejon, "Utility of a tactile display for cueing faults," in Proc. Hum. Factors Ergonom. Soc. 46th Annu. Meet., 2002, pp. 2144-2148.
110. R. D. Shilling and B. Shinn-Cunningham, "Virtual auditory displays," in Handbook of Virtual Environments, K. Stanney, Ed. Mahwah, NJ: Erlbaum, 2002, pp. 65-92.
111. N. Y. Chong, T. Kotoku, K. Ohba, H. Sasaki, K. Komoriya, and K. Tanie, "Multioperator teleoperation of multirobot systems with time delay. II - Testbed description," Presence: Teleop. Virtual Environ., vol. 11, no. 3, pp. 292-303, 2002.
112. Y. Nagai, S. Tsuchiya, and S. Kimura, "A study on audio feedback system for the operation of Engineering Test Satellite VII - Effects on telemetry monitor," in Proc. Int. Sym. Space Technol. Sci., 2000, pp. 1226-1231.
113. B. D. Simpson, R. S. Bolia, and M. H. Draper, "Spatial auditory display concepts supporting situation awareness for operators of unmanned aerial vehicles," in Human Performance, Situation Awareness, and Automation: Current Research and Trends, vol. 1, D. A. Vincenzi, M. Mouloua, and P. A. Hancock, Eds. Mahwah, NJ: Erlbaum, 2004, pp. 61-65.
114. S. Tachi, K. Komoriya, K. Sawada, T. Nishiyama, T. Itoko, M. Kobayashi, and K. Inoue, "Telexistence cockpit for humanoid robot control," Adv. Robot., vol. 17, no. 3, pp. 199-217, 2003.
115. F. Gemperle, N. Ota, and D. Siewiorek, "Design of a wearable tactile display," in Proc. 5th IEEE Int. Symp. Wearable Comput., 2001, pp. 5-12.
116. R. W. Cholewiak and A. A. Collins, "The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode," Percept. Psychophys., vol. 62, pp. 1220-1235, 2000.
117. J. L. Rochlis and D. J. Newman, "A tactile display for international space station (ISS) extravehicular activity (EVA)," Aviation Space Environ. Med., vol. 71, pp. 571-578, 2000.
118. G. Calhoun, J. Fontejon, M. Draper, H. Ruff, and B. Guilfoos, "Tactile versus aural redundant alert cues for UAV control applications," in Proc. Hum. Factors Ergonom. Soc. 48th Annu. Meet., 2004, pp. 137-141.
119. M. Sitti and H. Hashimoto, "Teleoperated nano scale object manipulation," in Recent Advances on Mechatronics, O. Kaynak, Ed. New York: Springer-Verlag, 1999, pp. 172-178.
120. A. Kortschack, A. Shirinov, T. Truper, and S. Fatikow, "Development of mobile versatile nanohandling microrobots: Design, driving principles, haptic control," Robotica, vol. 23, no. 4, pp. 419-434, 2005.
121. J. Aleotti, S. Bonazzi, S. Caselli, and M. Reggiani. (2002). A multi-modal user interface for remote object exploration in teleoperation systems. [Online]. Available: http://rimlab.ce.unipr.it/ Publications/HUROIN2002.pdf
122. A. M. Murray, R. L. Klatzky, and P. K. Khosla, "Psychophysical characterization and testbed validation of a wearable vibrotactile glove for telemanipulation," Presence: Teleop. Virtual Environ., vol. 12, no. 2, pp. 156-182, 2003.
123. S. Charles, H. Das, T. Ohm, C. Boswell, G. Rodriguez, R. Steele, and D. Istrate, "Dexterity-enhanced telerobotic microsurgery," in Proc. Int. Conf. Adv. Robot., 1997, pp. 5-10.
124. C. W. Kennedy, T. Hu, J. P. Desai, A. S. Wechsler, and J. Y. Kresh, "A novel approach to robotic cardiac surgery using haptics and vision," Cardiovascular Eng.: Int. J., vol. 2, no. 1, pp. 15-22, 2002.
125. M. Kitagawa, D. Dokko, A. M. Okamura, and D. D. Yuh, "Effect of sensory substitution on suture-manipulation forces for robotic surgical systems," J. Thoracic Cardiovascular Surg., vol. 129, pp. 151-158, 2005.
126. D. Kragic, P. Marayong, M. Li, A. M. Okamura, and G. D. Hager, "Human machine collaborative systems for microsurgical applications," Int. J. Robot. Res., vol. 24, no. 9, pp. 731-741, 2005.
127. L. Rosenberg, "Virtual fixtures: Perceptual overlays enhance operator performance in telepresence tasks," Ph.D. dissertation, Dept. Mech. Eng., Stanford Univ., Stanford, CA, 1994.
128. D. V. Gunn, J. S. Warm, W. T. Nelson, R. S. Bolia, D. A. Schumsky, and K. J. Corcoran, "Target acquisition with UAVs: Vigilance displays and advanced cuing interfaces," Hum. Factors, vol. 47, pp. 488-497, 2005.
129. J. Y. C. Ng, J. C. F. Man, S. Fels, G. Dumont, and J. M. Ansermino, "An evaluation of a vibro-tactile display prototype for physiological monitoring," Anesth. Analg., vol. 101, no. 6, pp. 1719-1724, 2005.
130. M. Massimino and T. Sheridan, "Sensory substitution of force feedback for the human-machine interface in space teleoperation," presented at the 43rd Congr. Int. Astronaut. Fed., World Space Congress, Paper IAF/iAA-92-0246, 1992.
131. W. Chou and T. Wang, "The design of multimodal human-machine interface for teleoperation," in Proc. 2001 IEEE Int. Conf. Syst., Man, Cybern., 2001, vol. 5, pp. 3187-3192.
132. I. Elhajj, N. Xi, W. K. Fung, Y-H Liu, Y. Hasegawa, and T. Fukuda, "Supermedia-enhanced Internet-based telerobotics," in Proc. Inst. Elect. Eng., vol. 91, no. 3, pp. 396-421, 2003.
133. J. J. Abbott, P. Marayong, and A. M. Okamura, "Haptic virtual fixtures for robot-assisted manipulation," in Robotics Research: Results of the 12th International Symposium ISRR, S. Thrun, R. Brooks, and H. Durrant-Whyte, Eds. New York, NY: Springer, 2007, pp. 49-64.
134. C. P. Sayers and R. P. Paul, "An operator interface for teleprogramming employing synthetic fixtures," Presence: Teleop. Virtual Environ. vol. 3, pp. 309-320, 1994.
135. J. Aleotti, S. Caselli, and M. Reggiani, "Evaluation of virtual fixtures for a robot programming by demonstration interface," IEEE Trans. Syst. Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 536-545, Jul. 2005.
136. M. Draper, G. Calhoun, H. Ruff, D. Williamson, and T. Barry, "Manual versus speech input for unmanned aerial vehicle control station operations," in Proc. Hum. Factors Ergonom. Soc. 47th Annu. Meet. 2003, pp. 109-113.
137. H. Downs, Integrated Remote Neurosurgical System. Charlottesville, VA: Virginia Neurological Inst., 1998.
138. H. Rininsland, "ARTEMIS: A telemanipulator for Cardiac surgery," Eur. J. Cardio-Thoracic Surg., vol. 16, pp. S106-S111, 1999.
139. L. F. Penin, R. Aracil, M. Ferre, E. Pinto, M. Hernando, and A. Barrientos, "Telerobotic system for live power lines maintenance: ROBTET," in Proc. 1998 IEEE Int. Conf. Robot. Autom., vol. 3, pp. 2110-2115.
140. S. M. Goza, R. O. Ambrose, M. A. Diftler, and I. M. Spain, "Telepresence control of the NASA/DARPA robonaut on a mobility platform," in Proc. SIGCHI Conf. Hum. Factors Comput. Syst., 2004, pp. 623-629.
141. D. Perzanowski, D. Brock, W. Adams, M. Bugajska, A. Schultz, J. Trafton, S. Blisard, and M. Skubic, "Finding the FOO: A pilot study for a multimodal interface," in Proc. 2003 IEEE Conf. Syst., Man, Cybern. vol. 4, pp. 3218-3223.
142. C. Hu, M. Q. Meng, P. X. Liu, and X. Wang, "Visual gesture recognition for human-machine interface of robot teleoperation," in Proc. 2003 IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 1560-1565.
143. M. Frigola, J. Fernandez, and J. Aranda, "Visual human machine interface by gestures," in Proc. IEEE Int. Conf. Robot. Autom., 2003, pp. 386-391.
144. C. J. Cohen, L. Conway, and D. Kiditschek, "Dynamical system representation, generation, and recognition of basic oscillatory motion gestures," in Proc. 2nd Int. Conf. Face Gesture Recog., 1996, pp. 60-65.
145. Y. Kuno, S. Nakanishi, T. Murashima, N. Shimada, and Y. Shirai, "Robotic wheelchair with three control modes," in Proc. IEEE Int. Conf. Robot. Autom., 1999, pp. 2590-2594.
146. E. Adrizzone, A. Chella, and R. Pirrone, "An architecture for automatic gesture analysis," in Proc. Working Conf. Adv. Vis. Interfaces, 2000, pp. 205-256.
147. V. Zue, "Eighty challenges facing speech input/output technologies," in Proc. From Sound Sense: 50+ Years Discovery Speech Commun., 2004, pp. B179-B195.
148. D. Weimer and S. K. Ganapathy, "A synthetic visual environment with hand gesturing and voice input," in Proc. Comput.-Hum. Interact., 1989, pp. 235-240.
149. J. Juster and D. Roy, "Elvis: Situated speech and gesture understanding for a robotic chandelier," in Proc. Int. Conf. Multimodal Interfaces 2004, pp. 90-95.
150. M. Yoshizaki, Y. Kuno, and A. Nakamura, "Human-robot interface based on the mutual assistance between speech and vision," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2002, pp. 1308-1313.
151. I. Mitsugami, N. Ukita, and M. Kidode, "Robot navigation by eye pointing," in Proc. 4th Int. Conf. Entertainment Comput., 2005, pp. 256-267.