Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design

International Journal of Advanced Robotic Systems

Volumn 5, Issue 1, 2008, Pages 1-18

  Green, Scott A ^a,b   Billinghurst, Mark ^b   Chen, Xiaoqi ^a   Chase, J Geoffrey ^a  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

augmented reality; collaboration; communication; human computer interaction; human robot collaboration; human robot interaction; robotics

Indexed keywords

AUGMENTED REALITY; COMMUNICATION; COMPUTER GRAPHICS; HUMAN COMPUTER INTERACTION; INTELLIGENT ROBOTS; MACHINE DESIGN; MAN MACHINE SYSTEMS; NASA; ROBOTICS; ROBOTS; SPACE RESEARCH; ARCHITECTURAL DESIGN; VIRTUAL REALITY;

COLLABORATION; EFFECTIVE COMMUNICATION; HUMAN-ROBOT COLLABORATION; HUMAN-ROBOTIC SYSTEMS; INTELLIGENT ROBOTIC SYSTEMS; SITUATIONAL AWARENESS; URBAN SEARCH AND RESCUE; VISION FOR SPACE EXPLORATION; HUMAN-ROBOT INTERACTION;

HUMAN ROBOT INTERACTION; ROBOTICS;

EID: 40549104177     PISSN: 17298806     EISSN: 17298814     Source Type: Journal    
DOI: 10.5772/5664     Document Type: Review

References (80)

1. Argyle M., (1967). The Psychology of Interpersonal Behavior. London, Penguin Books.
2. Ariadne (2006). http://www.opendialog.org/.
3. ARToolKit (2007). http://www.hitl.washington.edu/artoolkit/.
4. Azuma R., Baillot Y., et al.(2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications 21 (6)
5. Bechar A., and Edan Y., (2003). Human-robot collaboration for improved target recognition of agricultural robots. Industrial Robot 30 (5): 432-436.
6. Billinghurst M., Bowskill J., et al.(1998). Spatial information displays on a wearable computer. IEEE Computer Graphics and Applications 18 (6): 24-31.
7. Billinghurst M., Grasset R., et al.(2005). Designing Augmented Reality Interfaces. Computer Graphics SIGGRAPH Quarterly, 39 (1), 17-22 Feb.
8. Billinghurst M., Kato H., et al.(2001). The MagicBook: A transitional AR interface. Computers and Graphics (Pergamon) 25 (5): 745-753.
9. Billinghurst M., Poupyrev I., et al.(2000). Mixing realities in Shared Space: An augmented reality interface for collaborative computing. 2000 IEEE International Conference on Multimedia and Expo (ICME 2000), Jul 30-Aug 2, New York, NY.
10. Billinghurst M., Weghorst S., et al.(1997). Wearable computers for three dimensional CSCW. Proceedings of the 1997 1st International Symposium on Wearable Computers, Oct 13-14, Cambridge, MA, USA, IEEE Comp Soc, Los Alamitos, CA, USA.
11. Bowen C., Maida J., et al.(2004). Utilization of the Space Vision System as an Augmented Reality System for Mission Operations. Proceedings of AIAA Habitation Conference, Houston TX.
12. Breazeal C., (2004). Social interactions in HRI: The robot view. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews Human-Robot Interactions 34 (2): 181-186.
13. Breazeal C., Brooks A., et al.(2003). Humanoid Robots as Cooperative Partners for People. MIT Media Lab, Robotic Life Group, Submitted for review to International Journal of Humanoid Robots December 15.
14. Breazeal C., Edsinger A., et al.(2001). Active vision for sociable robots. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 31 (5): 443-453.
15. Cassell J., Bickmore T., et al.(1999). Embodiment in conversational interfaces: Rea. Conference on Human Factors in Computing Systems-Proceedings Proceedings of the CHI 99 Conference: CHI is the Limit-Human Factors in Computing Systems, May 15-May 20: 520-527.
16. Cassell J., Nakano Y., et al.(2001). Non-Verbal Cues for Discourse Structure. Association for Computational Linguistics Annual Conference (ACL).
17. Cheok A. D., Fong S. W., et al.(2003). Human Pacman: A Mobile Entertainment System with Ubiquitous Computing and Tangible Interaction over a Wide Outdoor Area. Mobile HCI: 209-223.
18. Cheok A. D., Weihua W., et al.(2002). Interactive theatre experience in embodied + wearable mixed reality space. Proceedings. International Symposium on Mixed and Augmented Reality, ISMAR.
19. Chong N. Y., Kotoku T., et al.(2001). Exploring interactive simulator in collaborative multi-site teleoperation. 10th IEEE International Workshop on Robot and Human Communication, Sep 18-21, Bordeaux-Paris, Institute of Electrical and Electronics Engineers Inc.
20. Clark H. H., and Brennan S. E., (1991). Grounding in Communication. Perspectives on Socially Shared Cognition. Resnick L., Levine J., Teasley S., Washington D.C., American Psychological Association: 127-149.
21. Clark H. H., and Wilkes-Gibbs D., (1986). Referring as a collaborative process. Cognition 22 (1): 1-39.
22. COGNIRON (2007). http://www.cogniron.org/InShort.php.
23. Collett T. H. J., and MacDonald B. A., (2006). Developer Oriented Visualisation of a Robot Program. Proceedings 2006 ACM Conference on Human-Robot Interaction, March 2-4: 49-56.
24. Denecke M., (2002). Rapid Prototyping for Spoken Dialogue Sysems. Proceedings of 19th International Conference on Computational Linguistics 1: 1-7.
25. Drury J., Richer J., et al.(2006). Comparing Situation Awareness for Two Unmanned Aerial Vehicle Human Interface Approaches. Proceedings IEEE International Workshop on Safety, Security and Rescue Robotics (SSRR). Gainsburg, MD, USA August.
26. Fernandez V., Balaguer C., et al.(2001). Active human-mobile manipulator cooperation through intention recognition. 2001 IEEE International Conference on Robotics and Automation, May 21-26, Seoul, Institute of Electrical and Electronics Engineers Inc.
27. Fong T., Kunz C., et al.(2006). The Human-Robot Interaction Operating System. Proceedings of 2006 ACM Conference on Human-Robot Interaction, March 2-4: 41-48.
28. Fong T., and Nourbakhsh I. R., (2005). Interaction challenges in human-robot space exploration. Interactions 12 (2): 42-45.
29. Fong T., Thorpe C., et al.(2002a). Robot As Partner: Vehicle Teleoperation With Collaborative Control. Multi-Robot Systems: From Swarms to Intelligent Automata, 01 June.
30. Fong T., Thorpe C., et al.(2002b). Robot, asker of questions. IROS 2002, Sep 30, Lausanne, Switzerland, Elsevier Science B.V.
31. Fong T., Thorpe C., et al.(2003). Multi-robot remote driving with collaborative control. IEEE Transactions on Industrial Electronics 50 (4): 699-704.
32. Fussell S. R., Setlock L. D., et al.(2003). Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. The CHI 2003 New Horizons Conference Proceedings: Conference on Human Factors in Computing Systems, Apr 5-10, Ft. Lauderdale, FL, United States, Association for Computing Machinery.
33. Giesler B., Salb T., et al.(2004). Using augmented reality to interact with an autonomous mobile platform. Proceedings- 2004 IEEE International Conference on Robotics and Automation, Apr 26-May 1, New Orleans, LA, United States, Institute of Electrical and Electronics Engineers Inc., Piscataway, United States.
34. Giesler B., Steinhaus P., et al.(2004). Sharing skills: Using augmented reality for human-Robot collaboration. Stereoscopic Displays and Virtual Reality Systems XI, Jan 19-21, San Jose, CA, United States, International Society for Optical Engineering, Bellingham, WA 98227-0010, United States.
35. Glassmire J., O'Malley M., et al.(2004). Cooperative manipulation between humans and teleoperated agents. Proceedings-12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS 2004, Mar 27-28, Chicago, IL, United States, IEEE Computer Society, Los Alamitos;Massey University, Palmerston, United States;New Zealand.
36. Hoffmann G., and Breazeal C., (2004). Robots that Work in Collaboration with People. AAAI Fall Symposium on the Intersection of Cognitive Science and Robotics, Washington, D.C.
37. Honda (2007). http://world.honda.com/ASIMO/.
38. Horiguchi Y., Sawaragi T., et al.(2000). Naturalistic human-robot collaboration based upon mixed-initiative interactions in teleoperating environment. 2000 IEEE International Conference on Systems, Man and Cybernetics, Oct 8-Oct 11, Nashville, TN, USA, Institute of Electrical and Electronics Engineers Inc., Piscataway, NJ, USA.
39. HRI2006 (2006). http://www.hri2006.org/.
40. Huttenrauch H., Green A., et al.(2004). Involving users in the design of a mobile office robot. IEEE Transactions on Systems, Man and Cybernetics, Part C 34 (2): 113-124.
41. Inagaki Y., Sugie H., et al.(1995). Behavior-based intention inference for intelligent robots cooperating with human. Proceedings of the 1995 IEEE International Conference on Fuzzy Systems. Part 3 (of 5), Mar 20-24, Yokohama, Jpn, IEEE, Piscataway, NJ, USA.
42. Iossifidis I., Theis C., et al.(2003). Anthropomorphism as a pervasive design concept for a robotic assistant. 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 27-31, Las Vegas, NV, United States, Institute of Electrical and Electronics Engineers Inc.
43. Ishikawa N., and Suzuki K., (1997). Development of a human and robot collaborative system for inspecting patrol of nuclear power plants. Proceedings of the 1997 6th IEEE International Workshop on Robot and Human Communication, RO-MAN'97, Sep 29-Oct 1, Sendai, Jpn, IEEE, Piscataway, NJ, USA.
44. Julier S., Baillot Y., et al.(2002). Information filtering for mobile augmented reality. IEEE Computer Graphics and Applications 22 (5): 12-15.
45. Kanda T., Ishiguro H., et al.(2002). Development and evaluation of an interactive humanoid robot Robovie. 2002 IEEE International Conference on Robotics and Automation, May 11-15, Washington, DC, United States, Institute of Electrical and Electronics Engineers Inc.
46. Kendon A., (1967). Some Functions of Gaze Direction in Social Interaction. Acta Psychologica 32: 1-25.
47. Kendon A., (1983). Gesture and Speech: How They Interact. Nonverbal Interaction. Wiemann J., Harrison R., (Eds). Beverly Hills, Sage Publications: 13-46.
48. Kiyokawa K., Billinghurst M., et al.(2002). Communication behaviors of co-located users in collaborative AR interfaces. International Symposium on Mixed and Augmented Reality, ISMAR.
49. Krujiff G.-J. M., Zender H., et al.(2006). Clarification Dialogues in Human-Augmented Mapping. Proceedings of 2006 ACM Conference on Human-Robot Interaction, March 2-4: 282-289.
50. Kuzuoka H., Yamazaki K., et al.(2004). Dual ecologies of robot as communication media: Thoughts on coordinating orientations and projectability. 2004 Conference on Human Factors in Computing Systems-Proceedings, CHI 2004, Apr 24-29, Vienna, Austria, Association for Computing Machinery, New York, NY 10036-5701, United States.
51. Maida J., Bowen C., et al.(2006). Enhanced Lighting Techniques and Augmented Reality to Improve Human Task Performance. NASA Tech Paper TP-2006-213724 July.
52. McNeill D., (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago, The University of Chicago Press.
53. Milgram P., and Kishino F., (1994). Taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems E77-D (12): 1321-1329.
54. Milgram P., Zhai S., et al.(1993). Applications of Augmented Reality for Human-Robot Communication. In Proceedings of IROS 93: International Conference on Intelligent Robots and Systems, Yokohama, Japan.
55. Minneman S., and Harrison S., (1996). A Bike in Hand: A Study of 3D Objects in Design. Analyzing Design Activity. Cross N., Christiaans H., and Dorst K., Chichester, J. Wiley.
56. Morita T., Shibuya K., et al.(1998). Design and control of mobile manipulation system for human symbiotic humanoid: Hadaly-2. Proceedings of the 1998 IEEE International Conference on Robotics and Automation. Part 2 (of 4), May 16-20, Leuven, Belgium, IEEE, Piscataway, NJ, USA.
57. Murphy R. R., (2004). Human-robot interaction in rescue robotics. Systems, Man and Cybernetics, Part C, IEEE Transactions on 34 (2): 138-153.
58. NASA (2004). The Vision for Space Exploration: National Aeronautics and Space Administration, http://www.nasa.gov/pdf/55583main-vision-space-exploration2.pdf.
59. Nass C., Steuer J., et al.(1994). Computers are social actors. Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, Apr 24-28, Boston, MA, USA, Publ by ACM, New York, NY, USA.
60. Nourbakhsh I. R., Bobenage J., et al.(1999). Affective mobile robot educator with a full-time job. Artificial Intelligence 114 (1-2): 95-124.
61. Nourbakhsh I. R., Sycara K., et al.(2005). Human-robot teaming for Search and Rescue. IEEE Pervasive Computing 4 (1): 72-77.
62. Ohba K., Kawabata S., et al.(1999). Remote collaboration through time delay in multiple teleoperation. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'99): Human and Environment Friendly Robots with High Intelligence and Emotional Quotients', Oct 17-Oct 21, Kyongju, South Korea, IEEE, Piscataway, NJ, USA.
63. Prince S., Cheok A. D., et al.(2002). 3-D live: Real time interaction for mixed reality. The eight Conference on Computer Supported Cooperative Work (CSCW 2002), Nov 16-20, New Orleans, LA, United States, Association for Computing Machinery.
64. Rani P., Sarkar N., et al.(2004). Anxiety detecting robotic system-Towards implicit human-robot collaboration. Robotica 22 (1): 85-95.
65. Reitmayr G., and Schmalstieg D., (2004). Collaborative Augmented Reality for Outdoor Navigation and Information Browsing. Proc. Symposium Location Based Services and TeleCartography 2004 Geowissenschaftliche Mitteilungen Nr. 66.
66. Roy D., Hsiao K.-Y., et al.(2004). Mental imagery for a conversational robot. Systems, Man and Cybernetics, Part B, IEEE Transactions on 34 (3): 1374-1383.
67. Scholtz J., (2002). Human Robot Interactions: Creating Synergistic Cyber Forces. In Schultz A., and Parker L., eds., Multi-robot Systems: From Swarms to Intelligent Automata, Kluwer.
68. Scholtz J., (2003). Theory and evaluation of human robot interactions. Proceedings of the 36th Annual Hawaii International Conference on System Sciences.
69. Scholtz J., Antonishek B., et al.(2005). A Comparison of Situation Awareness Techniques for Human-Robot Interaction in Urban Search and Rescue. CHI 2005 | alt.chi, April 2-7, Portland, Oregon, USA.
70. Sidner C. L., and Lee C., (2003). Engagement rules for human-robot collaborative interactions. System Security and Assurance, Oct 5-8, Washington, DC, United States, Institute of Electrical and Electronics Engineers Inc.
71. Sidner C. L., and Lee C., (2005). Robots as laboratory hosts. Interactions 12 (2): 24-26.
72. Skubic M., Perzanowski D., et al.(2004). Spatial language for human-robot dialogs. Systems, Man and Cybernetics, Part C, IEEE Transactions on 34 (2): 154-167.
73. Skubic M., Perzanowski D., et al.(2002). Using spatial language in a human-robot dialog. 2002 IEEE International Conference on Robotics and Automation, May 11-15, Washington, DC, United States, Institute of Electrical and Electronics Engineers Inc.
74. Sony (2007). http://www.sony.net/SonyInfo/QRIO/story/index-nf.html.
75. Tenbrink T., Fischer K., et al.(2002). Spatial Strategies in Human-Robot Communication. Korrekturabzug Kuenstliche Intelligenz, Heft 4/02, pp 19-23, ISSN 0933-1875, arendtap Verla, Bemen.
76. Toyota (2007). http://www.toyota.co.jp/en/special/robot/.
77. Tsoukalas L. H., and Bargiotas D. T., (1996). Modeling instructible robots for waste disposal applications. Proceedings of the 1996 IEEE International Joint Symposia on Intelligence and Systems, Nov 4-5, Rockville, MD, USA, IEEE, Los Alamitos, CA, USA.
78. Tversky B., Lee P., et al.(1999). Why do Speakers Mix Perspectives? Spatial Cognition Computing 1: 399-412.
79. Watanuki K., Sakamoto K., et al.(1995). Multimodal interaction in human communication. IEICE Transactions on Information and Systems E78-D (6): 609-615.
80. Yanco H. A., Drury J. L., et al.(2004). Beyond usability evaluation: Analysis of human-robot interaction at a major robotics competition. Human-Computer Interaction Human-Robot Interaction 19 (1-2): 117-149.