Human-recognizable robotic gestures

IEEE Transactions on Autonomous Mental Development

Volumn 4, Issue 4, 2012, Pages 305-314

  Cabibihan, John John ^a   So, Wing Chee ^b   Pramanik, Soumo ^a,c  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c NONE

Author keywords

Emblematic gestures; human robot interaction; humanoid robots; iconic gestures; robot gestures; social robotics

Indexed keywords

ANIMAL BEHAVIOR; EMBLEMATIC GESTURES; HUMAN ACTIVITIES; HUMAN OBSERVERS; HUMANOID ROBOT; ICONIC GESTURES; SOCIAL ROBOTICS; SOCIAL ROBOTS;

ANTHROPOMORPHIC ROBOTS; ROBOTICS;

BEHAVIORAL RESEARCH;

EID: 84871082629     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2012.2208962     Document Type: Article

References (104)

1. T. Fong, I. Nourbakhsh, and K. Dautenhahn, "A survey of socially interactive robots," Robot. Auton. Syst., vol. 42, pp. 143-166, 2003.
2. C. Breazeal, "Toward sociable robots," Robot. Auton. Syst., vol. 42, pp. 167-175, 2003.
3. F. Tanaka, A. Cicourel, and J. R. Movellan, "Socialization between toddlers and robots at an early childhood education center," in Proc. NAS, 2007, vol. 104, pp. 17954-17958. (Pubitemid 350210803)
4. K. Severinson-Eklundh, A. Green, and H. Hüttenrauch, "Social and collaborative aspects of interaction with a service robot," Robot. Auton. Syst., vol. 42, pp. 223-234, 2003.
5. Y. Nakauchi and R. Simmons, "A social robot that stands in line," Auton. Robots, vol. 12, pp. 313-324, 2002. (Pubitemid 34573245)
6. M. Malfaz, A. Castro-González, R. Barber, andM. A. Salichs, "A biologically inspired architecture for an autonomous and social robot," IEEE Trans. Auton. Mental Develop., vol. 3, pp. 232-246, 2011.
7. T. Shibata and K. Wada, "Robot therapy: A new approach for mental healthcare of the elderly-A mini-review," Gerontol., vol. 57, pp. 378-386, 2011.
8. K. Dautenhahn, "Socially intelligent robots: Dimensions of humanrobot interaction," Philosophical Trans. Royal Soc. B: Biol. Sci., vol. 362, pp. 679-704, 2007. (Pubitemid 47056835)
9. H. Kozima, C. Nakagawa, and Y. Yasuda, "Children-robot interaction: A pilot study in autism therapy," Progress Brain Res., vol. 164, pp. 385-400, 2007. (Pubitemid 47494705)
10. S. S. Ge, "Social robotics: Integrating advances in engineering and computer science (keynote speech)," in Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI). Chang Rai, Thailand: Mae Fah Luang Univ., 2007.
11. H. Li, J. J. Cabibihan, and Y. K. Tan, "Towards an effective design of social robots," Int. J. Soc. Robot., vol. 3, pp. 333-335, 2011.
12. S. Coradeschi, H. Ishiguro, M. Asada, S. C. Shapiro, M. Thielscher, C. Breazeal,M. J.Mataric, and H. Ishida, "Human-inspired robots," IEEE Intell. Syst., vol. 21, pp. 74-85, 2006.
13. H. Ishiguro, "Android science: Conscious and subconscious recognition," Connect. Sci., vol. 18, pp. 319-332, 2006. (Pubitemid 44673520)
14. A. Cangelosi, G. Metta, G. Sagerer, S. Nolfi, C. Nehaniv, K. Fischer, J. Tani, T. Belpaeme, G. Sandini, F. Nori, L. Fadiga, B. Wrede, K. Rohlfing, E. Tuci, K. Dautenhahn, J. Saunders, and A. Zeschel, "Integration of action and language knowledge: A roadmap for developmental robotics," IEEE Trans. Auton. Mental Develop., vol. 2, pp. 167-195, 2010.
15. Y. Sakagami, R.Watanabe, C. Aoyama, S. Matsunaga, N. Higaki, and K. Fujimura, "The intelligent ASIMO: System overview and integration," in IEEE Int. Conf. Intell. Robots Syst., 2002, pp. 2478-2483. (Pubitemid 35438181)
16. E. Sato, T. Yamaguchi, and F. Harashima, "Natural interface using pointing behavior for human-robot gestural interaction," IEEE Trans. Ind. Electron., vol. 54, pp. 1105-1112, 2007. (Pubitemid 46591030)
17. C. L. Sidner, C. Lee, C. D. Kidd, N. Lesh, and C. Rich, "Explorations in engagement for humans and robots," Artif. Intell., vol. 166, pp. 140-164, 2005. (Pubitemid 40915124)
18. S. Waldherr, R. Romero, and S. Thrun, "Gesture based interface for human-robot interaction," Auton. Robots, vol. 9, pp. 151-173, 2000.
19. P. Andry, A. Blanchard, and P. Gaussier, "Using the rhythm of nonverbal human-robot interaction as a signal for learning," IEEE Trans. Auton. Mental Develop., vol. 3, pp. 30-42, 2011.
20. A. Yorita and N. Kubota, "Cognitive development in partner robots for information support to elderly people," IEEE Trans. Auton. Mental Develop., vol. 3, pp. 64-73, 2011.
21. C. Breazeal and B. Scassellati, "Robots that imitate humans," Trends Cognit. Sci., vol. 6, pp. 481-487, 2002. (Pubitemid 35341852)
22. R. M. Voyles, J. D.Morrow, and P. K. Khosla, "Towards gesture-based programming: Shape from motion primordial learning of sensorimotor primitives," Robot. Auton. Syst., vol. 22, pp. 361-375, 1997. (Pubitemid 127398219)
23. R. Dillmann, "Teaching and learning of robot tasks via observation of human performance," Robot. Auton. Syst., vol. 47, pp. 109-116, 2004.
24. D. Lee, C. Ott, and Y. Nakamura, "Mimetic communication model with compliant physical contact in human-humanoid interaction," Int. J. Robot. Res., vol. 29, pp. 1684-1704, 2010.
25. M. Hersch, F. Guenter, S. Calinon, and A. Billard, "Dynamical system modulation for robot learning via kinesthetic demonstrations," IEEE Trans. Robot., vol. 24, pp. 1463-1467, 2008.
26. S. Calinon and A. Billard, "Incremental learning of gestures by imitation in a humanoid robot," in Proc. ACM/IEEE Conf. Human-Robot Interaction-Robot as Team Member, 2007, pp. 255-262. (Pubitemid 47327150)
27. S. Calinon, F. D'Halluin, E. L. Sauser, D. G. Caldwell, and A. G. Billard, "Learning and reproduction of gestures by imitation," IEEE Robot. Autom. Mag., vol. 17, pp. 44-54, Jun. 2010.
28. J. J. Cabibihan, W. C. So, S. Saj, and Z. Zhang, "Telerobotic pointing gestures shape human spatial cognition," Int. J. Soc. Robot., vol. 4, pp. 263-272, 2012.
29. T. Kanda, M. Kamasima, M. Imai, T. Ono, D. Sakamoto, H. Ishiguro, and Y. Anzai, "A humanoid robot that pretends to listen to route guidance from a human," Auton. Robots, vol. 22, pp. 87-100, 2007. (Pubitemid 46372474)
30. L. M. Oberman, J. P. McCleery, V. S. Ramachandran, and J. A. Pineda, "EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots," Neurocomput., vol. 70, pp. 2194-2203, 2007. (Pubitemid 46825367)
31. D. McNeill, "Iconic gestures of children and adults," Semiotica, vol. 62, pp. 107-128, 1986.
32. F. Bacon, The Advancement of Learning, Book 2. London: Oxford Univ. Press, 1891.
33. S. Duncan, L. Brunner, and D. Fiske, "Strategy signals in face-to-face interaction," J. Personal. Soc. Psychol., vol. 37, pp. 301-313, 1979.
34. S. Duncan and G. Niederehe, "On signalling that it's your turn to speak," J. Exp. Soc. Psychol., vol. 10, pp. 234-247, 1974.
35. S. Duncan, "Some signals and rules for taking speaking turns in conversations," J. Personal. Soc. Psychol., vol. 23, pp. 283-292, 1972.
36. A. Kendon, "Some functions of gaze-direction in social interaction," Acta Psychologica, vol. 26, pp. 22-63, 1967.
37. D. J. Schneider, A. H. Hastorf, and P. C. Ellesworth, Person Perception, 2nd ed. Menlo Park, CA: Addison-Wesley, 1979.
38. L. Tickle-Degnen and R. Rosenthal, "The nature of rapport and its nonverbal correlates," Psychol. Inquiry, vol. 1, pp. 285-293, 1990.
39. M. Knapp and J. Hall, Nonverbal Communication in Human Interaction, 4th ed. Fort Worth, TX: Harcourt Brace College, 1997.
40. J. K. Burgoon, "Nonverbal signals," in Handbook of Interpersonal Communication, M. L. Knapp and G. R. Miller, Eds., 2nd ed. Thousand Oaks, CA: Sage, 1994, pp. 229-285.
41. T. Kito and B. Lee, "Interpersonal perception in Japanese and British observers," Perception, vol. 33, pp. 957-974, 2004. (Pubitemid 39427607)
42. W. Wundt, Volkerpsychologie. Eine Untersuchung der Entwicklungsgesetze von Sprache Mythus und Zitte, 4th ed. Stuttgart, Germany: Kröner, 1921, vol. 1.
43. G. H. Mead, Mind, Self and Society From the Standpoint of a Social Behaviorist. Chicago: Univ. Chicago Press, 1934.
44. P. Feyereisen and J.D. de Lannoy,Gestures and Speech: Psychological Investigations. New York: Cambridge Univ. Press, 1991.
45. R. M. Krauss, "Why do we gesture when we speak?," Current Direct. Psychol. Sci., vol. 7, pp. 54-59, 1998. (Pubitemid 128163547)
46. A. Kendon, "Gesture and speech: How they interact," in Nonverbal Interaction, J. M. Weimann and R. P. Harrison, Eds. Beverly Hills, CA: Sage, 1983.
47. A. A. Cohen, "The communicative functions of hand illustrators," J. Commun., vol. 27, pp. 54-63, 1977.
48. J. P. de Ruiter, "Can gesticulation help aphasic people speak, or rather, communicate?," Adv. Speech-Lang. Pathol., vol. 8, pp. 124-127, 2006.
49. J. J. Cabibihan, W. Yusson, S. Salehi, and S. S. Ge, "Minimal set of recognizable gestures for a 10 DOF anthropomorphic robot," in Social Robotics, S. S. Ge,H. Li, J. J.Cabibihan, andY.K. Tan, Eds. Berlin/ Heidelberg: Springer, 2010, vol. 6414, pp. 63-70.
50. A. P. Atkinson, M. L. Tunstall, and W. H. Dittrich, "Evidence for distinct contributions of form and motion information to the recognition of emotions frombody gestures," Cognition, vol. 104, pp. 59-72, 2007. (Pubitemid 46627560)
51. F. E. Pollick, H. M. Paterson, A. Bruderlin, and A. J. Sanford, "Perceiving affect from arm movement," Cognition, vol. 82, pp. B51-B61, 2001. (Pubitemid 33041320)
52. W. D. Goh, S. Lidia,M. J. Yap, and S. H. Tan, "Distributional analyses in auditory lexical decision: Neighborhood density and word-frequency effects," Psychonomic Bulletin Rev., vol. 16, pp. 882-887, 2009.
53. D. F. Yap, W. C. So, J. M. Yap, Y. Q. Tan, and R. L. Teoh, "Iconic gestures prime words," Cognit. Sci., vol. 35, pp. 171-183, 2011.
54. J. N. Bailenson, A. C. Beall, and J. Blascovich, "Gaze and task performance in shared virtual environments," J. Visual. Comput. Animat., vol. 13, pp. 313-320, 2002. (Pubitemid 135714462)
55. D. Heylen, "Head gestures, gaze and the principles of conversational structure," Int. J. Human. Robot., vol. 3, pp. 241-267, 2006. (Pubitemid 44604950)
56. A. Kendon, "Some uses of the head shake," Gesture, vol. 2, pp. 147-182, 2002.
57. E. Z. McClave, "Linguistic functions of head movements in the context of speech," J. Pragmat., vol. 32, pp. 855-878, 2000.
58. J. D.Matarazzo, G. Saslow, A. N.Wiens, M.Weitman, and B. V. Allen, "Interviewer head nodding and interviewee speech durations," Psychotherapy: Theory, Res. Practice, vol. 1, pp. 54-63, 1964.
59. W. S. Condon and L.W. Sander, "Neonate movement is synchronized with adult speech: Interactional participation and language acquisition," Science, vol. 183, pp. 99-101, 1974.
60. N. Kobayashi, T. Ishii, and T. Watanabe, "Quantitative evaluation of infant behaviour and mother-infant interaction," Early Develop. Parent., vol. 1, pp. 23-31, 1992.
61. C. L. Sidner, C. Lee, L. P. Morency, and C. Forlines, "The effect of head-nod recognition in human-robot conversation," in Proc. ACM Conf. Human-Robot Interact., 2006, pp. 290-296. (Pubitemid 44032419)
62. L. D. Riek, P. C. Paul, and P. Robinson, "When my robot smiles at me: Enabling human-robot rapport via real-time head gesture mimicry," J. Multimodal User Interfaces, vol. 3, pp. 99-108, 2010.
63. Z. Neda, E. Ravasz, Y. Brechet, T. Vicsek, and A. L. Barabasi, "The sound of many hands clapping," Nature, vol. 403, pp. 849-850, 2000. (Pubitemid 30130975)
64. A. Diaf, R. Benlamri, B. Boufama, and R. Ksantini, "A novel eigenspace-based method for human action recognition," in Proc. 5th Int. Conf. Digit. Inf. Manag., 2010, pp. 182-187.
65. H. G. Kim, S. Roeber, A. Samour, and T. Sikora, "Detection of goal event in soccer videos," in Proc. SPIE-Int. Soc. Opti. Eng., 2005, pp. 317-325. (Pubitemid 40952957)
66. S. Danafar and N. Gheissari, "Action recognition for surveillance applications using optic flow and SVM," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2007, vol. 4844, LNCS, pp. 457-466.
67. S. Sempena, N. U. Maulidevi, and P. R. Aryan, "Human action recognition using dynamic time warping," in Proc. ICEEI, 2011.
68. S. Singh and J. Wang, "Human activity recognition in videos: A systematic approach," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2006, vol. 4224, LNCS, pp. 257-264. (Pubitemid 44670379)
69. S. R. Poss, C. Kuhar, T. S. Stoinski, and W. D. Hopkins, "Differential use of attentional and visual communicative signaling by orangutans (Pongo pygmaeus) and gorillas (Gorilla gorilla) in response to the attentional status of a human," Amer. J. Primatology, vol. 68, pp. 978-992, 2006. (Pubitemid 44510726)
70. A.W. Fletcher, "Clapping in chimpanzees: Evidence of exclusive hand preference in a spontaneous, bimanual gesture," Amer. J. Primatology, vol. 68, pp. 1081-1088, 2006. (Pubitemid 44759517)
71. A. S. Pollick and F. B. M. De Waal, "Ape gestures and language evolution," in Proc. NAS, 2007, vol. 104, pp. 8184-8189. (Pubitemid 47185896)
72. A. K. Kalan and H. J. Rainey, "Hand-clapping as a communicative gesture by wild female swamp gorillas," Primates, vol. 50, pp. 273-275, 2009.
73. J. M. Fay, "Hand-clapping in western low land gorillas," Mammalia, vol. 53, pp. 457-458, 1989.
74. K. Hanahara and Y. Tada, "Human-robot communication with handclapping language," J. Comput., vol. 3, pp. 58-66, 2008.
75. P. Ekman, "Lying and nonverbal behavior: Theoretical issues and new findings," J. Nonverbal Behav., vol. 12, pp. 163-175, 1988.
76. A. W. Siegman and S. Feldstein, Nonverbal Behavior and Communication. Hillsdale, NJ: Erlbaum, 1987.
77. J. J. Cabibihan, S. Pattofatto, M. Jomaa, A. Benallal, and M. C. Carrozza, "Towards humanlike social touch for sociable robotics and prosthetics: Comparisons on the compliance, conformance and hysteresis of synthetic and human fingertip skins," Int. J. Soc. Robot., vol. 1, pp. 29-40, 2009.
78. J. S. Carton and E. E. R. Carton, "Nonverbal maternal warmth and children's locus of control of reinforcement," J. Nonverbal Behav., vol. 22, pp. 77-86, 1998.
79. J. S. Carton and S. Nowicki Jr., "Antecedents of individual differences in locus of control of reinforcement: A critical review," Genet. Soc. Gen. Psychol. Monographs, vol. 120, pp. 31-81, 1994.
80. J. S. Carton and S. Nowicki, Jr, "Origins of generalized control expectancies: Reported child stress and observed maternal control and warmth," J. Soc. Psychol., vol. 136, pp. 753-760, 1996. (Pubitemid 126420941)
81. M. Kosfeld, M. Heinrichs, P. J. Zak, U. Fischbacher, and E. Fehr, "Oxytocin increases trust in humans," Nature, vol. 435, pp. 673-676, 2005. (Pubitemid 40825511)
82. P. J. Zak, A. A. Stanton, and S. Ahmadi, "Oxytocin increases generosity in humans," PLoS ONE, vol. 2, 2007.
83. S. S. Ge, J. J. Cabibihan, Z. Zhang, Y. Li, C. Meng, H. He, M. R. Safizadeh, Y. B. Li, and J. Yang, "Design and development of Nancy, a social robot," in Proc. 8th Int. Conf. Ubiquitous Robots Ambient Intell., Incheon, Korea, 2011, pp. 568-573.
84. Y. Li, S. S. Ge, C. Yang, and K. P. Tee, "Model-free impedance control for safe human-robot interaction," in Proc. IEEE Int. Conf. Robot. Automat., Shanghai, China, 2011, pp. 6021-6026.
85. Y. Li, S. S. Ge, and C. Yang, "Impedance control for multi-point human-robot interaction," in Proc. 8th Asian Control Conf., 2011, pp. 1187-1192.
86. J. J. Cabibihan, R. Pradipta, and S. S. Ge, "Prosthetic finger phalanges with lifelike skin compliance for low-force social touching interactions," J. NeuroEng. Rehabil., vol. 8, p. 16, 2011.
87. J. J. Cabibihan, R. Pradipta, Y. Z. Chew, and S. S. Ge, "Towards humanlike social touch for prosthetics and sociable robotics: Handshake experiments and finger phalange indentations," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2009, vol. 5744, LNCS, pp. 73-79.
88. J. J. Cabibihan, I. Ahmed, and S. S. Ge, "Force and motion analyses of the human patting gesture for robotic social touching," in Proc. IEEE Cybernet. Intell. Syst. Robot. Automat. Mechatronics, Qingdao, China, 2011, pp. 165-169.
89. S. L. Videbeck, Psychiatric Mental Health Nursing, 5th ed. New York: Lippincott Williams & Wilkins, 2010.
90. J. Hirth, N. Schmitz, and K. Berns, "Towards social robots: Designing a emotion-based architecture," Int. J. Soc. Robot., vol. 3, pp. 273-290, 2011.
91. T. Chaminade, M. Zecca, S. J. Blakemore, A. Takanishi, C. D. Frith, S. Micera, P. Dario, G. Rizzolatti, V. Gallese, and M. A. Umilta, "Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures," PLoS ONE, vol. 5, 2010.
92. P. Ekman, "Facial expression and emotion," Amer. Psychologist, vol. 48, pp. 384-392, 1993.
93. H. Ishiguro, "Scientific issues concerning androids," Int. J. Robot. Res., vol. 26, pp. 105-117, 2007. (Pubitemid 44975090)
94. S. Collins, A. Ruina, R. Tedrake, and M. Wisse, "Efficient bipedal robots based on passive-dynamic walkers," Science, vol. 307, pp. 1082-1085, 2005. (Pubitemid 40262108)
95. M. M. Gross, E. A. Crane, and B. L. Fredrickson, "Effort-shape and kinematic assessment of bodily expression of emotion during gait," Human Movement Sci., pp. 202-221, 2011.
96. M. P. Kadaba, H. K. Ramakrishnan, andM. E.Wootten, "Measurement of lower extremity kinematics during level walking," J. Orthopaedic Res., vol. 8, pp. 383-392, 1990. (Pubitemid 20250861)
97. A. Koenig, X. Omlin, L. Zimmerli, M. Sapa, C. Krewer, M. Bolliger, F.Muller, and R. Riener, "Psychological state estimation from physiological recordings during robot-assisted gait rehabilitation," J. Rehabil. Res. Develop., vol. 48, pp. 367-385, 2011.
98. K. M. Naugle, J. Joyner,C. J.Hass, and C.M. Janelle, "Emotional influences on locomotor behavior," J. Biomechan., vol. 43, pp. 3099-3103, 2011.
99. M. D. Cooney, C. Becker-Asano, T. Kanda, A. Alissandrakis, and H. Ishiguro, "Full-body gesture recognition using inertial sensors for playful interaction with small humanoid robot," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2010, pp. 2276-2282.
100. B. Mutlu, J. Forlizzi, and J. Hodgins, "A storytelling robot: Modeling and evaluation of human-like gaze behavior," in Proc. 6th IEEE-RAS Int. Conf. Humanoid Robots, Humanoids, 2006, pp. 518-523.
101. C. A. Pesola, "Culture in the elementary foreign language classroom," Foreign Lang. Annals, vol. 24, pp. 331-346, 1991.
102. J. Han, M. Jo, S. Park, and S. Kim, "The educational use of Home Robots for children," in Proc. IEEE Int. Workshop Robot Human Interact. Commun., 2005, pp. 378-383. (Pubitemid 44144411)
103. T. Kanda, T. Hirano, D. Eaton, and H. Ishiguro, "Interactive robots as social partners and peer tutors for children: A field trial," Human- Comput. Interact., vol. 19, pp. 61-84, 2004.
104. C. F. Shih, C. W. Chang, and G. D. Chen, "Robot as a storytelling partner in the english classroom-Preliminary discussion," in Proc. 7th IEEE Int. Conf. Adv. Learn. Technol., 2007, pp. 678-682.