Generation of humanoid robot's facial expressions for context-aware communication

International Journal of Humanoid Robotics

Volumn 10, Issue 1, 2013, Pages

  Trovato, Gabriele ^a   Zecca, Massimiliano ^a   Kishi, Tatsuhiro ^a   Endo, Nobutsuna ^a   Hashimoto, Kenji ^a   Takanishi, Atsuo ^a  

^a WASEDA UNIVERSITY   (Japan)

Author keywords

emotion recognition; Facial expressions; humanoid robotics

Indexed keywords

COMMUNICATION ACT; CONTEXT-AWARE COMMUNICATIONS; EMOTION RECOGNITION; FACIAL EXPRESSIONS; HUMAN COMMUNICATIONS; HUMANOID ROBOTICS; NATURAL INTERACTIONS; NON-VERBAL COMMUNICATIONS;

ANTHROPOMORPHIC ROBOTS; FACE RECOGNITION; ROBOTICS;

COMMUNICATION;

EID: 84880661761     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843613500138     Document Type: Article

References (53)

1. M. Argyle and P. Trower, Person to Person: Ways of Communicating (Harper and Row, 1980).
2. M. Knapp, Essentials of Nonverbal Communication (Holt, Rinehart and Winston, New York, 1980).
3. A. Mehrabian and M. Wiener, Decoding of inconsistent communications, J. Pers. Soc. Psychol. 6(1) (1967) 109-114.
4. T. Kishi, T. Otani, N. Endo, P. Kryczka, K. Hashimoto, K. Nakata and A. Takanishi, Development of expressive robotic head for bipedal humanoid robot with wide moveable range of facial parts and facial color, in Proc. 19th CISMIFToMM Symp. Robot Design, Dynamics, and Control (2012).
5. A. Mehrabian and J. Firar, Encoding of attitude by a seated communicator via posture and position cues, J. Consult. Clin. Psychol. 33(3) (1969) 330-336.
6. M. L. Patterson, J. L. Powell and M. G. Lenihan, Touch, compliance and interpersonal affect, J. Nonverbal Behav. 10(1) (1986) 41-50.
7. A. Mehrabian, Silent Messages, 1st edn. (Wadsworth Publishing Company, 1971).
8. I. Poggi and C. Pelachaud, Signals and meanings of gaze in animated faces, Language, Vision and Music: Selected Papers from the 8th Int. Workshop on the Cognitive Science of Natural Language Processing (John Benjamins, 2002), pp. 133-144.
9. C. Pelachaud and I. Poggi, Subtleties of facial expressions in embodied agents, J. Visualization Comput. Animation (Special Issue on Graphical Autonomous Virtual Humans) 13(5) (2002) 301-312.
10. V. Vinayagamoorthy, M. Gilles, A. Steed, E. Tanguy, X. Pan, C. Loscos and M. Slater, Building expression into virtual characters, Eurographics Conf. State of the Art Reports (Goldsmiths Research Online, Vienna, 2006).
11. M. Argyle, Bodily Communication, 2nd edn. (Methuen & Co Ltd, 1998).
12. J. Cassell, C. Pelachaud, N. I. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost and M. Stone, Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents, in Proc. SIGGRAPH (1994).
13. S. Duck, Human Relationships, 3rd edn. (SAGE, 1998).
14. S. R. Fussell, The Verbal Communication of Emotions: Interdisciplinary Perspectives (Lawrence Erlbaum Associates, 2002).
15. S. Marcos, J. Gomez-Garcia-Bermejo and E. Zalama, A realistic, virtual head for humancomputer interaction, Interacting Comput. 22 (2010) 176-192.
16. S. Marcos, J. Gomez-Garcia-Bermejo, E. Zalama and J. Lopez, Nonverbal communication with a multimodal agent via facial expression recognition, IEEE Int. Conf. Robotics and Automation (2011), pp. 1199-1204.
17. J. Cassell et al., MACK: Media lab autonomous conversational kiosk, in Proc. Imagina '02, Monte Carlo (2002).
18. T. W. Bickmore, Relational agents: Effecting change through human-computer relationships, Ph.D. thesis, Massachusetts Institute of Technology (2003).
19. J. Bates, The role of emotion in believable agents, Commun. ACM Special Issue on Agents (1994).
20. R. G. Harper, A. N. Weins and J. D. Marrazzo, Non Verbal Communication: The State of the Art (John Wiley & Sons, New York, 1978).
21. S. Weitz, Nonverbal communication: Readings with Commentary (Oxford University Press, New York, 1974).
22. H. Aviezer, R. R. Hasshin, J. Ryan, C. Grady, J. Susskind, A. Anderson, M. Moscovitch and S. Bentin, Angry, disgusted, or afraid? Studies on the malleability of emotion perception, Psychol. Sci. 19 (2008) 724.
23. R. J. Dolan, J. S. Morris and B. de Gelder, Crossmodal binding of fear and voice in face, Proc. Nat. Acad. Sci. U.S.A. 98 (2000) 10006-10010.
24. G. Poutois, B. de Gelder, A. Bol and M. Crommelinck, Perception of facial expressions and voices and of their combinations in the human brain, Cortex 41 (2005) 49-59.
25. B. de Gelder and J. Van der Stock, Real faces, real emotions: Perceiving facial expressions in naturalistic contexts of voices, bodies and scenes, in The Handbook of Face Perception (Oxford University Press, USA, 2011), pp. 535-550.
26. H. R. Knudsen and L. H. Muzekari, The effects of verbal statements of context on facial expressions of emotion, J. Nonverbal Behav. 7 (1983) 202-212.
27. D. W. Massaro and P. B. Egan, Perceiving affect from the voice and the face, Psychonomic Bull. Rev. 3(2) (1996) 215-221.
28. R. Birdwhistell, Kinesics and Context (University of Pennsylvania Press, Philadelphia, 1970).
29. R. Beira, M. Lopes, M. Praaa, J. Santos-Victor, A. Bernardino, G. Metta, F. Becchi and R. J. Saltarn, Design of the robot-cub (iCub) head, IEEE Int. Conf. Robotics and Automation (ICRA) (2006), pp. 94-100.
30. J. H. Oh, D. Hanson, W. S. Kim, I. Y. Han, J. Y. Kim and I. W. Park, Design of android type humanoid robot albert HUBO, in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (2006).
31. H. Miwa, T. Okuchi, H. Takanobu and A. Takanishi, Development of a new human-like head robot WE-4, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (2002), pp. 2443-2448.
32. N. Endo and A. Takanishi, Development of whole-body emotional expression humanoid robot for ADL-assistive RT services, J. Robot. Mechatronics 23(6) (2011).
33. C. Breazeal, Emotion and sociable humanoid robots, Int. J. Hum. Comput. Interact. 59 (2002) 119-155.
34. A. Beck, A. Hiolle, A. Mazel and L. Caamero, Interpretation of emotional body language displayed by robots, in Proc. 3rd Int. Workshop on Affective Interaction in Natural Environments (2010).
35. K. Itoh, H. Miwa, M. Zecca, H. Takanobu, S. Roccella, M. C. Carrozza, P. Dario and A. Takanishi, Mechanical design of emotion expression humanoid robot WE-4RII, 16th CISM-IFToMM Symp. Robot Design, Dynamics and Control (2006), pp. 255-262.
36. Y. Ogura, H. Aikawa, K. Shimomura, H. Kondo, A. Morishima, H. Lim and A. Takanishi, Development of a new humanoid robot WABIAN-2, I, in Proc. IEEE Int. Conf. Robotics and Automation (2006), pp. 76-81.
37. P. Ekman, W. V. Friesen and J. C. Hager, The Facial Action Coding System, 2nd edn. (Weidenfeld & Nicolson, London, 2002).
38. J. C. Hager and P. Ekman, The inner and outer meanings of facial expressions, in J. Social Psychophysiology: A Sourcebook eds. T. Cacioppo and R. E. Petty (Guilford, New York, 1983).
39. N. Stoiber, R. Seguier and G. Breton, Facial animation retargeting and control based on a human appearance space, Comput. Animation Virtual Worlds 21 (2010) 39-54.
40. J. Saldien, K. Goris, B. Vanderborght, J. Vanderfaeillie and D. Lefeber, Expressing emotions with the social robot probo, Int. J. Soc. Robot. 2 (2010) 377-389.
41. T. Ribeiro and A. Paiva, The illusion of robotic life: Principles and practices of animation for robots, in Proc. Seventh Annual ACM/IEEE Int. Conf. Human-Robot Interaction (2012).
42. I. Poggi, The lexicon of the conductor's face, in CSNLP-8 (Cognitive Science and Natural Language Processing), Proc. Workshop on \Language, Vision and Music," ed. P. McKevitt (1999), pp. 67-54.
43. I. Poggi, Towards the Alphabet and the lexicon of gesture, gaze and touch, in Multimodality of Human Communication. Theories, Problems and Applications, Virtual Symp. ed. P. Bouissac (2001-2002).
44. I. Poggi, Le parole del corpo (Carrocci, Roma, 2006) (in Italian).
45. H. Kobayashi, Y. Ichikawa, M. Senda and T. Shiba, Toward rich facial expression by face robot, IEEE Int. Symp. Micromechatronics and Human Science (2002).
46. C. A. Smith and H. S. Scott, A componential approach to the meaning of facial expressions, in The Psychololgy of Facial Expression, eds. J. Russell and J. Fernandez- Dols (Cambridge University Press, Cambridge, UK, 1997), pp. 229-254.
47. D. L. Bimler and G. V. Paramei, Facial-expression affective attributes and their configural correlates: Components and categories, Spanish J. Psychol. 9(1) (2009) 19-31.
48. I. Poggi and C. Pelachaud, Performative facial expressions in animated faces, in Embodied Conversational Agents, eds. J. Cassell, J. Sullivan, S. Prevost and E. Churchill (MIT press, Cambridge, 2000).
49. R. Plutchik, Emotions and Life: Perspectives from Psychology, Biology, and Evolution (American Psychological Association, Washington, DC, 2002).
50. E. Douglas-Cowie et al., HUMAINE project, Mid Term Report on Database Exemplar Progress, Available at: http://emotion-research.net/projects/humaine/ deliverables/D5g bibitemb20final.pdf.
51. S. Raudys and R. P. W. Duin, On expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix, Pattern Recogn. Lett. 19(5-6) (1998) 385-392.
52. G. Trovato, T. Kishi, N. Endo, K. Hashimoto and A. Takanishi, A development of facial expressions generator for emotion expressive humanoid robot, in IEEE-RAS Int. Conf. Humanoid Robots, Osaka, Japan, November 2012.
53. G. Trovato, T. Kishi, N. Endo, K. Hashimoto and A. Takanishi, A cross-cultural study on generation of culture dependent facial expressions of humanoid social robot, Int. Conf. Social Robotics, Chengdu, China, October 2012.