Generation of nodding, head tilting and gazing for human-robot speech interaction

International Journal of Humanoid Robotics

Volumn 10, Issue 1, 2013, Pages

  Liu, Chaoran ^a   Ishi, Carlos T ^a   Ishiguro, Hiroshi ^a   Hagita, Norihiro ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

dialogue acts; gazing; Head motion; motion generation

Indexed keywords

DIALOGUE ACTS; GAZING; HEAD MOTION; HUMAN DIALOGUES; HUMANOID ROBOT; MOTION GENERATION; PARALINGUISTIC INFORMATION; SPEECH INTERACTION;

ANTHROPOMORPHIC ROBOTS;

SPEECH COMMUNICATION;

EID: 84880658131     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843613500096     Document Type: Article

References (19)

1. A. G. Brooks and R. C. Arkin, Behavioral overlays for non-verbal communication expression on a humanoid robot, Auton. Robots 22(1) (2007) 55-74.
2. Y. Iwano, S. Kageyama, E. Morikawa, S. Nakazato and K. Shirai, Analysis of head movements and its role in spoken dialogue, Int. Conf. Spoken Language Processing (ICSLP), Philadelphia, USA (1996), pp. 2167-2170.
3. C. Sidner, C. Lee, L.-P. Morency and C. Forlines, The effect of head-nod recognition in human-robot conversation, ACM/IEEE Int. Conf. Human Robot Interaction (HRI) (ACM Press, Salt Lake, USA, 2006), pp. 290-296.
4. L.-P. Morency, C. Sidner, C. Lee and T. Darrell, Head gestures for perceptual interfaces: The role of context in improving recognition, Artif. Intell. 171(8-9) (2007) 568-585.
5. H. P. Graf, E. Cosatto, V. Strom and F. J. Huang, Visual prosody: Facial movements accompanying speech, IEEE Int. Conf. Automatic Face and Gesture Recognition (FGR) (IEEE Press, Washington, USA, 2002), pp. 381-386.
6. C. Busso, Z. Deng, M. Grimm, U. Neumann and S. Narayanan, Rigid head motion in expressive speech animation: Analysis and synthesis, IEEE Trans. Audio, Speech Lang. Process. 15(3) (2007) 1075-1086.
7. M. E. Sargin, O. Aran, A. Karpov, F. O°i, Y. Yasinnik, S. Wilson, E. Erzin, Y. Yemez and A. M. Tekalp, Combined gesture-speech analysis and speech driven gesture synthesis, IEEE Int. Conf. Multimedia and Expo (ICME) (IEEE Press, Toronto, Canada, 2006), pp. 893-896.
8. K. G. Munhall, J. A. Jones, D. E. Callan, T. Kuratate and E. Vatikiotis-Bateson, Visual prosody and speech intelligibility - Head movement improves auditory speech perception, Psychol. Sci. 15(2) (2004) 133-137.
9. J. Beskow, B. Granstrom and D. House, Visual correlates to prominence in several expressive modes, in Interspeech (ICSLP), Pittsburgh, USA (2006), pp. 1272-1275.
10. H. C. Yehia, T. Kuratate and E. Vatikiotis-Bateson, Linking facial animation, head motion and speech acoustics, J. Phonetics 30 (2002) 555-568.
11. M. E. Foster and J. Oberlander, Corpus-based generation of head and eyebrow motion for an embodied conversational agent, Lang. Resour. Eval. 41(3-4) (2007) 305-323.
12. C. T. Ishi, C. Liu, H. Ishiguro and N. Hagita, Head motion during dialogue speech and nod timing control in humanoid robots, ACM/IEEE Int. Conf. Human Robot Interaction (HRI) (ACM Press, Osaka, Japan, 2010), pp. 293-300.
13. C. T. Ishi, H. Ishiguro and N. Hagita, Analysis of prosodic and linguistic cues of phrase finals for turn-taking and dialog acts, in Interspeech (ICSLP), Pittsburgh, USA (2006), pp. 2006-2009.
14. C. T. Ishi, J. Haas, F. P. Wilbers, H. Ishiguro and N. Hagita, Analysis of head motions and speech, and head motion control in an android, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS) (IEEE Press, San Diego, USA, 2007), pp. 548-553.
15. M. DeBoer and A. M. Boxer, Signal functions of infant facial expression and gaze direction during mother-infant face-to-face play, Child Dev. 50(4) (1979) 1215-1218.
16. S. R. H. Langton, R. J. Watt and V. Bruce, Do the eyes have it? Cues to the direction of social attention, Trends Cognit. Sci. 4(2) (2000) 50-59.
17. F. Kaplan and V. Hafner, The challenges of joint attention, Interact. Stud. 7(2) (2006) 135-169.
18. Y. Nagai, M. Asada and K. Hosoda, Learning for joint attention helped by functional development, Adv. Robot. 20(10) (2006) 1165-1181.
19. C. T. Ishi, C. Liu, H. Ishiguro and N. Hagita, Speech-driven lip motion generation for teleoperated humanoid robots, The 11th Int. Conf. Auditory-Visual Speech Processing (AVSP), Volterra, Italy (2011), pp. 131-135.