Generation of nodding, head tilting and eye gazing for human-robot dialogue interaction

HRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction

Volumn , Issue , 2012, Pages 285-292

  Liu, Chaoran ^a   Ishi, Carlos T ^a   Ishiguro, Hiroshi ^a   Hagita, Norihiro ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

dialogue acts; eye gazing; head motion; motion generation

Indexed keywords

DIALOGUE ACTS; EYE GAZING; HEAD MOTION; HUMAN DIALOGUES; HUMAN-ROBOT DIALOGUE; HUMANOID ROBOT; MOTION GENERATION; PARALINGUISTIC INFORMATION;

ANTHROPOMORPHIC ROBOTS; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION; SPEECH COMMUNICATION;

MAN MACHINE SYSTEMS;

EID: 84859945554     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2157689.2157797     Document Type: Conference Paper

References (19)

1. C.T. Ishi, C. Liu, H. Ishiguro, N. Hagita. 2010. Head motion during dialogue speech and nod timing control in humanoid robots. Proc. of IEEE/RSJ Human Robot Interaction (HRI 2010), 293-300, 2010.
2. C. Sidner, C. Lee, L.-P. Morency, C. Forlines. 2006. The effect of head-nod recognition in human-robot conversation. Proc. of IEEE/RSJ Human Robot Interaction (HRI 2006), pp. 290-296, 2006.
3. L.-P. Morency, C. Sidner, C. Lee, and T. Darrell. 2007. Head gestures for perceptual interfaces: The role of context in improving recognition. Artificial Intelligence, 171(8-9): 568-585, June 2007. (Pubitemid 46828980)
4. H.C. Yehia, T. Kuratate, E. Vatikiotis-Bateson. 2002. Linking facial animation, head motion and speech acoustics. J. of Phonetics, Vol. 30, pp. 555-568, 2002.
5. M.E. Sargin, O. Aran, A. Karpov, F. Ofli, Y. Yasinnik, S. Wilson, E. Erzin, Y. Yemez, A.M. Tekalp. 2006. Combined Gesture-Speech Analysis and Speech Driven Gesture Synthesis. Proc IEEE International Conference on Multimedia, 2006.
6. K.G. Munhall, J.A. Jones, D.E. Callan, T. Kuratate, E. Vatikiotis- Bateson. 2004. Visual prosody and speech intelligibility - Head movement improves auditory speech perception. Psychological Science, Vol. 15, No. 2, pp. 133-137, 2004.
7. H.P. Graf., E. Cosatto, V. Strom, F.J. Huang. 2002. Visual prosody: Facial movements accompanying speech. Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition (FGR'02), 2002.
8. J. Beskow, B. Granstrom, D. House. 2006. Visual correlates to prominence in several expressive modes. Proc. Interspeech 2006 -ICSLP, pp. 1272-1275, 2006.
9. C. Busso, Z. Deng, M. Grimm, U. Neumann, S. Narayanan. 2007. Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis. IEEE Trans. on Audio, Speech and Language Processing, March 2007.
10. Y. Iwano, S. Kageyama, E. Morikawa, S. Nakazato, K. Shirai. 1996. Analysis of head movements and its role in spoken dialogue. Proc. International Conference on Spoken Language Processing (ICSLP'96), pp. 2167-2170, 1996.
11. M.E. Foster and J. Oberlander. 2007. Corpus-based generation of head and eyebrow motion for an embodied conversational agent. Language Resources and Evaluation, 41(3-4), 305-323, Dec. 2007.
12. C.T Ishi, J. Haas, F.P. Wilbers, H. Ishiguro, and N. Hagita. 2007. Analysis of head motions and speech, and head motion control in an android. Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), 548-553, 2007.
13. C.T. Ishi, H. Ishiguro, N. Hagita. 2006. Analysis of prosodic and linguistic cues of phrase finals for turn-taking and dialog acts. Proc. Interspeech'2006 - ICSLP, pp. 2006-2009, 2006.
14. T. Minato, M. Shimada, H. Ishiguro, S. Itakura. 2004. Development of an android robot for studying human-robot interaction. Innovations in Applied Artificial Intelligence, Springer Verlag, pp. 424-434, 2004.
15. M. DeBoer and A. M. Boxer. 1979. Signal functions of infant facial expression and gaze direction during mother-infant face-to-face play. Child Development, vol. 50, no. 4, pp. 1215-1218, 1979.
16. S. R. H. Langton, R. J. Watt, and V. Bruce. 2000. Do the eyes have it? Cues to the direction of social attention. Trends in Cognitive Sciences, vol. 4, no. 2, pp. 50-59, 2000.
17. F. Kaplan and V. Hafner. 2004. The challenges of joint attention. Interaction Studies, pp. 67-74, 2004. [Online]. Available: http://cogprints.org/ 4067/
18. Y. Nagai, M. Asada, and K. Hosoda. 2006. Learning for joint attention helped by functional development. Advanced Robotics, vol. 20, pp. 1165-1181(17), October 2006.
19. C. T. Ishi, C. Liu, H. Ishiguro, N. Hagita. 2011. Speech-driven lip motion generation for tele-operated humanoid robots. International Conference on Auditory-Visual Speech Processing, 2011