Synchronized gesture and speech production for humanoid robots

IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings

Volumn , Issue , 2010, Pages 4617-4624

  Ng Thow Hing, Victor ^a   Luo, Pengcheng ^b   Okita, Sandra ^c  

^a HONDA RESEARCH INSTITUTE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMANOID ROBOT; PART-OF-SPEECH TAGGER; SPEECH PRODUCTION; SPEECH SYNCHRONIZATION; SPOKEN WORDS; TEXT-TO-SPEECH ENGINES; TIMING INFORMATION; TRAJECTORY TRACKING; WHOLE BODY;

ANTHROPOMORPHIC ROBOTS; OBSERVABILITY; SPEECH; SYNCHRONIZATION;

INTELLIGENT ROBOTS;

EID: 78651495982     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2010.5654322     Document Type: Conference Paper

References (26)

1. Andrew G. Brooks. Working with robots and objects: Revisiting deictic reference for achieving spatial common ground. In In Proceedings of Human-Robot Interaction, pages 297-304, 2006.
2. Justine Cassell, Hannes Högni Vilhjálmsson, and Timothy Bickmore. Beat: the behavior expression animation toolkit. In SIGGRAPH 2001: Proceedings of ACM SIGGRAPH, pages 477-486, New York, NY, USA, 2001. ACM.
3. D. Chi, M. Costa, L. Zhao, and N. Badler. The emote model for effort and shape. In SIGGRAPH 2000: Proceedings of ACM SIGGRAPH, pages 173-182, 2000.
4. B. Hartmann, M. Mancini, and C. Pelachaud. Implementing expressive gesture synthesis for embodied conversational agents. In In Gesture in Human-Computer Interaction and Simulation, volume 3881, pages 188-199. Springer, 2006.
5. Honda Motor Co., Ltd. Asimo year 2000 model. http://world.honda.com/ ASIMO/technology/spec.html, 2000.
6. K. Itoh, H. Matsumoto, M. Zecca, H. Takanobu, S. Roccella, M.C. Carrozza, P. Dario, and A. Takanishi. Various emotional expressions with emotion expression humanoid robot we-4rii. In IEEE Conference on Robotics and Automation 2004 TExCRA Technical Exhibition Based, pages 35-36, 2004.
7. A. Kendon. Gesture: Visible Action as Utterance. Cambridge University Press, 2004.
8. D.H.U. Kochanek and R.H. Bartels. Interpolating splines with local tension, continuity, and bias control. ACM SIGGRAPH Computer Graphics, 18(3):41, 1984.
9. S. Kopp and I. Wachsmuth. Synthesizing multimodal utterances for conversational agents. Comp. Anim. Virtual Worlds, 15(1):39-52, 2004.
10. S. Levine, P. Krähenbühl, S. Thrun, and V. Koltun. Gesture controllers. ACM Trans. Graph., 29(4), 2010.
11. S. Levine, C. Theobalt, and V. Koltun. Real-time prosody-driven synthesis of body language. ACM Trans. Graph., 28(5):1-10, 2009.
12. C.D. Manning and H. Schütze. Foundations of statistical natural language processing. MIT Press, 2002.
13. D. McNeill. Gesture and Thought. University of Chicago Press, 2005.
14. Hisayuki Narahara and Takashi Maeno. Factors of gestures of robots for smooth communication with humans. In RoboComm '07: Proceedings of the 1st international conference on Robot communication and coordination, pages 1-4, 2007.
15. M. Neff, M. Kipp, I. Albrecht, and H. Seidel. Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Trans. Graph., 27(1):5:1-24, 2008.
16. V. Ng-Thow-Hing, J. Lim, J. Wormer, R. Sarvadevabhatla, C. Rocha, K. Fujimura, and Y. Sakagami. The memory game: Creating a humanrobot interactive scenario for asimo. In International Conference on Intelligent Robots and Systems (IROS 2008), pages 779-786, 2008.
17. C. Rose, B. Bodenheimer, and M. Cohen. Verbs and adverbs: Multidimensional motion interpolation using radial basis functions. IEEE Computer Graphics and Applications, 18(5):32-40, 1998.
18. M. Salem, S. Kopp, I. Wachsmuth, and F. Joublin. Towards meaningful robot gesture. In Human Centered Robot Systems, volume 6, pages 173-182, 2009.
19. T. Shiratori and K. Ikeuchi. Synthesis of dance performance based on analyses of human motion and music. IPSJ Online Transactions, 1:80-93, 2008.
20. Matthew Stone, Doug DeCarlo, Insuk Oh, Christian Rodriguez, Adrian Stere, Alyssa Lees, and Chris Bregler. Speaking with hands: creating animated conversational characters from recordings of human performance. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers, pages 506-513, New York, NY, USA, 2004. ACM.
21. H. Sugiura, M. Gienger, H. Janssen, and C. Goerick. Real-time collision avoidance with whole body motion control for humanoid robots. In Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2053-2058, 2007.
22. O. Sugiyama, T. Kanda, M. Imai, H. Ishiguro, and N. Hagita. Natural deictic communication with humanoid robots. In International Conference on Intelligent Robots and Systems (IROS 2007), pages 1441-1448, 2007.
23. TED. Ted (technology, entertainment, design) conference series. www.ted.com. http://www.ted.com/.
24. P. Tepper, S. Kopp, and J. Cassell. Content in context: Generating language and iconic gesture without a gestionary. In Proceedings of the Workshop on Balanced Perception and Action in ECAs at AAMAS '04, 2004.
25. K. Toutanova and C. Manning. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-2000), pages 63-70, 2000.
26. I. Wachsmuth and S. Kopp. Lifelike gesture synthesis and timing for conversational agents. In Gesture and Sign Language in Human-Computer Interaction, pages 225-235. Springer, 2002.