Engaging human-to-robot attention using conversational gestures and lip-synchronization

Journal of Physical Agents

Volumn 6, Issue 1, 2012, Pages 3-10

  Cid, F ^a   Manso, L J ^a   Calderita, L V ^a   Sanchez A ^a   Nunez P ^a  

^a UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Human Robot Interaction; Lip Synchronization; Robotics head

Indexed keywords

EID: 84865115714     PISSN: 18880258     EISSN: None     Source Type: Journal    
DOI: 10.14198/jopha.2012.6.1.02     Document Type: Article

References (38)

1. W. Burgard, A. B. Cremers, D. Fox, D. Hahnel, G. Lakemeyer. "Experiences with an interactive museum tour-guide robot".In Artificial Intelligence (AI), pp. 3-55. 2000.
2. F. Faber, M. Bennewitz, C. Eppner, A. Gorog, "The humanoid museum tour guide Robotinho". In Proc. IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). September 2009.
3. X. Ma and F. Quek, "Development of a Child-Oriented Social Robot for Safe and Interactive Physical Interaction". In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems Taiwan, pp. 2163-2168, October 2010.
4. T. Mukai, S. Hirano, H. Nakashima, Y. Kato, Y. Sakaida, S. Guo, and S. Hosoe, "Development of a Nursing-Care Assistant Robot RIBA That Can Lift a Human in Its Arms", In Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, Taiwan, pp. 5996-6001, October 2010.
5. P.Breen, E. Bowers, W. Welsh, "An investigation into the generation of mouth shapes for a talking head". In Proc. of ICSLP 96, USA, pp. 2159-2162, October 1996.
6. L.V. Calderita, P. Bachiller, J.P. Bandera, P. Bustos, and P. Nunez, "MIMIC: A Human motion imitation component for RoboComp". In Proc of Int Workshop on Recognition and Action for Scene understanding.. 2011.
7. T. Hashimoto, S. Hitramatsu, T. Tsuji, and H. Kobayashi, "Development of the Face Robot SAYA for Rich Facial Expressions". In Proc. of 2006 SICE-ICASE International Joint Conference Korea, pp. 5423-5428, October 2006.
8. M.J. Matarić J. Eriksson D.J. Feil-Seifer1 and C.J. Winstein. "Socially assistive robotics for post-stroke rehabilitation". In Journal of NeuroEngineering and Rehabilitation. 4:5. 2007.
9. J.A. Prado, C. Simplãň? cio, N.F. Lori and J. Dias, "Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction", In International Journal of Social Robotics, vol. 4, no. 1, pp. 29-51, December 2011.
10. J.P. Bandera, "Vision-Based Gesture Recognition in a Robot Learning by Imitation Framework", Ph.D. Thesis, University of Malaga, 2009.
11. A. Aly and A. Tapus, "Speech to Head Gesture Mapping in Multimodal Human-Robot Interaction", In Proc. of the 5th European Conference on Mobile Robots ECMR 2011 Sweden, pp. 101-108, September 2011.
12. C. Breazeal and L. Aryananda, "Recognition of Affective Communicative Intent in Robot-Directed Speech", Artificial Intelligence, pp. 83-104, 2002.
13. T. Chen, "Audio-Visual Integration in multimodal Communication". In IEEE Proceedings, May, 1998.
14. M.K Lee, J. Forlizzi, P.E. Rybski, F. Crabbe, W. Chung, J. Finkle, E. Glaser, S. Kiesler, "The Snackbot: Documenting the Design of a Robot for Long-term Human-Robot Interaction". In Proc. of HRI 2009, pp. 7-14, 2009.
15. R. W. Picard, "Affective Computing". MIT Press, pp. 88-91, 2000.
16. J. Gómez, A. Ceballos, F. Prieto, T. Redarce, "Mouth Gesture and Voice Command Based Robot Command Interface". In Proc. of IEEE International Conference on Robotics and Automation, Japan, pp. 333-338, May. 2009.
17. Verbio Technologies, "Text to Speech (TTS) and Speech Recognition (ASR)". Available at: http://www.verbio.com.
18. S. Anderson, D. Kewley-Port, "Evaluation of Speech Recognizers for Speech Training: Applications", In IEEE Transactions on speech and audio processing, VOL. 3, NO. 4, pp. 229-241, July 1995.
19. C. Jayawardena, I. H. Kuo, U. Unger, A. Igic, R. Wong, C. I. Watson, R. Q. Stafford, E. Broadbent, P. Tiwari, J. Warren, J. Sohn and B. A. MacDonald. "Deployment of a Service Robot to Help Older People". In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems Taiwan, pp. 5990-5995, October 2010.
20. C. Shi, T. Kanda, M. Shimada, F. Yamaoka, H. Ishiguro and N. Hagita "Easy Development of Communication Behaviors in Social Robots". In IEEE/RSJ International Conference on Intelligent Robots and Systems Taiwan, pp. 5302-5309, October 2010.
21. W. Zhiliang, L. Yaofeng, J. Xiao, "The research of the humanoid robot with facial expressions for emotional interaction". In Proc. First International Conference on Intelligent Networks and Intelligent Systems, pp. 416-420. 2008.
22. P. Rybski, K. Yoon, J. Stolarz, M. Veloso, "Interactive Robot Task Training through Dialog and Demonstration". In In Proc. of HRI 2007, USA, 2007.
23. K.-geune Oh, C.-yul Jung, Y.-gyu Lee, and S.-jong Kim, "Real Time Lip Synchronization between Text to Speech(TTS) System and Robot Mouth". In Proc. of IEEE International Symposium on Robot and Human Interactive Communication,Italy, pp. 620-625, September. 2010.
24. F. Hara, K. Endou, and S. Shirata, "Lip-Configuration control of a Mouth robot for japanese vowels". In Proc. IEEE International Workshop on Robot and Human Communication pp. 412-418, 1997.
25. A. Austermann, S. Yamada, K. Funakoshi, M. Nakano, "Similarities and Differences in Users Interaction with a Humanoid and a Pet Robot". In Proc. 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI) pp.73-74, 2010.
26. H. Kamide, Y Mae, T. Takubo, K. Ohara and T Arai. "Development of a Scale of Perception to Humanoid Robots: PERNOD". In IEEE/RSJ International Conference on Intelligent Robots and Systems Taiwan, pp. 5830-5835, October 2010.
27. S. DiPaola, A. Arya, J. Chan, "Simulating Face to Face Collaboration for Interactive Learning Systems", In In Proc: E-Learn 2005, Vancouver, 2005.
28. K. Waters and T.M. Levergood, "DECface: An Automatic Lip-Synchronization Algorithm for Synthetic Faces". In MULTIMEDIA TOOLS AND APPLICATIONS Vol. 1, Number 4, pp. 349-366, 1995.
29. Kaihui Mu, Jianhua Tao, J. che and M. Yang, "Real-Time Speech-Driven Lip Synchronization", In 4th International Universal Communication Symposium (IUCS), 2010 Beijing, pp. 378-382, 2010
30. J-L. Shen, J-W. Hung, L-S. Lee, "Robust entropy-based endpoint detection for speech recognition in noisy environments", In ICSLP-1998, 1998.
31. J.C. Junqua, B. Mak, and B. Reaves, "A Robust Algorithm for Word Boundary Detection in the Presence of Noise", In IEEE Trans. on Speech and Audio Processing, Vol. 2, No.3, pp. 406-412, Apr. 1994.
32. M.H. Savoji, "A Robust Algorithm for Accurate Endpointing of Speech", In Speech Communication, Vol. 8, pp. 45-60, 1989.
33. A. Tapus and M.j. Mataric, "Emulating Empathy in Socially Assistive Robotics", In AAAI Spring Symposium on Multidisciplinary Collaboration for Socially Assistive Robotics, Stanford, USA, March 2007
34. A. Paiva, J. Dias, D. Sobral, R. Aylett, P. Sobreperez, S. Woods, C. Zoll and L. Hall, "Caring for Agents and Agents that Care: Building Empathic Relations with Synthetic Agents", In Third International Joint Conference on Autonomous Agents and Multiagents Systems, Vol. 1, pp. 194-201, New York, USA, 2004.
35. L.J. Manso, P. Bachiller, P. Bustos, P. Nuñez, R. Cintas and L. Calderita. "RoboComp: a Tool-based Robotics Framework". In Simulation, Modeling and Programming for Autonomous Robots (SIMPAR). Pages 251-262. 2010.
36. M. Siegel, C. Breazeal, and M. I. Norton, "Persuasive Robotics: The influence of robot gender on human behavior". In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2563-2568, October 2009.
37. H. Song, and D. Kwon, "Design of a Robot Head with Arm-type Antennae for Emotional Expression". In International Conference on Control,Automation and System. ICCAS '07, pp. 1842 - 1846, October 2007.
38. J. Cahn. "Generation Expression in synthesized speech". Master's Thesis, MIT Media Lab. 1990.