Muecas: A multi-sensor robotic head for affective human robot interaction and imitation

Sensors (Switzerland)

Volumn 14, Issue 5, 2014, Pages 7711-7737

  Cid, Felipe ^a   Moreno, Jose ^a   Bustos, Pablo ^a   Núñez, Pedro ^a  

^a UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Human robot interaction; Imitation; Robotic head

Indexed keywords

ANTHROPOMORPHIC ROBOTS; BEHAVIORAL RESEARCH; COMPUTER KEYBOARDS; DESIGN; FACE RECOGNITION; GESTURE RECOGNITION; HUMAN ROBOT INTERACTION; SENSORS;

COMPLEX CONTROLLERS; DIRECT INTERACTIONS; FACIAL ACTION CODING SYSTEM; FACIAL EXPRESSION RECOGNITION; GOAL-BASED SYSTEMS; HUMAN FACIAL EXPRESSIONS; IMITATION; ROBOTIC HEAD;

ROBOTICS;

EID: 84899653785     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s140507711     Document Type: Article

References (44)

1. Pavia, A.; Dias, J.; Sobral, D.; Woods, S.; Aylett, R.; Sobreperez, P.; Zoll, C.; Hall, L. Caring for Agents that Care: Building Empathic Relations with Synthetic Agents. In Proceedings of the 3rd International Joint Conference on Autonomous Agents and Multiagents Systems, New York, NY, USA, 19-23 July 2004; pp. 194-201.
2. Tapus, A.; Mataric, M.J. Emulating Empathy in Socially Assistive Robotics. In Proceedings of AAAI Spring Symposium on Multidisciplinary Collaboration for Socially Assistive Robotics, Palo Alto, CA, USA, 26-28 March 2007.
3. Picard, R.W. Affective Computing; MIT Press: Cambridge, MA, USA, 2000; pp. 88-91.
4. Prado, J.A.; Simplicio, C.; Lori, N.F.; Dias, J. Visual-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction. Int. J. Soc. Robot. 2011, 4, 29-51.
5. Chen, T. Audio-Visual Integration in Multimodal Communication. Proc. IEEE 1998, 86, 837-852.
6. Bandera, J.P. Vision-Based Gesture Recognition in a Robot Learning by Imitation Framework. Ph.D. Thesis, University of Malaga, Malaga, Spain, 2009.
7. Cid, F.; Prado, J.A.; Manzano, P.; Bustos, P.; Núñez, P. Imitation System for Humanoid Robotics Head. J. Phys. Agents 2013, 1, 22-29.
8. Zeng, Z.; Pantic, M.; Roisman, G.I.; Huang, T. A Survey of Affect Recognition Methods: Audio, Visual and Spontaneous Expressions. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 31, 39-58.
9. Ge, S.S.; Wang, C.; Hang, C.C. Facial Expression Imitation in Human Robot Interaction. In Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, Munich, Germany, 1-3 August 2008; pp. 213-218.
10. Mayer, C.; Wimmer, M.; Eggers, M.; Radig, B. Facial Expression Recognition with 3D Deformable Models. In Proceedings of 2009 2nd International Conferences on Advances in Computer-Human Interactions (ACHI 09), Cancun, Mexico, 1-7 February 2009; pp. 26-31.
11. Riaz, Z.; Mayer, C.; Beetz, M.; Radig, B. Model Based Analysis of Face Images for Facial Feature Extraction. In Computer Analysis of Images and Patterns; Springer: Berlin Heidelberg, Germany, 2009; pp. 99-106.
12. Rosenblum, M.; Yacoob, Y.; Davis, L.S. Human expression recognition from motion using a radial basis function network architecture. IEEE Trans. Neural Netw. 1996, 7, 1121-1138.
13. Hegel, F.; Krach, S.; Kircher, T.; Wrede, B.; Sagerer, G. Theory of Mind (ToM) on Robots: A Functional Neuroimaging Study. In Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction (HRI), Amsterdam, The Netherlands, 12-15 March 2008; pp. 335-342.
14. Guthrie, S.E. Anthropomorphism: A Definition and a Theory. In Anthropomorphism, Anecdotes, and Animals; Mitchell R.W., Thompson, N.S., Miles, H.L., Eds.; States University of New York Press: New York, NY, USA.
15. Breazeal, C.; Aryananda, L. Recognition of Affective Communicative Intent in Robot-Directed Speech. Autonomous Robots 2002, 12, 83-104.
16. Busso, C.; Deng, Z.; Yildirim, S.; Bulut, M.; Lee, C.M.; Kazemzadeh, A.; Lee, S.; Neumann, U.; Narayanan, S. Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information. In Proceedings of ACM 6th International Conference on Multimodal Interfaces (ICMI 2004), State College, PA, USA, 13-15 October 2004.
17. Kessous, L.; Castellano, G.; Caridakis, G. Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. J. Multimodal User Interfaces 2010, 3, 33-48.
18. Sebe, N.; Cohen, I.; Gevers, T.; Huang, T.S. Multimodal Approaches for Emotion Recognition: A Survey. In Internet Imaging VI, SPIE'05; SPIE: San Jose, CA, USA, 2005.
19. Ekman, P.; Friesen, W.V.; Hager, J.C. Facial Action Coding System (FACS) Manual; A Human Face: Salt Lake City, UT, USA, 2002.
20. Ekman, P.; Rosenberg, E. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), 2nd ed.; Oxford Press: London, UK.
21. Fong, T.; Nourbakhsh, I.; Dautenhahn, K. A survey of socially interactive robots. Robot. Auton. Syst. 2003, 42, 143-166.
22. Siegel, M.; Breazeal, C.; Norton, M.I. Persuasive robotics: The influence of robot gender on human behavior. In Proceedings of 2009 IEEE/RSJ International Conference on Intellegent Robots and Systems, St. Louis, MO, USA, 10-15 October 2009; pp. 2563-2568.
23. Beira, R.; Lopes, M.; Praga, M.; Santos-Victor, J.; Bernardino, A.; Metta, G.; Becchi, F.; Saltaren, R. Design of the Robot-Cub (iCub) Head. In Proceedings of 2006 IEEE International Conference on Robotics and Automation (ICRA2006), Orlando, FL, USA, 15-19 May 2006; pp. 94-100.
24. Fujita, Y. Personal Robot PaPeRo. J. Robot. Mechatron. 2002, 14, 60-63.
25. Breazeal, C. Designing Sociable Robots; MIT Press: Cambridge, MA, USA, 2002.
26. Hirth, J.; Schmitz, N.; Berns K. Emotional Architecture for the Humanoid Robot Head ROMAN. In Proceedings of 2007 IEEE International Conference on Robotics and Automation, Roma, Italy, 10-15 April 2007; pp. 2150-2155.
27. Berns, K.; Hirth, J. Control of facial expressions of the humanoid robot head ROMAN. In Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 9-15 October 2006; pp. 3119-3124.
28. Asfour, T.; Welke, K.; Azad, P.; Ude, A.; Dillmann, R. The Karlsruhe Humanoid Head. In Proceedings of 8th IEEE-RAS International Conference on Humanoid Robots, Daejeon, South Korea, 1-3 December 2008; pp. 447-453.
29. Zecca, M.; Chaminade, T.; Umilta, M.A.; Itoh, K.; Saito, M.; Endo, N. Emotional Expression Humanoid Robot WE-4RII-Evaluation of the perception of facial emotional expressions by using fMRI. In Proceedings of Robotics and Mechatronics Conference ROBOMEC 2007, Akita, Japan, 10-12 May 2007; pp. 2A1-O10.
30. Hashimoto, T.; Hitramatsu, S.; Tsuji, T.; Kobayashi, H. Development of the Face Robot SAYA for Rich Facial Expressions. In Proceedings of 2006 SICE-ICASE International Joint Conference, Busan, Korea, 18-21 October 2006; pp. 5423-5428.
31. Hashimoto, T.; Kobayashi, H. Study on Natural Head Motion in Waiting State with Receptionist Robot SAYA that has human-like Appearance. In Proceedings of IEEE Workshop on Robotic Intelligence in Informationally Structured Space (RIISS '09), Nashville, TN, USA, 30 March-2 April 2009; pp. 93-98.
32. Spexard, T.P.; Hanheide, M.; Sagerer, G. Human-Oriented Interaction With an Anthropomorphic Robot. IEEE Trans. Robot. 2007, 5, 852-862.
33. Mori, M. Bukimi No Tani (The Uncanny Valley). Energy 1970, 7, 33-35.
34. van Breemen, A.; Yan, X.; Meerbeek, B. iCat: An animated user-interface robot with personality. In Proceedings of the 4th International Joint Conference on Autonomous Agents and Multiagent Systems, Utrecht, The Netherlands, 25-29 July 2005; pp. 143-144.
35. Saldien, J.; Goris, K.; Yilmazyildiz, S.; Verhelst, W.; Lefeber, D. On the Design of the Huggable Robot Probo. J. Phys. Agents 2008, 2, 3-11.
36. Lütkebohle, I.; Hegel, F.; Schulz, S.; Hackel, M.; Wrede, B.; Wachsmuth, S.; Sagerer, G. The Bielefeld Anthropomorphic Robot Head "Flobi". In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA, 3-7 May 2010.
37. Seyama, J.; Nagayama, R. The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces. Presence Teleoper. Virtual Environ. 2007, 16, 337-351.
38. Wang, S.; Yin, B.; Li, H.; Yang, Q. Multi-motor control system design based on Can bus. In Proceedings of International Conference on Electronic and Mechanical Engineering and Information Technology (EMEIT), Harbin, China, 12-14 August 2011; pp. 4910-4913.
39. Manso, L.J.; Bachiller, P.; Bustos, P.; Nuñez, P., Cintas, R.; Calderita, L. RoboComp: A Tool-based Robotics Framework. In Simulation, Modeling and Programming for Autonomous Robots; Springer: Berlin Heidelberg, Germany, 2010; pp. 251-262.
40. Internet Communications Engine Middleware, ICE. Available online: http://www.zeroc.com/ ice.html (accessed on 16 April 2014).
41. Cid, F.; Cintas, R.; Manso, L.J.; Calderita, L.V.; Sánchez, A.; Núñez, P. Engaging human-to-robot attention using conversational gestures and lip-synchronization. J. Phys. Agents 2012, 6, 3-10.
42. Romero, P.; Cid, F.; Núñez, P. A Novel Real Time Facial Expression Recognition System Based on Candide-3 Reconstruction Model. In Proceedings of the XIV Workshop on Physical Agents (WAF 2013), Madrid, Spain, 18-19 September 2013; pp. 41-46.
43. Cid, F.; Prado, J.A.; Bustos, P.; Núñez, P. A Real Time and Robust Facial Expression Recognition and Imitation Approach for Affective Human-Robot Interaction Using Gabor Filtering. In Proceedings of 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan, 3-8 November 2013; pp. 2188-2193.
44. Noll, M. Pitch determination of human speech by the harmonic product spectrum, the harmonic sum spectrum, and a maximum likelihood estimate. In Proceedings of the Symposium on Computer Processing in Communications, Vol. XIX, Polytechnic Press: Brooklyn, New York, NY, USA, 1970; pp. 779-797.