Facial behaviour mapping-From video footage to a robot head

Robotics and Autonomous Systems

Volumn 56, Issue 12, 2008, Pages 1042-1049

  Jaeckel, Peter ^a   Campbell, Neill ^b   Melhuish, Chris ^a  

^a UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

^b Department of Computer Science ^*  (United Kingdom)

Author keywords

Facial behaviour; Partial Least Squares; Tracking

Indexed keywords

ANIMATION; CURVE FITTING; FLOW INTERACTIONS; LEAST SQUARES APPROXIMATIONS; ROBOTICS;

AUTONOMOUS ROBOTIC SYSTEMS; FACIAL BEHAVIOUR; FEATURE POINTS; HUMAN HEADS; HUMAN-MACHINE INTERACTIONS; KEY FRAMES; PARTIAL LEAST SQUARES; ROBOT HEADS; TRACKING; TRACKING ERRORS; VIDEO FOOTAGES;

ROBOTS;

EID: 55149090570     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2008.09.002     Document Type: Article

References (31)

1. A. Debiolles, L. Oukhellou, P. Aknin, Combined use of partial least squares regression and neural network for diagnosis tasks, in: Proceedings of the 17th International Conference on Pattern Recognition, ICPR04, vol. 4, 2004, pp. 573-576
2. H. Miwa, H. Takanobu, A. Takanishi, Human-like head robot WE-3RV for emotional human-robot interaction, in: Fourteenth CISM-IFToMM Symposium RoManSy, 2002, pp. 519-526
3. Hegel F., Spexard T., Vogt T., Horstmann G., and Wrede B. Playing a different imitation game: Interaction with an empathic android robot. Proceedings 2006 IEEE-RAS International Conference on Humanoid Robots, Humanoids06 (2006), IEEE 56-61
4. Bavelas J., Coates L., and ~ T.J. Listeners as co-narrators. Journal of Personality and Social Psychology 79 6 (2000) 941-952
5. W. Burleson, R. Picard, K. Perlin, J. Lippincott, A platform for affective agent research, in: Workshop on Empathetic Agents, International Conference on Autonomous Agents and Multiagent Systems, Columbia University, New York, NY, 2004
6. Hanson D., Olney A., Pereira I., and Zielke M. Upending the uncanny valley. Proceedings of the Twentieth National Conference on Artificial Intelligence (2005), AAAI Press 1728-1729
7. Picard R. Affective Computing (1997), The MIT Press, Cambridge
8. C. Kidd, C. Breazeal, Effect of a robot on user perceptions, in: Proceedings 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2004, Sendai, Japan, 2004, pp. 3559-3564
9. Reeves B., Wise K., Maldonado H., Kogure K., Shinozawa K., and Naya F. Robots versus on-screen agents: Effects of social and emotional responses. Proceedings of the Conference on Human Factors in Computing Systems, CHI 2003 (2003), ACM Press, Fort Lauderdale, FL
10. C. Kidd, Sociable robots: The role of presence and task in human-robot interaction, Master's Thesis, School of Architecture and Planning, Massachusetts Institute of Technology, 2003
11. H. Ishiguro, Android science: Toward a new cross-interdisciplinary framework, in: The Twelveth International Symposium of Robotics Research, 2005, pp. 1-6
12. H. Kobayashi, F. Hara, A. Tange, A basic study on dynamic control of facial expressions for a face robot, in: Proceedings of the 3rd IEEE International Workshop on Robot and Human Communication, RO-MAN 1994 Nagoya, Japan, 1994, pp. 168-173
13. Breazeal C. Designing Social Robots (2002), The MIT Press
14. H. Kozima, C. Nakagawa, H. Yano, Using robots for the study of human social development, in: AAAI Spring Symposium on Developmental Robotics, DevRob-2005, Palo Alto, CA, USA, 2005, pp. 111-114
15. Bavelas J., and Chovil N. Faces in dialogue. In: Russell J., and Fernandez-Dols J.M. (Eds). The Psychology of Facial Expression (1997), Cambridge University Press, Cambridge, UK
16. Gralewski L., Campbell N., Thomas B., Dalton C., and Gibson D. Statistical synthesis of facial expressions for the portrayal of emotion. Graphite 2004 International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (2004), ACM 190-203
17. Darwin C., and Ekman P. The Expression of Emotion in Man and Animals (1998/1872), Oxford University Press, New York
18. Ekman P., Friesen W., and Hager J. Facial Action Coding System (2002), Research Nexus, Salt Lake City, Utah
19. Cohn J.F., and Schmidt K.L. The timing of facial motion in posed and spontaneous smiles. International Journal of Wavelets, Multiresolution and Information Processing 2 (2004) 1-12
20. J.F. Cohn, L.I. Reed, T. Moriyama, J. Xiao, K. Schmidt, Z. Ambadar, Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles, in: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, FG 2004, 2004
21. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features: in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001, pp. 511-518
22. T. Cootes, G. Edwards, C. Taylor, Active appearance models, in: Proceedings European Conference on Computer Vision 1998, 2, 1998, pp. 484-498
23. A. Brett, C. Taylor, A framework for automated landmark generation for automated 3d statistical model construction, in: Proceedings Information Processing in Medical Imaging, 1613, 1999, pp. 376-381
24. M. Rydfalk, CANDIDE, a Parameterized Face-Report No. LiTH-ISY-I-866. Technical Report, Chemometrics and Intelligent Laboratory Systems, Dept. of Electrical Engineering, Linkping University, Sweden, 1987
25. Parke F.I. Parameterized models for facial animation. IEEE Computer Graphics and Applications 2 9 (1982) 61-68
26. Breazeal C., Buchsbaum D., Gray J., Gatenby D., and Blumberg B. Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots. Artificial Life 11 1-2 (2005) 31-62
27. Littlewort G., Bartlett M., Fasel I., Susskind J., and Movellan J. An automatic system for measuring facial expression in video. Image and Vision Computing 24 6 (2006) 615-625
28. P. Jaeckel, N. Campbell, C. Melhuish, Towards realistic facial behaviour in humanoids-mapping from video footage to a robot head, in: 10th International Conference on Rehabilitation Robotics, ICORR 2007, 2007, pp. 833-839
29. R. Tobias, An introduction to partial least squares, Technical Report, SAS Institute Inc, Cary, NC, 1997
30. Abdi H. Partial least squares regression (PLS-Regression). In: Lewis-Beck M., Bryman A., and Futing T. (Eds). Encyclopedia for Research Methods for the Social Sciences (2003), Sage, Thousand Oaks, CA 792-795
31. Wallraven C., M., Breidt D.C., and Blthoff H.H. Psychophysical evaluation of animated facial expressions. Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization, APGV05 (2005), ACM Press, New York, NY, USA 17-24