Facial expression analysis, modeling and synthesis: Overcoming the limitations of artificial intelligence with the art of the soluble

Handbook of Research on Synthetic Emotions and Sociable Robotics: New Applications in Affective Computing and Artificial Intelligence

Volumn , Issue , 2009, Pages 34-55

  Bartneck, Christoph ^a   Lyons, Michael J ^b  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b RITSUMEIKAN UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84898153604     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-354-8.ch003     Document Type: Chapter

References (74)

1. Bandai. (2000). Tamagotchi. Retrieved January 2000, from http://www.bandai.com/
2. Bartneck, C. (2001). How convincing is Mr. Data's smile: Affective expressions of machines. User Modeling and User-Adapted Interaction, 11, 279-295. | DOI:10.1023/A:1011811315582
3. Bartneck, C. (2002). eMuu - an embodied emotional character for the ambient intelligent home. Ph.D. thesis, Eindhoven University of Technology, Eindhoven.
4. Bartneck, C. (2003). Interacting with an embodied emotional character. In Proceedings of the Design for Pleasurable Products Conference (DPPI2004), Pittsburgh (pp. 55-60). | DOI: 10.1145/782896.782911
5. Bartneck, C., Kanda, T., Ishiguro, H., & Hagita, N. (2007). Is the uncanny valley an uncanny cliff? In Proceedings of the 16th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2007, Jeju, Korea (pp. 368-373). | DOI: 10.1109/ROMAN.2007.4415111
6. Bartneck, C., & Lyons, M. J. (2007). HCI and the Face: Towards an Art of the Soluble. In J. Jacko (Ed.), Human-computer interaction, part 1, HCII2007, LNCS 4550 (pp. 20-29). Berlin: Springer. | DOI: 10.1007/978-3-540-73105-4_3
7. Bartneck, C., & Okada, M. (2001). Robotic user interfaces. In Proceedings of the Human and Computer Conference (HC2001), Aizu (pp. 130-140).
8. Bartneck, C., & Reichenbach, J. (2005). Subtle emotional expressions of synthetic characters. The International Journal of Human-Computer Studies, 62(2), 179-192. | DOI: 10.1016/j.ijh-cs.2004.11.006
9. Bartneck, C., Reichenbach, J., & Breemen, A. (2004). In your face, robot! The influence of a character's embodiment on how users perceive its emotional expressions. In Proceedings of the Design and Emotion 2004, Ankara.
10. Bartneck, C., & Suzuki, N. (2005). Subtle Expressivity for Characters and Robots. International Journal of Human Computer Studies, 62(2), 159-160. | DOI: 10.1016/j.ijhcs.2004.11.004
11. Biocca, F. (1997). The cyborg's dilemma: embodiment in virtual environments. In Proceedings of the Second International Conference on Cognitive Technology - "Humanizing the Information Age", Aizu (pp. 12-26). | DOI: 10.1109/CT.1997.617676
12. Bondarev, A. (2002). Design of an emotion management system for a home robot. Master, Eindhoven University of Technology, Eindhoven.
13. Bratman, M. E., Israel, D. J., & Pollack, M. E. (1988). Plans and resource-bounded practical reasoning. Computational Intelligence, 4(4), 349-355. | DOI: 10.1111/j.1467-8640.1988.tb00284.x
14. Breemen, A., Yan, X., & Meerbeek, B. (2005). iCat: an animated user-interface robot with personality. In Proceedings of the Fourth International Conference on Autonomous Agents & Multi Agent Systems, Utrecht. | DOI: 10.1145/1082473.1082823
15. Cassell, J., Sullivan, J., Prevost, S., & Churchill, E. (2000). Embodied conversational agents. Cambridge: MIT Press.
16. Cerami, F. (2006). Miss Digital World. Retrieved August 4th, from http://www.missdigitalworld.com/
17. Chan, C., Lyons, M. J., & Tetsutani, N. (2003). Mouthbrush: drawing and painting by hand and mouth. In Proceedings of the Fifth International Conference on Multimodal Interfaces, Vancouver (pp. 277-280). | DOI: 10.1145/958432.958482
18. Cycorp. (2007). Cyc. Retrieved February 2007, from http://www.cyc.com/
19. Dailey, M. N., Cottrell, G. W., Padgett, C., & Adolphs, R. (2002). EMPATH: A neural network that categorizes facial expressions. Journal of Cognitive Neuroscience, 14(8), 1158-1173. | DOI: 10.1162/089892902760807177
20. Darwin, C. (1872). The expression of the emotions in man and animals. London,: J. Murray.
21. De Silva, C. G., Lyons, M. J., Kawato, S., & Tetsutani, N. (2003). Human factors evaluation of a vision-based facial gesture interface. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop (pp. 52). | DOI: 10.1109/CVPRW.2003.10055
22. Ekman, P. (1985). Telling lies: Clues to deceit in the marketplace, politics, and marriage. New York: W.W. Norton.
23. Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. J. Power (Eds.), Handbook of cognition and emotion (pp. 45-60). Chichester, England; New York: Wiley.
24. Ekman, P., & Friesen, W. V. (1975). Unmasking the face. Englewood Cliffs: Prentice Hall.
25. Ekman, P., Friesen, W. V., & Ellsworth, P. (1972). Emotion in the human face: guidelines for research and an integration of findings. New York: Pergamon Press.
26. Elliott, C. D. (1992). The affective reasoner: A process model of emotions in a multi-agent system. Ph.D. thesis, The Institute for the Learning Sciences, Northwestern University, Evanston, Illinois.
27. Ellis, P. M., & Bryson, J. J. (2005). The significance of textures for affective interfaces. In J. G. Carbonell & J. Siekmann (Eds.), Intelligent virtual agents (Vol. 3661/2005, pp. 394-404). Berlin: Springer. | DOI: 10.1007/11550617_33
28. Fasel, B., & Luettin, J. (2003). Automatic facial expression analysis: a survey. Pattern Recognition, 36(1), 259-275. | DOI: 10.1016/S0031-3203(02)00052-3
29. Fogg, B. J. (2003). Persuasive technology: using computers to change what we think and do. Amsterdam; Boston: Morgan Kaufmann Publishers.
30. Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003). A survey of socially interactive robots. Robotics and Autonomous Systems, 42, 143-166. | DOI: 10.1016/S0921-8890(02)00372-X
31. Hara, F., & Kobayashi, H. (1996). A face robot able to recognize and produce facial expression. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems '96, IROS 96, Osaka (pp. 1600-1607). | DOI: 10.1109/IROS.1996.569026
32. Honda. (2002). Asimo. Retrieved from, http://www.honda.co.jp/ASIMO/
33. Ishiguro, H. (2005). Android science - Towards a new cross-interdisciplinary framework. In Proceedings of the CogSci Workshop Towards Social Mechanisms of Android Science, Stresa (pp. 1-6).
34. Koda, T. (1996). Agents with faces: A study on the effect of personification of software agents. Master Thesis, MIT Media Lab, Cambridge.
35. Lund, H. H., & Nielsen, J. (2002). An edutainment robotics survey. In Proceedings of the Third International Symposium on Human and Artificial Intelligence Systems: The Dynamic Systems Approach for Embodiment and Sociality, Fukui.
36. Lyons, M. J. (2004). Facial gesture interfaces for expression and communication. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, The Hague (pp. 598-603). | DOI: 10.1109/ICSMC.2004.1398365
37. Lyons, M. J., Akamatsu, S., Kamachi, M., & Gyoba, J. (1998). Coding Facial Expressions with Gabor Wavelets. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara pp. 200-205. | DOI: 10.1109/AFGR.1998.670949
38. Lyons, M. J., Budynek, J., & Akamatsu, S. (1999). Automatic Classification of Single Facial Images. IEEE Transactions Pattern Analysis and Machine Intelligence, 21(12), 1357-1362. | DOI: 10.1109/34.817413
39. Lyons, M. J., Chan, C., & Tetsutani, N. (2004). MouthType: Text Entry by Hand and Mouth. Proceedings of the Conference on Human Factors in Computing Systems CHI2004, Austria pp. 1383-1386. | DOI: 10.1145/985921.986070
40. Lyons, M. J., Funk, M., & Kuwabara, K. (2005). Segment and browse: A strategy for supporting human monitoring of facial expression behaviour. In Lecture notes in computer science - humancomputer interaction - INTERACT 2005 (Vol. 3585/2005, pp. 1120-1123). Rome: Springer. | DOI: 10.1007/11555261_119
41. Lyons, M. J., Kluender, D., & Tetsutani, N. (2005). Supporting empathy in online learning with artificial expressions. Journal of Educational Technology & Society, 8(4), 22-30.
42. Lyons, M. J., & Tetsutani, N. (2001). Facing the music: a facial action controlled musical interface. In Proceedings of the Conference on Human Factors in Computing Systems CHI2001, Seattle (pp. 309-310). | DOI: 10.1145/634067.634250
43. MacDorman, K. F. (2006). Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: An exploration of the uncanny valley. In Proceedings of the ICCS/CogSci-2006 Long Symposium: Toward Social Mechanisms of Android Science, Vancouver.
44. Mahmood, A. K., & Ferneley, E. (2004). Can avatars replace the trainer? A case study evaluation. In Proceedings of the the International Conference on Enterprise Information Systems (ICEIS), Porto (pp. 208-213).
45. McDermott, D. (1997, May 14th). Yes, Computers Can Think. New York Times.
46. Medawar, P. B. (1967). The art of the soluble. London: Methuen.
47. Michalowski, M. P., Sabanovic, S., & Kozima, H. (2007). A dancing robot for rhythmic social interaction. In Proceedings of the ACM/IEEE International Conference on Human-Robot In teraction, Arlington, Virginia, USA (pp. 89-96). | DOI: 10.1145/1228716.1228729
48. Mori, M. (1970). The uncanny valley. Energy, 7, 33-35.
49. NEC. (2001). PaPeRo. Retrieved from, http://www.incx.nec.co.jp/robot/
50. O'Reilly, W. S. N. (1996). Believable social and emotional agents. Ph.D. Thesis, Carnegie Mellon University, Pittsburgh, PA.
51. Ortony, A. (2003). On making believable emotional agents believable. In R. P. Trapple, P. (Ed.), Emotions in humans and artefacts. Cambridge: MIT Press.
52. Ortony, A., Clore, G., & Collins, A. (1988). The cognitive structure of emotions. Cambridge: Cambridge University Press.
53. Pantic, M., & Rothkrantz, L. J. M. (2000). Automatic analysis of facial expressions: the state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), 1424-1445 |DOI: 10.1109/34.895976
54. Pelachaud, C. (2005). Multimodal expressive embodied conversational agents. In Proceedings of the 13th Annual ACM International Conference on Multimedia, Hilton, Singapore (pp. 683-689). | DOI: 10.1145/1101149.1101301
55. Picard, R. W. (1997). Affective computing. Cambridge: MIT Press.
56. Robins, B., Dautenhahn, K., Boekhorst, R., & Billard, A. (2005). Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Universal Access in the Information Society, 4(2), 105-120. | DOI: 10.1007/s10209-005-0116-3
57. Roseman, I. J., Antoniou, A. A., & Jose, P. E. (1996). Appraisal determinants of emotions: constructing a more accurate and comprehensive theory. Cognition and Emotion, 10(3), 241-278. | DOI: 10.1080/026999396380240
58. Schiano, D. J., Ehrlich, S. M., Rahardja, K., & Sheridan, K. (2000). Face to interface: facial affect in (hu)man and machine. In Proceedings of the CHI 2000, Den Hague (pp. 193-200).
59. Schiano, D. J., Ehrlich, S. M., & Sheridan, K. (2004). Categorical imperative not: facial affect is perceived continously. In Proceedings of the CHI2004, Vienna (pp. 49-56). | DOI: 10.1145/985692.985699
60. Schlossberg, H. (1952). The description of facial expressions in terms of two dimensions. Journal of Experimental Psychology, 44(2).
61. Schlossberg, H. (1954). Three dimensions of emotion. Psychological Review, 61, 81-88.
62. Schulz, F. v. T. (1981). Miteinander Reden - Stoerungen und Klaerungen. Reinbeck bei Hamburg: Rowolth Taschenbuch Verlag GmbH.
63. Schwienhorst, K. (2002). The state of VR: A meta-analysis of virtual reality tools in second language acquisition. Computer Assisted Language Learning, 15(3), 221-239. | DOI: 10.1076/call.15.3.221.8186
64. Searle, J. R. (1980). Minds, brains and programs. Behavioral and Brain Sciences, 3(3), 417-457.
65. Shugrina, M., Betke, M., & Collomosse, J. (2006). Empathic painting: interactive stylization through observed emotional state. In Proceedings of the 4th International Symposium on Non-Photorealistic Animation and Rendering, Annecy, France (pp. 87-96). | DOI: 10.1145/1124728.1124744
66. Sloman, A. (1999). Architectural requirements for human-like agents both natural and artificial. In K. Dautenhahn (Ed.), Human cognition and social agent technology, advances in consciousness research. Amsterdam: John Benjamins Publishing Company.
67. Sony. (1999). Aibo. Retrieved January 1999, from http://www.aibo.com
68. Studdard, P. (1995). Representing human emotions in intelligent agents. Master Thesis, The American University, Washington DC.
69. Tamura, T., Yonemitsu, S., Itoh, A., Oikawa, D., Kawakami, A., Higashi, Y., et al. (2004). Is an entertainment robot useful in the care of elderly people with severe dementia? The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 59M83-M85
70. Tobii Technology. (2007). Tobii Technology. Retrieved February 2007, from http://www.tobii.com/
71. Wehrle, T. (1998). Motivations behind modeling emotional agents: Whose emotion does your robot have? In C. Numaoka, L. D. Cañamero & P. Petta (Eds.), Grounding emotions in adaptive systems. Zurich: 5th International Conference of the Society for Adaptive Behavior Workshop Notes (SAB'98).
72. Wiratanaya, A., Lyons, M. J., & Abe, S. (2006). An interactive character animation system for dementia care. In Proceedings of the ACM SIGGRAPH 2006 Research posters, Boston, Massachusetts (pp. Article No. 82). | DOI: 10.1145/1179622.1179717
73. Zanbaka, C.,Goolkasian, P., & Hodges, L. (2006). Can a virtual cat persuade you? The role of gender and realism in speaker persuasiveness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Montreal, Quebec, Canada. | DOI: 10.1145/1124772.1124945
74. Zhai, S., Morimoto, C., & Ihde, S. (1999). Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, Pittsburgh (pp. 246-253). | DOI: 10.1145/302979.303053