A model of the perception of facial expressions of emotion by humans: Research overview and perspectives

Journal of Machine Learning Research

Volumn 13, Issue , 2012, Pages 1589-1608

  Martinez, Aleix ^a   Du, Shichuan ^a  

^a Ohio State University   (United States)

Author keywords

Categorical perception; Computational modeling; Emotions; Face detection; Face perception; Vision

Indexed keywords

CATEGORICAL MODEL; CATEGORICAL PERCEPTION; COGNITIVE SCIENCE; COMPUTATIONAL MODELING; CONTINUOUS MODELS; CONTINUOUS SPACES; EMOTIONS; FACE SPACE; FACIAL EXPRESSIONS; FACIAL LANDMARK; FEATURE VECTORS; HUMAN PERCEPTION; MORPHING; NEUROSCIENCE LITERATURE; RESEARCH DIRECTIONS; SOCIAL INTERACTIONS; STATE OF THE ART;

COMPUTER VISION; FACE RECOGNITION; RESEARCH; VISION;

BEHAVIORAL RESEARCH;

EID: 84862014987     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (54)

1. J. C. Barlett and J. Searcy. Inversion and configuration of faces. Cognitive Psychology, 25(3):281-316, 1993.
2. J. M. Beale and F. C. Keil. Categorical effects in the perception of faces. Cognition, 57:217-239, 1995.
3. R. Brunelli and T. Poggio. Face recognition: features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(10):1042-1052, 1993.
4. A. J. Calder, A. W. Young, D. Rowland, and D. I. Perrett. Computer-enhanced emotion in facial expressions. Proceedings of the Royal Society of London B, 264:919-925, 1997. (Pubitemid 27283130)
5. A. J. Calder, A. D. Lawrence, and A. W. Young. Neuropsychology of fear and loathing. Nature Review Neuroscience, 2:352-363, 2001. (Pubitemid 33680577)
6. F. Castelli. Understanding emotions from standardized facial expressions in autism and normal development. Autism, 9:428-449, 2005. (Pubitemid 41489549)
7. CDC. Center for Disease Control and Prevention. Prevalence of autism spectrum disorders autism and developmental disabilities monitoring network, 14 sites, united states, 2008. Morbidity and Mortality Weekly Report (MMWR), 61, 2012.
8. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. IEEE Trans. Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001. (Pubitemid 32585279)
9. A. R. Damasio. Descartes' Error: Emotion, Reason, and the Human Brain. G. P. Putnam's Sons, New York, 1995.
10. C. Darwin. The Expression of the Emotions in Man and Animal. J. Murray., London, 1872.
11. L. Ding and A. M. Martinez. Features versus context: An approach for precise and detailed detection and delineation of faces and facial features. IEEE Trans. Pattern Analysis and Machine Intelligence, 32:2022-2038, 2010.
12. S. Du and A. M. Martinez. The resolution of facial expressions of emotion. Journal of Vision, 11(13):24, 2011.
13. P. Ekman and W. V. Friesen. Pictures of Facial Affect. Consulting Psychologists Press, Palo Alto, CA, 1976.
14. P. Ekman and E. L. Rosenberg. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, New York, 2nd edition, 2005.
15. P. F. U. Gotardo and A. M. Martinez. Computing smooth time-trajectories for camera and deformable shape in structure from motion with occlusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(10):2051-2065, 2011a.
16. P. F. U. Gotardo and A. M. Martinez. Kernel non-rigid structure from motion. In Proceedings of the IEEE International Conference on Computer Vision, 2011b.
17. O. C. Hamsici and A. M. Martinez. Bayes optimality in linear discriminant analysis. IEEE Trans. Pattern Analysis and Machine Intelligence, 30:647-657, 2008. (Pubitemid 351559718)
18. O. C. Hamsici and A. M. Martinez. Rotation invariant kernels and their application to shape analysis. IEEE Trans. Pattern Analysis and Machine Intelligence, 31:1985-1999, 2009a.
19. O. C. Hamsici and A. M. Martinez. Active appearance models with rotation invariant kernels. In IEEE Proc. International Conference on Computer Vision, 2009b.
20. J. A. Hosie, H. D. Ellis, and N. D. Haig. The effect of feature displacement on the perception of well-known faces. Perception, 17(4):461-474, 1988.
21. C. E. Izard. Emotion theory and research: Highlights, unanswered questions, and emerging issues. Annual Review of Psychology, 60:1-25, 2009.
22. B. Jemel, L. Mottron, and M. Dawson. Impaired face processing in autism: Fact or artifact? Journal of Autism and Developmental Disorders, 36:91-106, 2006.
23. T. Kanade. Picture Processing System by Computer Complex and Recognition of Human Faces. PhD thesis, Kyoto University, Japan, 1973.
24. N. Lawrence. Probabilistic non-linear principal component analysis with gaussian process latent variable models. Journal of Machine Learning Research, (6): 1783-1816, 2005.
25. J. E. LeDoux. Emotion circuits in the brain. Annual Review of Nueroscience, 23:155-184, 2000. (Pubitemid 30350041)
26. D. Lowe. Three-dimensional object recognition from single two-dimensional images. Artificial Intelligence, 31(3):355-395, 1983.
27. D. Marr. Early processing of visual information. Philosophical Transactions of the Royal Society of London, 275(942):483-519, 1976.
28. A. M. Martinez. Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class. IEEE Trans. Pattern Analysis and Machine Intelligence, 24(6):748-763, 2002. (Pubitemid 34669589)
29. A. M. Martinez. Matching expression variant faces. Vision Research, 43:1047-1060, 2003. (Pubitemid 36379311)
30. A. M. Martinez. Deciphering the face. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, workshop, 2011.
31. M. Minsky. The Society of Mind. Simon & Schuster, New York, N. Y., 1988.
32. D. Neth and A. M. Martinez. Emotion perception in emotionless face images suggests a norm-based representation. Journal of Vision, 9(1):1-11, 2009.
33. D. Neth and A. M. Martinez. A computational shape-based model of anger and sadness justifies a configural representation of faces. Vision Research, 50:1693-1711, 2010.
34. A. Pentland. Looking at people: Sensing for ubiquitous and wearable computing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1):107-119, 2000. (Pubitemid 32132957)
35. M. Prior. Is there an increase in the prevalence of autism spectrum disorders? Journal of Paediatrics and Child Health, 39:81-82, 2003. (Pubitemid 36308068)
36. G. Rhodes, S. Brennan, and S. Carey. Identification and ratings of caricatures: implications for mental representations of faces. Cognitive Psychology, 19:473-497, 1987.
37. S. Rivera and A. M. Martinez. Learning shape manifolds. Pattern Recognition, 45(4):1792-1801, 2012.
38. E. T. Rolls. A theory of emotion, and its application to understanding the neural basis of emotion. Cognition and Emotion, 4:161-190, 1990.
39. J. A. Russell. A circumplex model of affect. J. Personality Social. Psych., 39:1161-1178, 1980.
40. J. A. Russell. Core affect and the psychological construction of emotion. Psychological Review, 110:145-172, 2003. (Pubitemid 37170695)
41. K. L. Schmidt and J. F. Cohn. Human facial expressions as adaptations: Evolutionary questions in facial expression. Yearbook of Physical Anthropology, 44:3-24, 2001.
42. L. Sirovich and M. Kirby. Low-dimensional procedure for the characterization of human faces. J. Optical Soc. Am. A, 4:519-524, 1987.
43. F. W. Smith and P. G. Schyns. Smile through your fear and sadness: Transmitting and identifying facial expression signals over a range of viewing distances. Psychology Science, 20(10):1202-1208, 2009.
44. J. Susskind, D. Lee, A. Cusi, R. Feinman, W. Grabski, and A. K. Anderson. Expressing fear enhances sensory acquisition. Nature Neuroscience, 11(7):843-850, 2008. (Pubitemid 351896678)
45. J. M. Susskind, G. Littlewort, M. S. Bartlett, and A. K. Anderson J. Movellanb. Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45:152162, 2007.
46. F. Dela Torre and J. F. Cohn. Facial expression analysis. In Th. B. Moeslund, A. Hilton, V. Kruger, and L. Sigal, editors, Guide to Visual Analysis of Humans: Looking at People, pages 377-410. Springer, 2011.
47. M. Turk and A. Pentland. Eigenfaces for recognition. J. Cognitive Neuroscience, 3:71-86, 1991.
48. T. Valentine. A unified account of the effects of distinctiveness, inversion, and race in face recognition. Quarterly Journal of Experimental Psychology A: Human Experimental Psychology, 43:161-204, 1991.
49. V. Vapnik. Statistical Learning Theory. John Wiley and Sons, New York, NY, 1998.
50. D. A. Wilbraham, J. C. Christensen, A. M. Martinez, and J. T. Todd. Can low level image differences account for the ability of human observers to discriminate facial identity? Journal of Vision, 8(5):1-12, 2008.
51. R. B. Wilbur. Nonmanuals, semantic operators, domain marking, and the solution to two outstanding puzzles in asl. In Nonmanuals in Sign Languages. John Benjamins, 2011.
52. M.-H. Yang, D. J. Kriegman, and N. Ahuja. Detecting faces in images: A survey. IEEE Trans. Pattern Analysis and Machine Intelligence, 24(1):34-58, 2002. (Pubitemid 34325615)
53. A. W. Young, D. Hellawell, and D. C. Hay. Configurational information in face perception. Perception, 16(6):747-759, 1987.
54. L. A. Zebrowitz, M. Kikuchi, and J. M. Fellous. Facial resemblance to emotions: Group differences, impression effects, and race stereotypes. Journal of Personality and Social Psychology, 98(2):175-189, 2010.