A neural basis of facial action recognition in humans

Journal of Neuroscience

Volumn 36, Issue 16, 2016, Pages 4434-4442

  Srinivasan, Ramprakash ^a   Golomb, Julie D ^a   Martinez, Aleix M ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

Action units; Emotion; Face perception; Facial expressions; fMRI

Indexed keywords

ADULT; ARTICLE; BLOOD OXYGENATION; BRAIN ANALYSIS; BRAIN REGION; COMPUTER MODEL; DATA PROCESSING; DISCRIMINANT ANALYSIS; EMOTION; FACIAL RECOGNITION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE ANALYSIS; MACHINE LEARNING; MALE; METHODOLOGY; NERVOUS SYSTEM FUNCTION; NORMAL HUMAN; PATTERN RECOGNITION; PERCEPTION; PRIORITY JOURNAL; PROCESSING; STIMULUS; TASK PERFORMANCE; VISUAL MEMORY; YOUNG ADULT; BRAIN; BRAIN MAPPING; FACIAL EXPRESSION; METABOLISM; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES;

ADULT; BRAIN; BRAIN MAPPING; FACIAL EXPRESSION; FACIAL RECOGNITION; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION;

EID: 84957586304     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1704-15.2016     Document Type: Article

References (49)

1. Adolphs R (2002) Neural systems for recognizing emotion. Curr Opin Neurobiol 12:169-177. CrossRef Medline
2. Adolphs R (2003) Cognitive neuroscience of human social behaviour. Nat Rev Neurosci 4:165-178. CrossRef Medline
3. Allison T, Puce A, McCarthy G (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci 4:267-278. CrossRef Medline
4. Bartlett MS, Littlewort GC, Frank MG, Lee K (2014) Automatic decoding of facial movements reveals deceptive pain expressions. Curr Biol 24:738-743. CrossRef Medline
5. Bruce V, Young AW (2012) Face perception. New York: Psychology Press.
6. Cohn JF, De la Torre F (2014) Automated face analysis for affective. The Oxford Handbook of Affective Computing 131.
7. Coutanche MN, Thompson-Schill SL (2012) The advantage of brief fMRI acquisition runs for multi-voxel pattern detection across runs. Neuroimage 61:1113-1119. CrossRef Medline
8. Cox DD, Savoy RL (2003) Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19:261-270. CrossRef Medline
9. Dailey MN, Cottrell GW, Padgett C, Adolphs R (2002) EMPATH: a neural network that categorizes facial expressions. J Cogn Neurosci 14:1158-1173. CrossRef Medline
10. Darwin C (1965) The expression of the emotions in man and animals, Vol 526. Chicago: University of Chicago.
11. Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, Dale AM, Maguire RP, Hyman BT, Albert MS, Killiany RJ (2006) An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31: 968-980. CrossRef Medline
12. Duchenne CB (1862) The mechanism of human facial expression. Paris: Renard; reprinted in 1990, London: Cambridge UP.
13. Du S, Tao Y, Martinez AM (2014) Compound facial expressions of emotion. Proc Natl Acad Sci U S A 111:E1454-E1462. CrossRef Medline
14. Ekman P, FriesenWV(1977) Facial action coding system: a technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
15. Ekman P, Sorenson ER, Friesen WV (1969) Pan-cultural elements in facial displays of emotion. Science 164:86-88. CrossRef Medline
16. Emmorey K, Lane HL, eds (2013) The signs of language revisited: an anthology to honor Ursula Bellugi and Edward Klima. New York: Psychology Press.
17. Fisher RA (1938) The statistical utilization of multiple measurements. Ann Eugenics 8:376-386. CrossRef
18. Fox CJ, Moon SY, Iaria G, Barton JJ (2009) The correlates of subjective perception of identity and expression in the face network: an fMRI adaptation study. Neuroimage 44:569-580. CrossRef Medline
19. Grill-Spector K, Weiner KS (2014) The functional architecture of the ventral temporal cortex and its role in categorization. Nat Rev Neurosci 15: 536-548. CrossRef Medline
20. Hamsici OC, Martinez AM (2008) Bayes optimality in linear discriminant analysis. IEEE Trans Pattern Anal Mach Intell 30:647-657. CrossRef Medline
21. Harms MB, Martin A, Wallace GL (2010) Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. Neuropsychol Rev 20:290-322. CrossRef Medline
22. Harris RJ, Young AW, Andrews TJ (2012) Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain. Proc Natl Acad Sci U S A 109:21164-21169. CrossRef Medline
23. Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4:223-233. CrossRef Medline
24. Haxby JV, Guntupalli JS, Connolly AC, Halchenko YO, Conroy BR, Gobbini MI, Hanke M, Ramadge PJ (2011) A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 72:404-416. CrossRef Medline
25. Huth AG, Nishimoto S, Vu AT, Gallant JL (2012) A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76:1210-1224. CrossRef Medline
26. Johnston P, Mayes A, Hughes M, Young AW (2013) Brain networks subserving the evaluation of static and dynamic facial expressions. Cortex 49:2462-2472. CrossRef Medline
27. Jolliffe I (2002) Principal component analysis. New York: Wiley.
28. Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci U S A 103:3863-3868. CrossRef Medline
29. Lindquist KA, Wager TD, Kober H, Bliss-Moreau E, Barrett LF (2012) The brain basis of emotion: a meta-analytic review. Behav Brain Sci 35: 121-143. CrossRef Medline
30. Martinez AM, Du S (2012) A model of the perception of facial expressions of emotion by humans: research overview and perspectives. J Mach Learn Res 13:1589-1608. Medline
31. Martinez AM, Kak AC (2001) Pca versus lda. IEEE Trans Pattern Anal Mach Intell 23:228-233. CrossRef
32. Martinez AM, Zhu M (2005) Where are linear feature extraction methods applicable? IEEE Trans Pattern Anal Mach Intell 27:1934-1944. CrossRef Medline
33. Misaki M, Kim Y, Bandettini PA, Kriegeskorte N (2010) Comparison of multivariate classifiers and response normalizations for patterninformation fMRI. Neuroimage 53:103-118. CrossRef Medline
34. Nestor A, Plaut DC, BehrmannM (2011) Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc Natl Acad Sci U S A 108:9998-10003. CrossRef Medline
35. Neth D, Martinez AM (2009) Emotion perception in emotionless face images suggests a norm-based representation. J Vis 9:5.1-11. Medline
36. Oosterhof NN, Todorov A (2009) Shared perceptual basis of emotional expressions and trustworthiness impressions from faces. Emotion 9:128. CrossRef Medline
37. O'Toole AJ, Jiang F, Abdi H, Haxby JV (2005) Partially distributed representations of objects and faces in ventral temporal cortex. J Cogn Neurosci 17:580-590. CrossRef Medline
38. Peelen MV, Atkinson AP, Vuilleumier P (2010) Supramodal representations of perceived emotions in the human brain. J Neurosci 30:10127-10134. CrossRef Medline
39. Redcay E, Dodell-Feder D, Mavros PL, Kleiner M, Pearrow MJ, Triantafyllou C, Gabrieli JD, Saxe R (2013) Atypical brain activation patterns during a face-to-face joint attention game in adults with autism spectrum disorder. Hum Brain Mapp 34:2511-2523. CrossRef Medline
40. Riesenhuber M, Poggio T (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2:1019-1025. CrossRef Medline
41. Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39:1161-1178. CrossRef
42. Russell JA, Fernández-Dols JM, eds (1997) The psychology of facial expression. Cambridge, UK: Cambridge UP.
43. Said CP, Moore CD, Engell AD, Todorov A, Haxby JV (2010) Distributed representations of dynamic facial expressions in the superior temporal sulcus. J Vis 10:11. CrossRef Medline
44. Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T (2007) Robust object recognition with cortex-like mechanisms. IEEE Trans Pattern Anal Mach Intell 29:411-426. CrossRef Medline
45. Sieger T, Serranová T, Růžička F, Vostatek P, Wild J, Štástná D, Bonnet C, Novák D, Růžiška E, Urgošík D, Jech R (2015) Distinct populations of neurons respond to emotional valence and arousal in the human subthalamic nucleus. Proc Natl Acad Sci U S A 112:3116-3121. CrossRef Medline
46. Skerry AE, Saxe R (2014) A common neural code for perceived and inferred emotion. J Neurosci 34:15997-16008. CrossRef Medline
47. Vytal K, Hamann S (2010) Neuroimaging support for discrete neural correlates of basic emotions: a voxel-based meta-analysis. J Cogn Neurosci 22:2864-2885. CrossRef Medline
48. Wegrzyn M, Riehle M, Labudda K, Woermann F, Baumgartner F, Pollmann S, Bien CG, Kissler J (2015) Investigating the brain basis of facial expression perception using multi-voxel pattern analysis. Cortex 69:131-140. CrossRef Medline
49. Woodworth RS, Schlosberg H (1954) Experimental psychology. New York: Henry Holt.