Dynamic and static facial expressions decoded from motion-sensitive areas in the macaque monkey

Journal of Neuroscience

Volumn 32, Issue 45, 2012, Pages 15952-15962

  Furl, Nicholas ^a   Hadj Bouziane, Fadila ^a   Liu, Ning ^a   Averbeck, Bruno B ^a   Ungerleider, Leslie G ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MONOCRYSTALLINE IRON OXIDE NANOPARTICLE;

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION CORTEX; EMOTION; FACIAL EXPRESSION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; MALE; NONHUMAN; PRIORITY JOURNAL; RHESUS MONKEY; SENSITIVITY TRAINING; SPATIAL ORIENTATION; SUPERIOR TEMPORAL SULCUS; TASK PERFORMANCE; TEMPORAL CORTEX; VISUAL ORIENTATION;

ANIMALS; BRAIN MAPPING; CEREBRAL CORTEX; EMOTIONS; FACIAL EXPRESSION; MACACA MULATTA; MAGNETIC RESONANCE IMAGING; MALE; MOTION PERCEPTION; NEURONS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION;

EID: 84868577560     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1992-12.2012     Document Type: Article

References (56)

1. Ambadar Z, Schooler JW, Cohn JF (2005) Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychol Sci 16:403-410. CrossRef Medline
2. Averbeck BB (2009) Noise correlations and information encoding and decoding. In: Coherent behavior in neuronal networks (Rubin J, Josic K, Matias M, Romo R, eds). New York: Springer.
3. Barraclough NE, Xiao D, Oram MW, Perrett DI (2006) The sensitivity of primate STS neurons to walking sequences and to the degree of articulation in static images. Prog Brain Res 154:135-148. CrossRef Medline
4. Bruce C, Desimone R, Gross CG (1981) Visual properties in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46:369-384. Medline
5. Calder AJ, Young AW (2005) Understanding recognition of facial identity and facial expression. Nat Rev Neurosci 6:641-651. CrossRef Medline
6. Cover TM, Thomas JA (1991) Elements ofinformation theory, 2nd ed. New York: Wiley-Interscience.
7. Cox RW (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162-173. CrossRef Medline
8. Desimone R, Ungerleider LG (1986) Multiple visual areas in the caudal superior temporal sulcus of the macaque. J Comp Neurol 248:164-189. CrossRef Medline
9. Dubner R, Zeki SM (1971) Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Res 35:528-532. CrossRef Medline
10. Engell AD, Haxby JV (2007) Facial expression and gaze-direction in human superior temporal sulcus. Neuropsycholgia 45:3234-3241. CrossRef
11. Foley E, Rippon G, Thai NJ, Longe O, Senior C (2012) Dynamic facial expressions evoke distinct activation in the face perception network: a connectivity analysis study. J Cogn Neurosci 24:507-520. CrossRef Medline
12. Formisano E, De Martino F, Bonte M, Goebel R (2008) "Who" is saying "what?" Brain-based decoding of human voice and speech. Science 322: 970-973. CrossRef Medline
13. Fox CJ, Iaria G, Barton JJ (2009) Defining the face processing network: optimization of the functional localizer in fMRI. Hum Brain Mapp 30:1637-1651. CrossRef Medline
14. Freiwald WA, Tsao DY, Livingstone MS (2009) A face feature space in the macaque temporal lobe. Nat Neurosci 12:1187-1196. CrossRef Medline
15. Freyd JJ (1983) The mental representation of movement when static stimuli are viewed. Percept Psychophys 33:575-581. CrossRef Medline
16. Furl N, van Rijsbergen NJ, Kiebel SJ, Friston KJ, Treves A, Dolan RJ (2010) Modulation of perception and brain activity by predictable trajectories of facial expressions. Cereb Cortex 20:694-703. CrossRef Medline
17. Giese MA, Poggio T (2003) Neural mechanisms for the recognition of biological movements. Nat Rev Neurosci 4:179-192. CrossRef Medline
18. Hadj-Bouziane F, Bell AH, Knusten TA, Ungerleider LG, Tootell RB (2008) Perception of emotional expressions is independent of face selectivity in monkey inferior temporal cortex. Proc Natl Acad Sci U S A 105:5591-5596. CrossRef Medline
19. Hasselmo ME, Rolls ET, Baylis GC (1989) The role of expression and identity inthe face-selective responses ofneuronsinthe temporal visual cortex of the monkey. Behav Brain Res 32:203-218. CrossRef Medline
20. Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4:223-233. CrossRef Medline
21. Jellema T, Perrett DI (2003) Cells in monkey STS responsive to articulated body motions and consequent static posture: a case of implied motion? Neuropsychologia 41:1728-1737. CrossRef Medline
22. Knappmeyer B, Thornton IM, Bülthoff HH (2003) The use of facial motion and facial form during the processing of identity. Vision Res 43:1921-1936. CrossRef Medline
23. Knight B, Johnston A (1997) The role of movement in face recognition. Vis Cogn 4:265-273. CrossRef
24. Kourtzi Z, Kanwisher N (2000) Activation in human MT/MST by static images with implied motion. J Cogn Neurosci 12:48-55. CrossRef Medline
25. Kriegeskorte N, Formisano E, Sorger B, Goebel R (2007) Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc Natl Acad Sci U S A 104:20600-20605. CrossRef Medline
26. Kriegeskorte N, Mur M, Ruff DA, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA (2008) Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60:1126-1141. CrossRef Medline
27. Krzanowski WJ (1988) Principles of multivariate analysis: a user's perspective. New York: Oxford UP.
28. Ku SP, Tolias AS, Logothetis NK, Goense J (2011) fMRI of the face-processing network in the ventral temporal lobe of awake and anesthetized macaques. Neuron 70:352-362. CrossRef Medline
29. Lander K, Davies R (2007) Exploring the role of characteristic motion when learning new faces. Q J Exp Psychol (Colchester) 60:519-526. CrossRef
30. Lander K, Christie F, Bruce V (1999) The role of movement in the recognition of famous faces. Mem Cognit 27:974-985. CrossRef Medline
31. Leite FP, Tsao D, Vanduffel W, Fize D, Sasaki Y, Wald LL, Dale AM, Kwong KK, Orban GA, Rosen BR, Tottell RB, Mandeville JB (2002) Repeated fMRI using iron oxide contrast agent in awake, behaving macaques at 3 Tesla. Neuroimage 16:283-294. CrossRef Medline
32. McLaren DG, Kosmatka KJ, Oakes TR, Kroenke CD, Kohama SG, Matochik JA, Ingram DK, Johnson SC (2009) A population-average MRI-based atlas collection of the rhesus macaque. Neuroimage 45:52-59. CrossRef Medline
33. Natu VS, Jiang F, Narvekar A, Keshvari S, Blanz V, O'Toole AJ (2010) Dissociable neural patterns of facial identity across changes in viewpoint. J Coh Neurosci 22:1570-1582. CrossRef
34. Nelissen K, Vanduffel W, Orban GA (2006) Charting the lower superior temporal region, a new motion-sensitive region in monkey superior temporal sulcus. J Neurosci 26:5929-5947. CrossRef Medline
35. Nelissen K, Borra E, Gerbella M, Rozzi S, Luppino G, Vanduffel W, Rizzolatti G, Orban GA (2011) Action observation circuits in the macaque monkey cortex. J Neurosci 31:3743-3756. CrossRef Medline
36. Nestor A, Plaut DC, Behrmann M (2011) Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc Natl Acad Sci U S A 108:9998-10003. CrossRef Medline
37. Oram MW, Perrett DI (1996) Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. J Neurophysiol 76:109-129. Medline
38. O'Toole AJ, Roark DA, Abdi H (2002) Recognizing moving faces: a psychological and neural synthesis. Trends Cogn Sci 6:261-266. CrossRef Medline
39. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, Milner AD, Jeeves MA (1984) Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Hum Neurobiol 3:197-208. Medline
40. Pitcher D, Dilks DD, Saxe RR, Triantafyllou C, Kanwisher N (2011) Differential selectivity for dynamic versus static information in face-selective cortical regions. Neuroimage 56:2356-2363. CrossRef Medline
41. Puce A, Syngeniotis A, Thompson JC, Abbott DF, Wheaton KJ, Castiello U (2003) The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies. Neuroimage 19:861-869. CrossRef Medline
42. Roark DA, O'Toole AJ, Abdi H, Barrett SE (2006) Learning the moves: the effect of familiarity and facial motion on person recognition across large changes in viewing format. Perception 35:761-773. CrossRef Medline
43. Saad ZS, Glen DR, Chen G, Beauchamp MS, Desai R, Cox RW (2009) A new method for improving functional-to-structural alignment using local Person correlation. Neuroimage 44:839-848. CrossRef Medline
44. Said CP, Moore CD, Engell AD, Todorov A, Haxby JV (2010) Distributed representations of dynamic facial expressions in the superior temporal sulcus. J Vis 10:11. CrossRef Medline
45. Saleem K, Logothetis NK (2007) A combined MRI and histology atlas of the rhesus monkey brain. Amsterdam: Academic.
46. Schultz J, Pilz KS (2009) Natural facial motion enhances cortical responses to faces. Exp Brain Res 194:465-475. CrossRef Medline
47. Schultz J, Brockhaus M, Büthoff HH, Pilz KS (2012) What the human brain likes about facial motion. Cereb Cortex. Advance online publication. Retrieved. doi:10.1093/cercor/bhs106. CrossRef Medline
48. Senior C, Barnes J, Giampietro V, Simmons A, Bullmore ET, Brammer M, David AS (2000) The functional neuroanatomy of implicit-motion perception or representational momentum. Curr Biol 10:16-22. CrossRef Medline
49. Thompson JC, Hardee JE, Panayiotou A, Crewther D, Puce A (2007) Common and distinct brain activation to viewing dynamic sequences of face and hand movements. Neuroimage 37:966-973. CrossRef Medline
50. Trautmann SA, Fehr T, Herrmann M (2009) Emotions in motion: dynamic compared to static facial expressions of disgust and happiness reveal more widespread emotion-specific activations. Brain Res 1284:100-115. CrossRef Medline
51. Tsao DY, Freiwald WA, Tootell RB, Livingstone MS (2006) A cortical region consisting entirely of face-selective cells. Science 311:670-674. CrossRef Medline
52. Vaina LM, Gross CG (2004) Perceptual deficits in patients with impaired recognition of biological motion after temporal lobe lesions. Proc Natl Acad Sci U S A 101:16947-16951. CrossRef Medline
53. Van Essen DC, Drury HA, Dickson J, Harwell J, Hanlon D, Anderson CH (2001) An integrated software suite for surface-based analyses ofcerebral cortex. J Am Med Inform Assoc 8:443-459. CrossRef Medline
54. Vanduffel W, Fize D, Mandeville JB, Nelissen K, Van Hecke P, Rosen BR, Tootell RB, Orban GA (2001) Visual motion processing investigated using contrast agent-enhanced fMRI in awake behaving monkeys. Neuron 32:565-577. CrossRef Medline
55. Vangeneugden J, De Mazière PA, Van Hulle MM, Jaeggli T, Van Gool L, Vogels R (2011) Distinct mechanisms for coding of visual actions in macaque temporal cortex. J Neurosci 31:385-401. CrossRef Medline
56. Wehrle T, Kaiser S, Schmidt S, Scherer KR (2000) Studying the dynamics of emotional expression using synthesized facial muscle movements. J Pers Soc Psychol 78:105-119. CrossRef Medline