Decoding face information in time, frequency and space from direct intracranial recordings of the human brain

PLoS ONE

Volumn 3, Issue 12, 2008, Pages

  Tsuchiya, Naotsugu ^a   Kawasaki, Hiroto ^b   Oya, Hiroyuki ^b   Howard III, Matthew A ^b   Adolphs, Ralph ^a,b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANTICONVULSIVE AGENT;

ACCURACY; ADULT; ARTICLE; BRAIN CORTEX; CLINICAL ARTICLE; CONTROLLED STUDY; ELECTROCORTICOGRAPHY; EPILEPSY; FACIAL EXPRESSION; FEMALE; FREQUENCY MODULATION; HEMISPHERIC DOMINANCE; HUMAN; MALE; NERVE CONDUCTION; NEUROSURGERY; PATTERN RECOGNITION; SUBICULUM; TASK PERFORMANCE; TEMPORAL CORTEX; VISUAL DISCRIMINATION; VISUAL STIMULATION; ATTENTION; BEHAVIOR; BRAIN MAPPING; DEMOGRAPHY; ELECTROENCEPHALOGRAPHY; EMOTION; EVOKED VISUAL RESPONSE; MIDDLE AGED; PHOTOSTIMULATION; PHYSIOLOGY; TEMPORAL LOBE; TIME; VISION;

ADULT; ATTENTION; BEHAVIOR; BRAIN MAPPING; DEMOGRAPHY; ELECTROENCEPHALOGRAPHY; EMOTIONS; EVOKED POTENTIALS, VISUAL; FACIAL EXPRESSION; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; MIDDLE AGED; PHOTIC STIMULATION; TASK PERFORMANCE AND ANALYSIS; TEMPORAL LOBE; TIME FACTORS; VISUAL PERCEPTION;

EID: 57549083390     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0003892     Document Type: Article

References (59)

1. Allison T, Puce A, Spencer DD, McCarthy G (1999) Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb Cortex 9(5): 415-430.
2. McCarthy G, Puce A, Belger A, Allison T (1999) Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. Cereb Cortex 9(5): 431-444.
3. Puce A, Allison T, McCarthy G (1999) Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. Cereb Cortex 9(5): 445-458.
4. Halgren E, Baudena P, Heit G, Clarke JM, Marinkovic K, et al. (1994) Spatiotemporal stages in face and word processing. I. Depth-recorded potentials in the human occipital, temporal and parietal lobes [corrected]. Journal of physiology, Paris 88(1): 1-50.
5. Mitra PP, Pesaran B (1999) Analysis of dynamic brain imaging data. Biophysical Journal 76(2): 691-708.
6. Pesaran B, Pezaris JS, Sahani M, Mitra PP, Andersen RA (2002) Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nat Neurosci 5(8): 805-811.
7. Poggio T, Smale S (2003) The Mathematicss of Learning: Dealing with Data. Notices of the American Mathematics Society 50(5): 537-544.
8. Hung CP, Kreiman G, Poggio T, DiCarlo JJ (2005) Fast readout of object identity from macaque inferior temporal cortex. Science 310(5749): 863-866.
9. Macmillan NA, Crechnan CD (1991) Detection Theory: A User's Guide. New York: Cambridge University Press.
10. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A (2001) Neurophysiological investigation of the basis of the JMRI signal. Nature 412(6843): 150-157.
11. Nir Y, Fisch L, Mukamel R, Gelbard-Sagiv H, Arieli A, et al. (2007) Coupling between neuronall firing rate, gamma LFP, and BOLD IMRI is related to interneuronal correlations. Curr Biol 17(15): 1275-1285.
12. Nir Y, Mukamel R, Dinstein I, Privman E, Harel M, et al. (2008) Interhemispheric correlations of slow spontaneous neuronal fluctuations revealed in human sensory cortex. Nat Neurosci.
13. Haxby JV, Ruffman FA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci (Regul Ed). pp 223-233.
14. Allison T, Puce A, McCarthy G (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci 4(7): 267-278.
15. Schyns PG, Petro LS, Smith ML (2007) Dynamics of visual information integration in the brain for categorizing facial expressions. Curr Biol 17(18): 1580-1585.
16. Smith ML, Cottrell GW, Gosselin F, Schyns PG (2005) Transmitting and decoding facial expressions. Psychol Sci 16(3): 184-189.
17. Calder AJ, Young AW (2005) Understanding the recognition of facial identity and facial expression. Nat Rev Neurosci. pp 641-651.
18. De Renzi E, Perani D, Carlesimo GA, Silveri MG, Fazio F (1994) Prosopagnosia. can be associated with damage confined to the right hemisphere-an MRI and PET study and a review of the literature. Neuropsychologia 32(8): 893-902.
19. Adolphs R, Damasio H, Tranel D, Cooper G, Damasio AR (2000) A role for somatosensory cortices in the visual recognition of emotion as revealed by three-dimensional lesion mapping. J Neurosci 20(7): 2683-2690.
20. McCarthy G, Puce A, Gore JC, Allison T (1997) Face-specific processing in the human fusiform gyrus. Journal of Cognitive Neuroscience 9: 605-610.
21. Fried J, Mateer C, Ojermann G, Wohns R, Fedio P (1982) Organization of visuospatial functions in human cortex. Evidence from electrical stimulation. Brain. pp 349-371.
22. Morris JS, Frith CD, Perrett DI, Rowland D, Young AW, et al. (1996) A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383(6603): 812-815.
23. Sergent J, Ohta S, MacDonald B (1992) Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain 115Pt 1: 15-36.
24. Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17(11): 4302-4311.
25. LaBar KS, Crupain MJ, Voyvodic JT, McCarthy G (2003) Dynamic perception of facial affect and identity in the human brain. Cereb Cortex 13(10): 1023-1033.
26. Sato W, Kochiyama T, Yoshikawa S, Naito E, Matsumura M (2004) Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. Brain Res Cogn Brain Res 20(1): 81-91.
27. Bentin S, Allison T, Puce A, Perez E, McCarthy G (1996) Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience 8: 551-565.
28. Seeck M, Michel CM, Mainwaring N, Cosgrove R, Blume H, et al. (1997) Evidence for rapid face recognition from human scalp and intracranial electrodes. Neuroreport 8(12): 2749-2754.
29. Eimer M, Holmes A (2007) Event-related brain potential correlates of emotional face processing. Neuropsychologia 45(1): 15-31.
30. Mouchetant-Rostaing Y, Giard MH, Bentin S, Aguera PE, Pernier J (2000) Neurophysiological correlates of face gender processing in humans. Eur J Neurosci 12(1): 303-310.
31. Pizzagalli D, Regard M, Lehmann D (1999) Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. Neuroreport 10(13): 2691-2698.
32. Liu J, Harris A, Kanwisher N (2002) Stages of processing in face perception: an MEG study. Nat Neurosci 5(9): 910-916.
33. Halgren E, Raij T, Marinkovic K, Jousmaki V, Hari R (2000) Cognitive response profile of the human fusiform face area as determined by MEG. Cereb Cortex 10(1): 69-81.
34. Krolak-Salmon P, Henaff MA, Vighetto A, Bertrand O, Mauguiere F (2004) Early amygdala reaction to fear spreading in occipital, temporal, and frontal cortex: a depth electrode ERP study in human. Neuron 42(4): 665-676.
35. Lachaux JP, George N, Tallon-Baudry C, Martinerie J, Hugueville L, et al. (2005) The many faces of the gamma band response to complex visual stimuli. Neuroimage 25(2): 491-501.
36. Bruce V, Young A (1986) Understanding face recognition. British journal of psychology (London, England : 1953). pp 305-327.
37. Kanwisher N, Yovel G (2006) The fusiform face area: a cortical region specialized for the perception of faces. Philos Trans R Soc Lond B Biol Sci 361(1476): 2109-2128.
38. Adolphs R, Tranel D, Hamann S, Young AW, Calder AJ, et al. (1999) Recognition of facial emotion in nine individuals with bilateral amygdala damage. Neuropsychologia 37(10): 1111-1117.
39. Phillips ML, Young AW, Senior C, Brammer M, Andrew C, et al. (1997) A specific neural substrate for perceiving facial expressions of disgust. Nature 389(6650): 495-498.
40. Sugase Y, Yamane S, Ueno S, Kawano K (1999) Global and fine information coded by single neurons in the temporal visual cortex. Nature 400(6747): 869-873.
41. Young MP, Yamane S (1992) Sparse population coding of faces in the inferotemporal cortex. Science 256(5061): 1327-1331.
42. Mitzdorf U (1985) Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. Physiological reviews 65(1): 37-100.
43. VanRullen R, Thorpe SJ (2001) The time course of visual processing: from early perception to decision-making. J Cogn Neurosci 13(4): 454-461.
44. Foxe JJ, Simpson GV (2002) Flow of activation from V1 to frontal cortex in humans. A framework for defining "early" visual processing. Exp Brain Res 142(1): 139-150.
45. Canolty RT, Edwards E, Dalal SS, Soltani M, Nagarajan SS, et al. (2006) High gamma power is phase-locked to theta oscillations in human neocortex. Science 313(5793): 1626-1628.
46. Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18: 193-222.
47. Boynton GM (2005) Attention and visual perception. Curr Opin Neurobiol 15(4): 465-469.
48. Tallon-Baudry C, Bertrand O, Henaff MA, Isnard J, Fischer C (2005) Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus. Cereb Cortex 15(5): 654-662.
49. Corbetta M, Shulman GL (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3(3): 201-215.
50. Reddy L, Kanwisher N (2007) Category selectivity in the ventral visual pathway confers robustness to clutter and diverted attention. Curr Biol 17(23): 2067-2072.
51. Fries P, Reynolds JH, Rorie AE, Desimone R (2001) Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291(5508): 1560-1563.
52. Womelsdorf T, Fries P, Mitra PP, Desimone R (2006) Gamma-band synchronization in visual cortex predicts speed of change detection. Nature 439(7077): 733-736.
53. Averbeck BB, Latham PE, Pouget A (2006) Neural correlations, population coding and computation. Nat Rev Neurosci 7(5): 358-366.
54. Kriegeskorte N, Bandettini P (2007) Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage 38(4): 649-662.
55. Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci U S A 103(10): 3863-3868.
56. Wu MC, David SV, Gallant JL (2006) Complete functional characterization of sensory neurons by system identification. Annu Rev Neurosci 29: 477-505.
57. Ekman P, Friesen WV (1976) Pictures of Facial Affect. Palo Alto, CA: Consulting Psychologist Press.
58. Brainard DH (1997) The Psychophysics Toolbox. Spat Vis 10(4): 433-436.
59. Benjamini Y, Hochberg Y (1995) Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society Series B (Methodological) 57(1): 289-300.