Functional selectivity in the human occipitotemporal cortex during natural vision: Evidence from combined intracranial EEG and eye-tracking

NeuroImage

Volumn 95, Issue , 2014, Pages 276-286

  Hamamé, Carlos M ^a,b,c   Vidal, Juan R ^a,b   Perrone Bertolotti, Marcela ^d   Ossandón, Tomas ^e   Jerbi, Karim ^a,b   Kahane, Philippe ^f,g   Bertrand, Olivier ^a,b   Lachaux, Jean Philippe ^a,b  

^a LYON NEUROSCIENCE RESEARCH CENTER   (France)

^b UNIVERSITÉ LYON 1   (France)

^c AIX MARSEILLE UNIVERSITÉ   (France)

^d UNIVERSITÉ PIERRE MENDÈS FRANCE   (France)

^e PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^f GRENOBLE UNIVERSITY HOSPITAL   (France)

^g GRENOBLE INSTITUT DES NEUROSCIENCES   (France)

Author keywords

Eye movements; Fusiform face area; High frequency gamma activity; Intracranial EEG; Natural vision; Visual word form area

Indexed keywords

ADULT; AMPLITUDE MODULATION; ARTICLE; CASE REPORT; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EPILEPSY; EYE FIXATION; EYE MOVEMENT CONTROL; EYE TRACKING; FEMALE; FUSIFORM FACE AREA; HUMAN; MALE; OCCIPITAL CORTEX; OCCIPITOTEMPORAL CORTEX; PRIORITY JOURNAL; RECEPTIVE FIELD; TEMPORAL CORTEX; VISION; VISUAL DISCRIMINATION; VISUAL NERVOUS SYSTEM; VISUAL STIMULATION; VISUAL WORD FORM AREA; ELECTROENCEPHALOGRAPHY; EYE MOVEMENT; PHYSIOLOGY; SIGNAL PROCESSING; VISUAL CORTEX;

ADULT; ELECTROENCEPHALOGRAPHY; EYE MOVEMENTS; FEMALE; HUMANS; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84901359677     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.03.025     Document Type: Article

References (87)

1. Allison T., Ginter H., McCarthy G., Nobre A.C., Puce A., Luby M., Spencer D.D. Face recognition in human extrastriate cortex. J. Neurophysiol. 1994, 71:821-825.
2. Allison T., Puce A., Spencer D.D., McCarthy G. Electrophysiological studies of human face perception. I: potentials generated in the occipitotemporal cortex by face and non-face stimulus. Cereb. Cortex 1999, 9:415-430.
3. Bisley J.W., Goldberg M.E. Attention, intention, and priority in the parietal lobe. Ann. Rev. Neurosci. 2010, 33:1-21.
4. Brouwer A.M., Reuderink B., Vincent J., van Gerven M.A.J., van Erp J.B.F. Distinguishing between target and nontarget fixations in a visual search task using fixation-related potentials. J. Vis. 2013, 13:1-10.
5. Brunet N., Bosman C.A., Roberts M., Oostenveld R., Womelsdorf T., De Weerd P., Fries P. Visual cortical gamma-band activity during free viewing of natural images. Cereb. Cortex 2014, (in press).
6. Carl C., Açic A., König P., Engel A.K., Hipp J.F. The saccadic spike artifact in MEG. Neuroimage 2012, 59:1657-1667.
7. Chelazzi L., Miller E.K., Duncan J., Desimone R. A neural basis for visual search in inferior temporal cortex. Nature 1993, 363:345-347.
8. Cohen L., Dehaene S., Naccache L., Lehéricy S., Dehaene-Lambertz L., Hénnaf M.A., Michel F. The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subject and posterior split-brain patients. Brain 2000, 123:291-307.
9. Cohen L., Lehericy S., Chochon F., Lemer C., Rivaud S., Dehaene S. Language-specific tuning of visual cortex? Functional properties of the visual word form area. Brain 2002, 125:1054-1069.
10. Corbetta M., Patel G., Shulman G. The reorienting system of the human brain: from environment to theory of mind. Neuron 2008, 58:306-324.
11. Cukur T., Nishimoto S., Huth A.G., Gallant J.L. Attention during natural vision warps semantic representation across the human brain. Nat. Neurosci. 2013, 16:763-770.
12. Dalal S.S., Zumer J.M., Agrawal V., Hild K.E., Sekihara K., Nagarajan S.S. NUTMEG: a neuromagnetic source reconstruction toolbox. Neurol. Clin. Neurophysiol. 2004, 30:52.
13. Dastjerdi M., Ozker M., Foster B.L., Rangarajan V., Parvizi J. Numerical processing in the human parietal cortex during experimental and natural conditions. Nat. Commun. 2013, 4:2528.
14. David S.V., Hayden B.Y., Mazer J.A., Gallant J.L. Attention to stimulus features shifts spectral tuning of V4 neurons during natural vision. Neuron 2008, 59:509-521.
15. Déjerine J. Sur un cas de cécité verbale avec agraphie suivi d'autopsie. Mem. Soc. Biol. 1892, 3:197-201.
16. Engell A.D., McCarthy G. Selective attention modulates face-specific induced gamma oscillations recorded from ventral occipitotemporal cortex. J. Neurosci. 2010, 30:8780-8786.
17. Engell A.D., McCarthy G. The relationship of gamma oscillations and face-specific ERPs recorded subdurally in occipitotemporal cortex. Cereb. Cortex 2011, 21:1213-1221.
18. Fischer T., Graupner S.T., Velichkovsky B.M., Pannasch S. Attentional dynamics during free picture viewing: evidence from oculomotor behavior and electrocortical activity. Front. Syst. Neurosci. 2013, 7:17.
19. Fonov V.S., Evans A.C., Botteron K., Almli C.R., McKinstry R.C., Collins D.L. Unbiased average age-appropriate atlases for pediatric studies. Neuroimage 2011, 54:313-327.
20. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
21. Hamamé C.M., Vidal J.R., Ossandón T., Jerbi K., Dalal S.S., Minotti L., Bertrand O., Kahane P., Lachaux J.P. Reading the mind's eye: online detection of visuo-spatial working memory and visual imagery in the inferior temporal lobe. Neuroimage 2012, 59:72-79.
22. Hamamé C.M., Szwed M., Vidal J.R., Sharman M., Kahane P., Bertrand O., Lachaux J.P. Dejerines' reading area revisited with intracranial-EEG: selective neural responses to letter strings. Neurology 2013, 80:602-603.
23. Hasson U., Levy I., Behrmann M., Hendler T., Malach R. Eccentricity bias as an organizing principle for human high-order object areas. Neuron 2002, 34:479-490.
24. Hasson U., Nir Y., Levy I., Fuhrmann G., Malach R. Intersubject synchronization of cortical activity during natural vision. Science 2004, 303:1634-1640.
25. Henderson J.M., Luke S.G., Schmidt J., Richards J.E. Co-registration of eye movements and event-related potentials in connected-text paragraph reading. Front. Syst. Neurosci. 2013, 7:28.
26. Huth A.G., Nishimoto S., Vu A.T., Gallant J.L. A continuous semantic space describes the representation of thousands of object and action categories across the brain. Neuron 2013, 76:1210-1224.
27. Hutzler F., Braun M., Vo M.L.H., Engl V., Hofmann M., Dambacher M., Leder H., Jacobs A.M. Welcome to the real world: validating fixation-related brain potentials for ecologically valid settings. Brain Res. 2007, 1172:124-129.
28. Itti L., Koch C., Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20:1254-1259.
29. Jerbi K., Ossandon T., Hamamé C.M., Senova S., Dalal S.S., Jung J., Minotti L., Bertrand O., Berthoz A., Kahane P., Lachaux J.P. Task-related brain dynamics from an intracerebral perspective: review and implications for surface EEG and MEG. Hum. Brain Mapp. 2009, 30:1758-1771.
30. Jerbi K., Freyermuth S., Dalal S.S., Kahane P., Bertrand O., Berthoz A., Lachaux J.P. Saccade related gamma-band activity in intracranial EEG: dissociating neural from oculomotor muscle activity. Brain Topogr. 2009, 22:18-23.
31. Jung J., Mainy N., Kahane P., Minotti L., Hoffmann D., Bertrand O., Lachaux J.P. The neural bases of attentive reading. Hum. Brain Mapp. 2008, 29:1193-1206.
32. Juphard A., Vidal J.R., Perrone-Bertolotti M., Minotti L., Kahane P., Lachaux J.P., Baciu M. Direct evidence for two different neural mechanisms for reading familiar and unfamiliar words: an intra-cerebral EEG study. Front. Hum. Neurosci. 2011, 5:101.
33. Kahane P., Minotti L., Hoffmann D., Lachaux J.P., Ryvlin P. Invasive EEG in the definition of the seizure onset zone: depth electrodes. Handbook of Clinical Neurophysiology 2004, 109-133. Elsevier BV, Amsterdam. F. Rosenow, H.O. Lüders (Eds.).
34. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
35. Kaunitz L.N., Kamienkowski J.E., Varatharajah A., Sigman M., Quiroga R.Q., Ison M.J. Looking for a face in the crowd: fixation-related potentials in an eye movement visual search task. Neuroimage 2013, 89:297-305.
36. Keren A.S., Yuval-Greenberg S., Deouell L.Y. Saccadic spike potentials in gamma-band EEG: characterization, detection and suppression. Neuroimage 2010, 49:2248-2263.
37. Kliegl R., Dambacher M., Dimigen O., Jacobs A.M., Sommer W. Eye movements and brain electric potentials during reading. Psychol. Res. 2012, 76:145-158.
38. Kovach C.K., Tsuchiya N., Kawasaki H., Oya H., Howard M.A., Adolphs R. Manifestation of ocular-muscle EMG contamination in human intracranial recordings. Neuroimage 2011, 54:213-233.
39. Kravitz D.J., Saleem K.S., Baker C.I., Ungerleider L.G., Mishkin M. The ventral visual pathway: an expanded neural framework for the processing of object quality. Trends Cogn. Sci. 2013, 17:26-49.
40. Lachaux J.P., George N., Tallon-Baudry C., Martinerie J., Hugueville L., Minotti L., Kahane P., Renault B. The many faces of the gamma band response to complex visual stimuli. Neuroimage 2005, 25:491-501.
41. Lachaux J.P., Hoffmann D., Minotti L., Berthoz A., Kahane P. Intracranial dynamics of saccade generation in the human frontal eye field and supplemental eye field. Neuroimage 2006, 30:1302-1312.
42. Lachaux J.P., Fonlupt P., Kahane P., Minotti L., Hoffmann D., Bertrand O., Baciu M. Relationship between task-related gamma oscillations and bold signal: new insights from combined fMRI and intracranial EEG. Hum. Brain Mapp. 2007, 28:1368-1375.
43. Lachaux J.P., Jerbi K., Bertrand O., Minotti L., Hoffmann D., Schoendorff B., Kahane P. A blue print for real-time functional mapping via human intracranial recordings. PLoS One 2007, 2:e1094.
44. Le Van Quyen M., Foucher J., Lachaux J.P., Rodriguez E., Lutz A., Martinerie J., Varela F.J. Comparison of Hilbert transform and wavelet methods for the analysis of neuronal synchrony. J. Neurosci. Methods 2001, 111:83-98.
45. Le Van Quyen M., Staba R., Bragin A., Dickson C., Valderrama M., Fried I., Engel J. Large-scale microelectrodes recordings of high-frequency gamma oscillations in human cortex during sleep. J. Neurosci. 2010, 30:7770-7782.
46. Li W., Piech V., Gilbert C.D. Perceptual learning and top-down influences in primary visual cortex. Nat. Neurosci. 2004, 7:651-657.
47. Mainy N., Jung J., Baciu M., Kahane P., Schoendorff B., Minotti L., Hoffmann D., Bertrand O., Lachaux J.P. Cortical dynamics of word recognition. Hum. Brain Mapp. 2008, 29:1215-1230.
48. Malach R., Levy I., Hasson U. The topography of high-order humanobject areas. Trends Cogn Sci 2002, 6:176-184.
49. Manning J.R., Jacobs J., Fried I., Kahana M.J. Broadband shifts in local field potential power spectra are correlated with single-neuron spiking in humans. J. Neurosci. 2009, 29:13613-13620.
50. Mazer J.A., Gallant J.L. Goal-related activity in V4 during free viewing visual search: evidence for a ventral stream visual salience map. Neuron 2003, 40:1241-1250.
51. Moran J., Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science 1985, 229:782-784.
52. Nagasawa T., Matsuzaki N., Juhasz C., Hanazawa A., Shah A., Mittal S., Sood S., Asano E. Occipital gamma-oscillations modulated during eye-movement tasks: simultaneous eye tracking and electrocorticography recording in epileptic patients. Neuroimage 2011, 58:1101-1109.
53. Nikolaev A.R., Nakatani C., Plomp G., Jurica P., van Leeuwen C. Eye fixation-related potentials in free viewing identify encoding failures in change detection. Neuroimage 2011, 56:1598-1607.
54. Nobre A.C., Allison T., McCarthy G. Word recognition in the human inferior temporal lobe. Nature 1994, 372:260-263.
55. Ojemann J.G., Ojemann G.A., Lettich E. Neuronal activity related to faces and matching in human right nondominant temporal cortex. Brain 1992, 115:1-13.
56. Ossandon J.P., Helo A.V., Montefusco-Siegmund R., Maldonado P.E. Superposition model predicts EEG occipital activity during free viewing of natural scenes. J. Neurosci. 2010, 30:4787-4795.
57. Ossandón T., Jerbi K., Vidal J.R., Bayle D., Hennaf M.A., Jung J., Minotti L., Bertrand O., Kahane P., Lachaux J.P. Transient suppression of broadband gamma power in the default-mode network is correlated with task complexity and subject performance. J. Neurosci. 2011, 31:14521-14530.
58. Ossandon T., Vidal J.R., Ciumas C., Jerbi K., Hamamé C.M., Dalal S.S., Bertrand O., Minotti L., Kahane P., Lachaux J.P. Efficient 'pop-out' visual search elicits sustained broadband gamma activity in the dorsal attention network. J. Neurosci. 2012, 32:3414-3421.
59. Parvizi J., Jacques C., Foster B.L., Withoft N., Rangarajan V., Weiner K.S., Grill-Spector K. Electrical stimulation of human fusiform face-selective regions distorts face perception. J. Neurosci. 2012, 32:14915-14920.
60. Plöchl M., Ossandon J.P., König P. Combining EEG and eye tracking: identification, characterization, and correction of eye movement artifact in electroencephalographic data. Front. Hum. Neurosci. 2012, 6:278.
61. Rama P., Baccino T. Eye fixation-related potentials (EFRPs) during object identification. Vis. Neurosci. 2010, 27:187-192.
62. Rao H., Wang J., Tang K., Detre J.A. Imaging brain activity during natural vision using CASL perfusion fMRI. Hum. Brain Mapp. 2007, 28:593-601.
63. Ray S., Maunsell J.H.R. Different origins of gamma rhythm and high-gamma activity in macaque visual cortex. PLoS Biol. 2011, 9:e1000610.
64. Rensink R., O'Regan J., Clark J. To see or not to see: the need for attention to perceive changes in scenes. Psychol. Sci. 1997, 8:368-373.
65. S.R.Research Eyelink 1000 User's Manual 2006, SR Research, Mississauga.
66. Rolls E.T., Aggelopoulos N.C., Zheng F. The receptive fields of inferior temporal cortex neurons in natural scenes. J. Neurosci. 2003, 23:339-348.
67. Rousselet G.A., Fabre-Thorpe M., Thorpe S.J. Parallel processing in high-level categorization of natural images. Nat. Neurosci. 2002, 5:629-630.
68. Simmons D.J., Chabris C.F. Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception 1999, 28:1059-1074.
69. Sommer M.A., Wurtz R.H. Brain circuits for the internal monitoring of movements. Ann. Rev. Neurosci. 2008, 31:317-338.
70. Talairach J., Tounoux P. Referentially Oriented Cerebral MRI Anatomy: An Atlas of Stereotaxic Anatomical Correlations for Gray and White Matter 1993, Thieme Medical Publishers, New York.
71. Tallon-Baudry C., Bertrand O., Hénaff M.A., Isnard J., Fischer C. Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus. Cereb. Cortex 2005, 15:654-662.
72. Thorpe S., Fize D., Marlot C. Speed of processing in the human visual system. Nature 1996, 381:520-522.
73. Torralba A., Oliva A., Castellano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol. Rev. 2006, 113:766-786.
74. Treisman A., Gelade G. A feature integration theory of attention. Cogn. Psychol. 1980, 12:97-136.
75. Treue S., Maunsell J.H.R. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 1996, 382:539-541.
76. Trujillo L.T., Peterson M.A., Kaszniak A.W., Allen J.J. EEG phase synchrony differences across visual perception conditions may depend on recording and analysis methods. Clin. Neurophysiol. 2005, 116:172-189.
77. Vidal J.R., Ossandon T., Jerbi K., Dalal S.S., Minotti L., Ryvlin P., Kahane P., Lachaux J.P. Category-specific visual responses: an intracranial study comparing gamma, beta, alpha, and ERP response selectivity. Front. Hum. Neurosci. 2010, 4:A195.
78. Vidal J.R., Freyermuth S., Jerbi K., Hamamé C.M., Ossandon T., Bertrand O., Minotti L., Kahane P., Berthoz A., Lachaux J.P. Long-distance amplitude correlations in the high gamma-band reveal segregation and integration within the reading network. J. Neurosci. 2012, 32:6421-6434.
79. Vo M.L., Henderson J.M. The time course of initial scene processing for eye-movement guidance in natural scene search. J. Vis. 2010, 10:1-13.
80. Whittingstall K., Bartels A., Singh V., Kwon S., Logothetis N.K. Integration of EEG source imaging and fMRI during continuous viewing of natural movies. Magn. Reson. Imaging 2010, 28:1135-1142.
81. Willmore B.D.B., Prenger R.J., Gallant J.L. Neural representation of natural images in visual area V2. J. Neurosci. 2010, 10:2102-2114.
82. Wolfe J.M. Visual search in continuous, naturalistic stimuli. Vis. Res. 1994, 34:1187-1195.
83. Wolfe J.M., Vo M.L.H., Evans K.K., Greene M.R. Visual search in scenes involves selective and nonselective pathways. Trends Cogn. Sci. 2011, 15:77-84.
84. Yarbus A.L. Eye Movements and Vision 1967, Plenum Press, New York.
85. Yoshor D., Bosking W.H., Ghose G.M., Maunsell J.H.R. Receptive fields in human visual cortex mapped with surface electrodes. Cereb. Cortex 2012, 17:2293-2302.
86. Yuval-Greenberg S., Tomer O., Keren A.S., Nelken I., Deouell L.Y. Transient induced gamma-band response in EEG as a manifestation of miniature saccades. Neuron 2008, 58:429-441.
87. Zelinsky G.J. A theory of eye movements during target acquisition. Psychol. Rev. 2008, 115:787-835.