Single-trial EEG-informed fMRI reveals spatial dependency of BOLD signal on early and late IC-ERP amplitudes during face recognition

NeuroImage

Volumn 100, Issue , 2014, Pages 325-336

  Wirsich, Jonathan ^a,b,c   Bénar, Christian ^c   Ranjeva, Jean Philippe ^a,b   Descoins, Médéric ^a,b,c   Soulier, Elisabeth ^a,b   Le Troter, Arnaud ^a,b   Confort Gouny, Sylviane ^a,b   Liégeois Chauvel, Catherine ^c   Guye, Maxime ^a,b  

^a University of Aix Marseille   (France)

^b TIMONE HOSPITAL   (France)

^c AIX MARSEILLE UNIVERSITÉ   (France)

Author keywords

Evoked potentials; Face recognition; ICA; Simultaneous EEG fMRI; Ventral visual pathway

Indexed keywords

ADULT; ARTICLE; BOLD SIGNAL; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAM FUNCTIONAL MAGNETIC RESONANCE IMAGING; EVOKED RESPONSE; FACE RECOGNITION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; INDEPENDENT COMPONENT ANALYSIS; INFERIOR FRONTAL GYRUS; INFERIOR TEMPORAL GYRUS; INSULA; MALE; MIDDLE OCCIPITAL GYRUS; MIDDLE TEMPORAL GYRUS; NEUROMODULATION; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; OCCIPITAL GYRUS; ORBITAL CORTEX; PARAHIPPOCAMPAL GYRUS; POSTCENTRAL GYRUS; PRIORITY JOURNAL; RECOGNITION; SPATIOTEMPORAL ANALYSIS; STATISTICAL MODEL; SUPERIOR TEMPORAL GYRUS; ELECTROENCEPHALOGRAPHY; FACE; FUNCTIONAL NEUROIMAGING; MIDDLE AGED; MULTIMODAL IMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHYSIOLOGY; PROCEDURES; VISUAL SYSTEM; YOUNG ADULT;

ADULT; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FACE; FUNCTIONAL NEUROIMAGING; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MULTIMODAL IMAGING; PATTERN RECOGNITION, VISUAL; RECOGNITION (PSYCHOLOGY); VISUAL PATHWAYS; YOUNG ADULT;

EID: 84904065726     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.05.075     Document Type: Article

References (77)

1. Allen P.J., Polizzi G., Krakow K., Fish D.R., Lemieux L. Identification of EEG events in the MR scanner: the problem of pulse artifact and a method for its subtraction. NeuroImage 1998, 8:229-239.
2. Allen P.J., Josephs O., Turner R. A method for removing imaging artifact from continuous EEG recorded during functional MRI. NeuroImage 2000, 12:230-239.
3. Allison T., Puce A., Spencer D.D., McCarthy G. Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb. Cortex 1999, 9:415-430.
4. Babiloni F., Carducci F., Cincotti F., Del Gratta C., Roberti G.M., Romani G.L., Rossini P.M., Babiloni C. Integration of high resolution EEG and functional magnetic resonance in the study of human movement-related potentials. Methods Inf. Med. 2000, 39:179-182.
5. Bagshaw A.P., Warbrick T. Single trial variability of EEG and fMRI responses to visual stimuli. NeuroImage 2007, 38:280-292.
6. Barbeau E.J., Taylor M.J., Regis J., Marquis P., Chauvel P., Liégeois-Chauvel C. Spatio temporal dynamics of face recognition. Cereb. Cortex 2008, 18:997-1009.
7. Bell A.J., Sejnowski T.J. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 1995, 7:1129-1159.
8. Bénar C.-G., Schön D., Grimault S., Nazarian B., Burle B., Roth M., Badier J.-M., Marquis P., Liegeois-Chauvel C., Anton J.-L. Single-trial analysis of oddball event-related potentials in simultaneous EEG-fMRI. Hum. Brain Mapp. 2007, 28:602-613.
9. Bentin S., Deouell L.Y. Structural encoding and identification in face processing: erp evidence for separate mechanisms. Cogn. Neuropsychol. 2000, 17:35-55.
10. Bentin S., Allison T., Puce A., Perez E., McCarthy G. Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 1996, 8:551-565.
11. Bergstrom Z.M., Henson R.N., Taylor J.R., Simons J.S. Multimodal imaging reveals the spatiotemporal dynamics of recollection. NeuroImage 2013, 68:141-153.
12. Bernard F.A., Bullmore E.T., Graham K.S., Thompson S.A., Hodges J.R., Fletcher P.C. The hippocampal region is involved in successful recognition of both remote and recent famous faces. NeuroImage 2004, 22:1704-1714.
13. Boehm S.G., Sommer W. Neural correlates of intentional and incidental recognition of famous faces. Brain Res. Cogn. Brain Res. 2005, 23:153-163.
14. Bojak I., Oostendorp T.F., Reid A.T., Kötter R. Towards a model-based integration of co-registered electroencephalography/functional magnetic resonance imaging data with realistic neural population meshes. Philos. Transact. A Math. Phys. Eng. Sci. 2011, 369:3785-3801.
15. Bruce V., Young A. Understanding face recognition. Br. J. Psychol. 1986, 77(Pt 3):305-327.
16. Bullmore E. The future of functional MRI in clinical medicine. NeuroImage 2012, 62:1267-1271.
17. Calhoun V.D., Adali T., Pearlson G.D., Kiehl K.A. Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential data. NeuroImage 2006, 30:544-553.
18. De Vos M., De Lathauwer L., Van Huffel S. Spatially constrained ICA algorithm with an application in EEG processing. Signal Process. 2011, 91:1963-1972.
19. De Vos M., Thorne J.D., Yovel G., Debener S. Let's face it, from trial to trial: comparing procedures for N170 single-trial estimation. NeuroImage 2012, 63:1196-1202.
20. Debener S., Ullsperger M., Siegel M., Fiehler K., von Cramon D.Y., Engel A.K. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 2005, 25:11730-11737.
21. Debener S., Ullsperger M., Siegel M., Engel A.K. Single-trial EEG-fMRI reveals the dynamics of cognitive function. Trends Cogn. Sci. 2006, 10:558-563.
22. Deffke I., Sander T., Heidenreich J., Sommer W., Curio G., Trahms L., Lueschow A. MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus. NeuroImage 2007, 35:1495-1501.
23. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134:9-21.
24. Eichele T., Specht K., Moosmann M., Jongsma M.L.A., Quiroga R.Q., Nordby H., Hugdahl K. Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. Proc. Natl. Acad. Sci. U. S. A. 2005, 102:17798-17803.
25. Eichele T., Rachakonda S., Brakedal B., Eikeland R., Calhoun V.D. EEGIFT: group independent component analysis for event-related EEG data. Comput. Intell. Neurosci. 2011, 2011:129365.
26. Eimer M. Event-related brain potentials distinguish processing stages involved in face perception and recognition. Clin. Neurophysiol. 2000, 111:694-705.
27. Elfgren C., van Westen D., Passant U., Larsson E.-M., Mannfolk P., Fransson P. fMRI activity in the medial temporal lobe during famous face processing. NeuroImage 2006, 30:609-616.
28. Friston K., Harrison L., Daunizeau J., Kiebel S., Phillips C., Trujillo-Barreto N., Henson R., Flandin G., Mattout J. Multiple sparse priors for the M/EEG inverse problem. NeuroImage 2008, 39:1104-1120.
29. Fuglø D., Pedersen H., Rostrup E., Hansen A.E., Larsson H.B.W. Correlation between single-trial visual evoked potentials and the blood oxygenation level dependent response in simultaneously recorded electroencephalography-functional magnetic resonance imaging. Magn. Reson. Med. 2012, 68:252-260.
30. George N., Dolan R.J., Fink G.R., Baylis G.C., Russell C., Driver J. Contrast polarity and face recognition in the human fusiform gyrus. Nat. Neurosci. 1999, 2:574-580.
31. Gobbini M.I., Haxby J.V. Neural systems for recognition of familiar faces. Neuropsychologia 2007, 45:32-41.
32. Gorno-Tempini M.L., Price C.J. Identification of famous faces and buildings: a functional neuroimaging study of semantically unique items. Brain 2001, 124:2087-2097.
33. Haxby J.V., Ungerleider L.G., Horwitz B., Maisog J.M., Rapoport S.I., Grady C.L. Face encoding and recognition in the human brain. Proc. Natl. Acad. Sci. U. S. A. 1996, 93:922-927.
34. Haxby, Hoffman, Gobbini The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
35. Haynes J.-D. Decoding visual consciousness from human brain signals. Trends Cogn. Sci. 2009, 13:194-202.
36. Henson R.N.A., Shallice T., Gorno-Tempini M.L., Dolan R.J. Face repetition effects in implicit and explicit memory tests as measured by fMRI. Cereb. Cortex 2002, 12:178-186.
37. Henson R.N., Goshen-Gottstein Y., Ganel T., Otten L.J., Quayle A., Rugg M.D. Electrophysiological and haemodynamic correlates of face perception, recognition and priming. Cereb. Cortex 2003, 13:793-805.
38. Henson R.N., Mouchlianitis E., Friston K.J. MEG and EEG data fusion: simultaneous localisation of face-evoked responses. NeuroImage 2009, 47:581-589.
39. Henson R.N., Flandin G., Friston K.J., Mattout J. A parametric empirical Bayesian framework for fMRI-constrained MEG/EEG source reconstruction. Hum. Brain Mapp. 2010, 31:1512-1531.
40. Himberg J., Hyvarinen A. Icasso: Software for Investigating the Reliability of ICA Estimates by Clustering and Visualization 2003.
41. Horovitz S.G., Rossion B., Skudlarski P., Gore J.C. Parametric design and correlational analyses help integrating fMRI and electrophysiological data during face processing. NeuroImage 2004, 22:1587-1595.
42. Horwitz B., Poeppel D. How can EEG/MEG and fMRI/PET data be combined?. Hum. Brain Mapp. 2002, 17:1-3.
43. Huster R.J., Debener S., Eichele T., Herrmann C.S. Methods for simultaneous EEG-fMRI: an introductory review. J. Neurosci. 2012, 32:6053-6060.
44. Ishai A. Let's face it: it's a cortical network. NeuroImage 2008, 40:415-419.
45. Itier R.J., Taylor M.J. Source analysis of the N170 to faces and objects. Neuroreport 2004, 15:1261-1265.
46. Ives J.R., Warach S., Schmitt F., Edelman R.R., Schomer D.L. Monitoring the patient's EEG during echo planar MRI. Electroencephalogr. Clin. Neurophysiol. 1993, 87:417-420.
47. Iyer D., Zouridakis G. Single-trial evoked potential estimation: comparison between independent component analysis and wavelet denoising. Clin. Neurophysiol. 2007, 118:495-504.
48. Josephs O., Henson R.N. Event-related functional magnetic resonance imaging: modelling, inference and optimization. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1999, 354:1215-1228.
49. Kapur N., Friston K.J., Young A., Frith C.D., Frackowiak R.S. Activation of human hippocampal formation during memory for faces: a PET study. Cortex 1995, 31:99-108.
50. Kobayashi E., Bagshaw A.P., Gotman J., Dubeau F. Metabolic correlates of epileptic spikes in cerebral cavernous angiomas. Epilepsy Res. 2007, 73:98-103.
51. Laufs H. A personalized history of EEG-fMRI integration. NeuroImage 2012, 62:1056-1067.
52. Lemieux L., Krakow K., Fish D.R. Comparison of spike-triggered functional MRI BOLD activation and EEG dipole model localization. NeuroImage 2001, 14:1097-1104.
53. Leveroni C.L., Seidenberg M., Mayer A.R., Mead L.A., Binder J.R., Rao S.M. Neural systems underlying the recognition of familiar and newly learned faces. J. Neurosci. 2000, 20:878-886.
54. Litvak V., Friston K. Electromagnetic source reconstruction for group studies. NeuroImage 2008, 42:1490-1498.
55. Martínez-Montes E., Valdés-Sosa P.A., Miwakeichi F., Goldman R.I., Cohen M.S. Concurrent EEG/fMRI analysis by multiway Partial Least Squares. NeuroImage 2004, 22:1023-1034.
56. Mattout J., Henson R.N., Friston K.J. Canonical source reconstruction for MEG. Comput. Intell. Neurosci. 2007, 67613.
57. Mitchell T.M., Shinkareva S.V., Carlson A., Chang K.M., Malave V.L., Mason R.A., Just M.A. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320:1191-1195.
58. Nagai Y., Critchley H.D., Featherstone E., Fenwick P.B.C., Trimble M.R., Dolan R.J. Brain activity relating to the contingent negative variation: an fMRI investigation. NeuroImage 2004, 21:1232-1241.
59. Navajas J., Ahmadi M., Quian Quiroga R. Uncovering the mechanisms of conscious face perception: a single-trial study of the n170 responses. J. Neurosci. 2013, 33:1337-1343.
60. Nguyen V.T., Cunnington R. The superior temporal sulcus and the N170 during face processing: single trial analysis of concurrent EEG-fMRI. NeuroImage 2014, 86:492-502.
61. Nguyen V.T., Breakspear M., Cunnington R. Fusing concurrent EEG-fMRI with dynamic causal modeling: Application to effective connectivity during face perception. NeuroImage 2013, 10.1016/j.neuroimage.2013.06.083.
62. Onton J., Westerfield M., Townsend J., Makeig S. Imaging human EEG dynamics using independent component analysis. Neurosci. Biobehav. Rev. 2006, 30:808-822.
63. Paller K.A., Voss J.L., Boehm S.G. Validating neural correlates of familiarity. Trends Cogn. Sci. 2007, 11:243-250.
64. Rodriguez V., Thompson R., Stokes M., Brett M., Alvarez I., Valdes-Sosa M., Duncan J. Absence of face-specific cortical activity in the complete absence of awareness: converging evidence from functional magnetic resonance imaging and event-related potentials. J. Cogn. Neurosci. 2012, 24:396-415.
65. Rosa M.J., Daunizeau J., Friston K.J. EEG-fMRI integration: a critical review of biophysical modeling and data analysis approaches. J. Integr. Neurosci. 2010, 9:453-476.
66. Rossion B., Jacques C. Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. NeuroImage 2008, 39:1959-1979.
67. Rossion B., Schiltz C., Robaye L., Pirenne D., Crommelinck M. How does the brain discriminate familiar and unfamiliar faces?: a PET study of face categorical perception. J. Cogn. Neurosci. 2001, 13:1019-1034.
68. Rossion B., Joyce C.A., Cottrell G.W., Tarr M.J. Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. NeuroImage 2003, 20:1609-1624.
69. Saavedra C., Iglesias J., Olivares E.I. Event-related potentials elicited by the explicit and implicit processing of familiarity in faces. Clin. EEG Neurosci. 2010, 41:24-31.
70. Sadeh B., Podlipsky I., Zhdanov A., Yovel G. Event-related potential and functional MRI measures of face-selectivity are highly correlated: a simultaneous ERP-fMRI investigation. Hum. Brain Mapp. 2010, 31:1490-1501.
71. Sergent J., Ohta S., MacDonald B. Functional neuroanatomy of face and object processing A positron emission tomography study. Brain 1992, 115(Pt 1):15-36.
72. Shibata T., Nishijo H., Tamura R., Miyamoto K., Eifuku S., Endo S., Ono T. Generators of visual evoked potentials for faces and eyes in the human brain as determined by dipole localization. Brain Topogr. 2002, 15:51-63.
73. Trenner M.U., Schweinberger S.R., Jentzsch I., Sommer W. Face repetition effects in direct and indirect tasks: an event-related brain potentials study. Brain Res. Cogn. Brain Res. 2004, 21:388-400.
74. Valdes-Sosa P.A., Vega-Hernandez M., Sanchez-Bornot J.M., Martinez-Montes E., Bobes M.A. EEG source imaging with spatio-temporal tomographic nonnegative independent component analysis. Hum. Brain Mapp. 2009, 30:1898-1910.
75. Walz J.M., Goldman R.I., Carapezza M., Muraskin J., Brown T.R., Sajda P. Simultaneous EEG-fMRI reveals a temporal cascade of task-related and default-mode activations during a simple target detection task. NeuroImage 2013, 10.1016/j.neuroimage.2013.08.014.
76. Warbrick T., Bagshaw A.P. Scanning strategies for simultaneous EEG-fMRI evoked potential studies at 3T. Int. J. Psychophysiol. 2008, 67:169-177.
77. Warbrick T., Arrubla J., Boers F., Neuner I., Shah N.J. Attention to detail: why considering task demands is essential for single-trial analysis of BOLD correlates of the visual P1 and N1. J. Cogn. Neurosci. 2014, 26:529-542.