Fusing concurrent EEG-fMRI with dynamic causal modeling: Application to effective connectivity during face perception

NeuroImage

Volumn 102, Issue P1, 2014, Pages 60-70

  Nguyen, Vinh T ^a   Breakspear, Michael ^b,c,d,e   Cunnington, Ross ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b QIMR BERGHOFER MEDICAL RESEARCH INSTITUTE   (Australia)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

^d BLACK DOG INSTITUTE   (Australia)

^e ROYAL BRISBANE AND WOMEN'S HOSPITAL   (Australia)

Author keywords

Concurrent EEG fMRI; Dynamic causal modeling; Effective connectivity; Face processing; Multimodal neuroimaging

Indexed keywords

ADULT; BRAIN REGION; CAUSAL MODELING; CONNECTOME; CONTROLLED STUDY; DYNAMIC CAUSAL MODELING; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FACE PERCEPTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM FACE AREA; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; MALE; OCCIPITAL FACE AREA; OCCIPITAL LOBE; PERCEPTION; REVIEW; SUPERIOR TEMPORAL SULCUS; TASK PERFORMANCE; VISUAL CORTEX; VISUAL INFORMATION; BIOLOGICAL MODEL; FACE; MULTIMODAL IMAGING; NERVE CELL NETWORK; NEUROIMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; VISION;

ELECTROENCEPHALOGRAPHY; FACE; HUMANS; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; MULTIMODAL IMAGING; NERVE NET; NEUROIMAGING; VISUAL PERCEPTION;

EID: 84908364628     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.06.083     Document Type: Review

References (68)

1. Aguirre G.K., Singh R., D'Esposito M. Stimulus inversion and the responses of face and object-sensitive cortical areas. Neuroreport 1999, 10:189-194.
2. Allen P.J., Josephs O., Turner R. A method for removing imaging artifact from continuous EEG recorded during functional MRI. NeuroImage 2000, 12:230-239.
3. Bentin S., Allison T., Puce A., Perez E., McCarthy G. Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 1996, 8:551-565.
4. Bötzel K., Schulze S., Stodieck S.R. Scalp topography and analysis of intracranial sources of face-evoked potentials. Exp. Brain Res. 1995, 104:135-143.
5. Breakspear M., Stam C.J. Dynamics of a neural system with a multiscale architecture. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2005, 360:1051-1074.
6. Caharel S., Fiori N., Bernard C., Lalonde R., Rebaï M. The effects of inversion and eye displacements of familiar and unknown faces on early and late-stage ERPs. Int. J. Psychophysiol. 2006, 62:141-151.
7. Cerutti S., Baselli G., Liberati D., Pavesi G. Single sweep analysis of visual evoked potentials through a model of parametric identification. Biol. Cybern. 1987, 56:111-120.
8. Daunizeau J., Grova C., Marrelec G., Mattout J., Jbabdi S., Pelegrini-Issac M., Lina J.-M., Benali H. Symmetrical event-related EEG/fMRI information fusion in a variational Bayesian framework. NeuroImage 2007, 36:69-87.
9. Daunizeau J., Friston K.J., Kiebel S.J. Variational Bayesian identification and prediction of stochastic nonlinear dynamic causal models. Physica D 2009, 238:2089-2118.
10. Daunizeau J., Kiebel S.J., Friston K.J. Dynamic causal modelling of distributed electromagnetic responses. NeuroImage 2009, 47:590-601.
11. Debener S., Ullsperger M., Siegel M., Fiehler K., von Cramon D.Y., Engel A.K. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 2005, 25:11730-11737.
12. Debener S., Ullsperger M., Siegel M., Engel A.K. Single-trial EEG-fMRI reveals the dynamics of cognitive function. Trends Cogn. Sci. 2006, 10:558-563.
13. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134:9-21.
14. Eichele T., Specht K., Moosmann M., Jongsma M.L.A., Quiroga R.Q., Nordby H., Hugdahl K. Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. Proc. Natl. Acad. Sci. U. S. A. 2005, 102:17798-17803.
15. Eichele T., Calhoun V.D., Debener S. Mining EEG-fMRI using independent component analysis. Int. J. Psychophysiol. 2009, 73:53-61.
16. Eickhoff S.B., Stephan K.E., Mohlberg H., Grefkes C., Fink G.R., Amunts K., Zilles K. A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. NeuroImage 2005, 25:1325-1335.
17. Eimer M. Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. Brain Res. Cogn. Brain Res. 2000, 10:145-158.
18. Epstein R.A., Higgins J.S., Parker W., Aguirre G.K., Cooperman S. Cortical correlates of face and scene inversion: a comparison. Neuropsychologia 2006, 44:1145-1158.
19. Fairhall S.L., Ishai A. Effective connectivity within the distributed cortical network for face perception. Cereb. Cortex 2007, 17:2400-2406.
20. Felleman D.J., Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1991, 1:1-47.
21. Friston K.J. Causal modelling and brain connectivity in functional magnetic resonance imaging. PLoS Biol. 2009, 7:e1000033.
22. Friston K.J. Functional and effective connectivity: a review. Brain Connect. 2011, 1:13-36.
23. Friston K.J., Harrison L., Penny W. Dynamic causal modelling. NeuroImage 2003, 19:1273-1302.
24. Friston K.J., Li B., Daunizeau J., Stephan K.E. Network discovery with DCM. NeuroImage 2011, 56:1202-1221.
25. Garrido M.I., Kilner J.M., Kiebel S.J., Stephan K.E., Friston K.J. Dynamic causal modelling of evoked potentials: a reproducibility study. NeuroImage 2007, 36:571-580.
26. Grill-Spector K., Knouf N., Kanwisher N. The fusiform face area subserves face perception, not generic within-category identification. Nat. Neurosci. 2004, 7:555-562.
27. Gschwind M., Pourtois G., Schwartz S., Van De Ville D., Vuilleumier P. White-matter connectivity between face-responsive regions in the human brain. Cereb. Cortex 2012, 22:1564-1576.
28. Halgren E., Dale A.M., Sereno M.I., Tootell R.B., Marinkovic K., Rosen B.R. Location of human face-selective cortex with respect to retinotopic areas. Hum. Brain Mapp. 1999, 7:29-37.
29. Harvey D.Y., Burgund E.D. Neural adaptation across viewpoint and exemplar in fusiform cortex. Brain Cogn. 2012, 80:33-44.
30. Haxby J.V., Ungerleider L.G., Clark V.P., Schouten J.L., Hoffman E.A., Martin A. The effect of face inversion on activity in human neural systems for face and object perception. Neuron 1999, 22:189-199.
31. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
32. Hoffman E.A., Haxby J.V. Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nat. Neurosci. 2000, 3:80-84.
33. Ishai A., Ungerleider L.G., Martin A., Schouten J.L., Haxby J.V. Distributed representation of objects in the human ventral visual pathway. Proc. Natl. Acad. Sci. U. S. A. 1999, 96:9379-9384.
34. Itier R.J., Taylor M.J. Source analysis of the N170 to faces and objects. Neuroreport 2004, 15:1261-1265.
35. Jung T.P., Makeig S., Humphries C., Lee T.W., Mckeown M.J., Iragui V., Sejnowski T.J. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 2000, 37:163-178.
36. Kadosh K.C., Walsh V., Kadosh R.C. Investigating face-property specific processing in the right OFA. Soc. Cogn. Affect. Neurosci. 2011, 6:58-65.
37. Kanwisher N., Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2006, 361:2109-2128.
38. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
39. Kiebel S.J., Garrido M.I., Moran R.J., Friston K.J. Dynamic causal modelling for EEG and MEG. Cogn. Neurodyn. 2008, 2:121-136.
40. Leube D.T., Yoon H.W., Rapp A., Erb M., Grodd W., Bartels M., Kircher T.T.J. Brain regions sensitive to the face inversion effect: a functional magnetic resonance imaging study in humans. Neurosci. Lett. 2003, 342:143-146.
41. Li J., Liu J., Liang J., Zhang H., Zhao J., Rieth C.A., Huber D.E., Li W., Shi G., Ai L., Tian J., Lee K. Effective connectivities of cortical regions for top-down face processing: a dynamic causal modeling study. Brain Res. 2010, 1340:40-51.
42. Liu J., Harris A., Kanwisher N. Perception of face parts and face configurations: an FMRI study. J. Cogn. Neurosci. 2010, 22:203-211.
43. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
44. Marreiros A.C., Kiebel S.J., Friston K.J. Dynamic causal modelling for fMRI: a two-state model. NeuroImage 2008, 39:269-278.
45. Mulert C., Seifert C., Leicht G., Kirsch V., Ertl M., Karch S., Moosmann M., Lutz J., Moller H.-J., Hegerl U., Pogarell O., Jager L. Single-trial coupling of EEG and fMRI reveals the involvement of early anterior cingulate cortex activation in effortful decision making. NeuroImage 2008, 42:158-168.
46. Niazy R.K., Beckmann C.F., Iannetti G.D., Brady J.M., Smith S.M. Removal of FMRI environment artifacts from EEG data using optimal basis sets. NeuroImage 2005, 28:720-737.
47. Pelphrey K.A., Morris J.P., Michelich C.R., Allison T., McCarthy G. Functional anatomy of biological motion perception in posterior temporal cortex: an FMRI study of eye, mouth and hand movements. Cereb. Cortex 2005, 15:1866-1876.
48. Penny W.D. Comparing dynamic causal models using AIC, BIC and free energy. NeuroImage 2012, 59:319-330.
49. Penny W.D., Stephan K.E., Mechelli A., Friston K.J. Comparing dynamic causal models. NeuroImage 2004, 22:1157-1172.
50. Penny W.D., Stephan K.E., Daunizeau J., Rosa M.J., Friston K.J., Schofield T.M., Leff A.P. Comparing families of dynamic causal models. PLoS Comput. Biol. 2010, 6:e1000709.
51. Pitcher D., Walsh V., Duchaine B. The role of the occipital face area in the cortical face perception network. Exp. Brain Res. 2011, 209:481-493.
52. Pourtois G., Schwartz S., Spiridon M., Martuzzi R., Vuilleumier P. Object representations for multiple visual categories overlap in lateral occipital and medial fusiform cortex. Cereb. Cortex 2009, 19:1806-1819.
53. Puce A., Allison T., Bentin S., Gore J.C., McCarthy G. Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 1998, 18:2188-2199.
54. Puce A., Syngeniotis A., Thompson J.C., Abbott D.F., Wheaton K.J., Castiello U., others, The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies. NeuroImage 2003, 19:861-869.
55. Rhodes G., Brake S., Atkinson A.P. What's lost in inverted faces?. Cognition 1993, 47:25-57.
56. Roebroeck A., Formisano E., Goebel R. The identification of interacting networks in the brain using fMRI: model selection, causality and deconvolution. NeuroImage 2011, 58:296-302.
57. Rosa M.J., Daunizeau J., Friston K.J. EEG-fMRI integration: a critical review of biophysical modeling and data analysis approaches. J. Integr. Neurosci. 2010, 9:453-476.
58. Rossion B., Jacques C. Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. NeuroImage 2008, 39:1959-1979.
59. Rossion B., Gauthier I., Tarr M.J., Despland P., Bruyer R., Linotte S., Crommelinck M. The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face-specific processes in the human brain. Neuroreport 2000, 11:69-74.
60. Rossion B., Caldara R., Seghier M., Schuller A.-M., Lazeyras F., Mayer E. A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain 2003, 126:2381-2395.
61. Sadeh B., Yovel G. Why is the N170 enhanced for inverted faces? An ERP competition experiment. NeuroImage 2010, 53:782-789.
62. Sadeh B., Podlipsky I., Zhdanov A., Yovel G. Event-related potential and functional MRI measures of face-selectivity are highly correlated: a simultaneous ERP-fMRI investigation. Hum. Brain Mapp. 2010, 31:1490-1501.
63. Stephan K.E., Friston K.J. Analyzing effective connectivity with fMRI. Wiley Interdiscip. Rev. Cogn. Sci. 2010, 1:446-459.
64. Stephan K.E., Kasper L., Harrison L.M., Daunizeau J., den Ouden H.E., Breakspear M., Friston K.J. Nonlinear dynamic causal models for fMRI. NeuroImage 2008, 42:649-662.
65. Stephan K.E., Penny W.D., Daunizeau J., Moran R.J., Friston K.J. Bayesian model selection for group studies. NeuroImage 2009, 46:1004-1017.
66. Stephan K.E., Penny W.D., Moran R.J., den Ouden H.E.M., Daunizeau J., Friston K.J. Ten simple rules for dynamic causal modeling. NeuroImage 2010, 49:3099-3109.
67. Valdes-Sosa P.A., Sanchez-Bornot J.M., Sotero R.C., Iturria-Medina Y., Aleman-Gomez Y., Bosch-Bayard J., Carbonell F., Ozaki T. Model driven EEG/fMRI fusion of brain oscillations. Hum. Brain Mapp. 2009, 30:2701-2721.
68. Yovel G., Kanwisher N. The neural basis of the behavioral face-inversion effect. Curr. Biol. 2005, 15:2256-2262.