General overview on the merits of multimodal neuroimaging data fusion

NeuroImage

Volumn 102, Issue P1, 2014, Pages 3-10

  Uludağ, Kâmil ^a   Roebroeck, Alard ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE QUALITY; INFORMATION PROCESSING; MAGNETIC FIELD; MAGNETOENCEPHALOGRAPHY; MULTIMODAL IMAGING; NEAR INFRARED SPECTROSCOPY; NEUROIMAGING; OPTICAL RESOLUTION; POSITRON EMISSION TOMOGRAPHY; REVIEW; SENSITIVITY AND SPECIFICITY; SIGNAL NOISE RATIO; ANATOMY AND HISTOLOGY; ANIMAL; BRAIN; PHYSIOLOGY;

ANIMALS; BRAIN; DATASETS AS TOPIC; HUMANS; MULTIMODAL IMAGING; NEUROIMAGING;

EID: 84908347504     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.05.018     Document Type: Review

References (87)

1. Acton P.D., Zhuang H., Alavi A. Quantification in PET. Radiol. Clin. N. Am. 2004, 42:1055-1062. (viii).
2. Ances B.M., Leontiev O., Perthen J.E., Liang C., Lansing A.E., Buxton R.B. Regional differences in the coupling of cerebral blood flow and oxygen metabolism changes in response to activation: Implications for BOLD-fMRI. NeuroImage 2008, 39:1510-1521.
3. Andersson J.L., Skare S., Ashburner J. How to correct susceptibility distortions in spin-echo echo-planar images: Application to diffusion tensor imaging. NeuroImage 2003, 20:870-888.
4. Bartels A., Logothetis N.K., Moutoussis K. fMRI and its interpretations: An illustration on directional selectivity in area V5/MT. Trends Neurosci. 2008, 31:444-453.
5. Becker R., Reinacher M., Freyer F., Villringer A., Ritter P. How ongoing neuronal oscillations account for evoked fMRI variability. J. Neurosci. 2011, 31:11016-11027.
6. Belitski A., Gretton A., Magri C., Murayama Y., Montemurro M.A., Logothetis N.K., Panzeri S. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. Neurosci. 2008, 28:5696-5709.
7. Bianciardi M., Fukunaga M., van Gelderen P., Horovitz S.G., de Zwart J.A., Shmueli K., Duyn J.H. Sources of functional magnetic resonance imaging signal fluctuations in the human brain at rest: A 7 T study. Magn. Reson. Imaging 2009, 27:1019-1029.
8. Birn R.M. The role of physiological noise in resting-state functional connectivity. NeuroImage 2012, 62:864-870.
9. Blockley N.P., Griffeth V.E., Simon A.B., Buxton R.B. A review of calibrated blood oxygenation level-dependent (BOLD) methods for the measurement of task-induced changes in brain oxygen metabolism. NMR Biomed. 2013, 26:987-1003.
10. Buffalo E.A., Fries P., Landman R., Buschman T.J., Desimone R. Laminar differences in gamma and alpha coherence in the ventral stream. Proc. Natl. Acad. Sci. U. S. A. 2011, 108:11262-11267.
11. Buxton R.B. An introduction to functional magnetic resonance imaging: Principles and techniques 2002, Cambridge University Press.
12. Buxton R.B., Uludag K., Dubowitz D.J., Liu T.T. Modeling the hemodynamic response to brain activation. NeuroImage 2004, 23(Suppl. 1):S220-S233.
13. Catani M., Thiebaut de Schotten M. A diffusion tensor imaging tractography atlas for virtual in vivo dissections. Cortex 2008, 44:1105-1132.
14. Chiarelli P.A., Bulte D.P., Wise R., Gallichan D., Jezzard P. A calibration method for quantitative BOLD fMRI based on hyperoxia. NeuroImage 2007, 37:808-820.
15. Daunizeau J., Laufs H., Friston K. EEG-fMRI information fusion: Biophysics and data analysis. EEG-fMRI 2010, Springer Verlag, Berlin Heidelberg. C. Mulert, L. Lemieux (Eds.).
16. David O., Kiebel S.J., Harrison L.M., Mattout J., Kilner J.M., Friston K.J. Dynamic causal modeling of evoked responses in EEG and MEG. NeuroImage 2006, 30:1255-1272.
17. De Martino F., Valente G., de Borst A.W., Esposito F., Roebroeck A., Goebel R., Formisano E. Multimodal imaging: An evaluation of univariate and multivariate methods for simultaneous EEG/fMRI. Magn. Reson. Imaging 2010, 28:1104-1112.
18. Debener S., Ullsperger M., Siegel M., Fiehler K., von Cramon D.Y., Engel A.K. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 2005, 25:11730-11737.
19. Deneux T., Faugeras O. EEG-fMRI fusion of paradigm-free activity using Kalman filtering. Neural Comput. 2010, 22:906-948.
20. Eickhoff S.B., Paus T., Caspers S., Grosbras M.H., Evans A.C., Zilles K., Amunts K. Assignment of functional activations to probabilistic cytoarchitectonic areas revisited. NeuroImage 2007, 36:511-521.
21. Fenno L., Yizhar O., Deisseroth K. The development and application of optogenetics. Annu. Rev. Neurosci. 2011, 34:389-412.
22. Friston K.J., Harrison L., Penny W. Dynamic causal modelling. NeuroImage 2003, 19:1273-1302.
23. Frost M.A., Goebel R. Functionally informed cortex based alignment: An integrated approach for whole-cortex macro-anatomical and ROI-based functional alignment. NeuroImage 2013, 83:1002-1010.
24. Goldman R.I., Stern J.M., Engel J., Cohen M.S. Simultaneous EEG and fMRI of the alpha rhythm. Neuroreport 2002, 13:2487-2492.
25. Griswold M.A., Jakob P.M., Heidemann R.M., Nittka M., Jellus V., Wang J., Kiefer B., Haase A. Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn. Reson. Med. 2002, 47:1202-1210.
26. Grova C., Daunizeau J., Kobayashi E., Bagshaw A.P., Lina J.M., Dubeau F., Gotman J. Concordance between distributed EEG source localization and simultaneous EEG-fMRI studies of epileptic spikes. NeuroImage 2008, 39:755-774.
27. Handwerker D.A., Bandettini P.A. Hemodynamic signals not predicted? Not so: A comment on Sirotin and Das (2009). NeuroImage 2011, 55(4):1409-1412.
28. Handwerker D.A., Bandettini P.A. Simple explanations before complex theories: Alternative interpretations of Sirotin and Das' observations. NeuroImage 2011, 55(4):1419-1422.
29. Hari R., Salmelin R. Magnetoencephalography: From SQUIDs to neuroscience. Neuroimage 20th anniversary special edition. NeuroImage 2012, 61:386-396.
30. Hennig J. K-space sampling strategies. Eur. Radiol. 1999, 9:1020-1031.
31. Herrmann C.S., Debener S. Simultaneous recording of EEG and BOLD responses: A historical perspective. Int. J. Psychophysiol. 2008, 67:161-168.
32. Herzog H., Pietrzyk U., Shah N.J., Ziemons K. The current state, challenges and perspectives of MR-PET. NeuroImage 2010, 49:2072-2082.
33. Herzog H. PET/MRI: challenges, solutions and perspectives. Z. Med. Phys. 2012, 22:281-298.
34. Hillman E.M. Optical brain imaging in vivo: Techniques and applications from animal to man. J. Biomed. Opt. 2007, 12:051402.
35. Hoge R.D. Calibrated FMRI. NeuroImage 2012, 62:930-937.
36. Ilmoniemi R.J., Dabek J., Lin F.H., Nieminen J.O., Parkkonen L.T., Vesanen P.T., Zevenhoven K.C., Zhdanov A.V., Luomahaara J., Hassel J., Penttila J., Simola J., Ahonen A.I., Makela J.P. Combination of MEG and MRI in one setup. Biomed. Tech. 2012, 57(Suppl. 1):218.
37. Jezzard P., Clare S. Principles of nuclear magnetic resonance and MRI. Functional MRI: An introduction to methods 2001, 67-92.
38. Jones T., Rabiner E.A. The development, past achievements, and future directions of brain PET. J. Cereb. Blood Flow Metab. 2012, 32:1426-1454.
39. Judenhofer M.S., Wehrl H.F., Newport D.F., Catana C., Siegel S.B., Becker M., Thielscher A., Kneilling M., Lichy M.P., Eichner M., Klingel K., Reischl G., Widmaier S., Röcken M., Nutt R.E., Machulla H.J., Uludag K., Cherry S.R., Claussen C.D., Pichler B.J. Simultaneous PET-MRI: a new approach for functional and morphological imaging. Nat. Med. 2008, 18:459-465.
40. Jung T.P., Makeig S., Westerfield M., Townsend J., Courchesne E., Sejnowski T.J. Analysis and visualization of single-trial event-related potentials. Hum. Brain Mapp. 2001, 14:166-185.
41. Kerr J.N., Denk W. Imaging in vivo: Watching the brain in action. Nat. Rev. Neurosci. 2008, 9:195-205.
42. Khalsa S., Mayhew S.D., Chechlacz M., Bagary M., Bagshaw A.P. The structural and functional connectivity of the posterior cingulate cortex: Comparison between deterministic and probabilistic tractography for the investigation of structure-function relationships. NeuroImage 2014, 102:118-127. (in press).
43. Lancaster J.L., Tordesillas-Gutierrez D., Martinez M., Salinas F., Evans A., Zilles K., Mazziotta J.C., Fox P.T. Bias between MNI and Talairach coordinates analyzed using the ICBM-152 brain template. Hum. Brain Mapp. 2007, 28:1194-1205.
44. Laufs H. A personalized history of EEG-fMRI integration. NeuroImage 2012, 62:1056-1067.
45. Laufs H., Krakow K., Sterzer P., Eger E., Beyerle A., Salek-Haddadi A., Kleinschmidt A. Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest. Proc. Natl. Acad. Sci. U. S. A. 2003, 100:11053-11058.
46. Lippert M.T., Steudel T., Ohl F., Logothetis N.K., Kayser C. Coupling of neural activity and fMRI-BOLD in the motion area MT. Magn. Reson. Imaging 2010, 28:1087-1094.
47. Logothetis N.K. Neurovascular coupling: Much ado about nothing. Front. Neuroenerg. 2010, 2:1-4.
48. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
49. Ma D., Gulani V., Seiberlich N., Liu K., Sunshine J.L., Duerk J.L., Griswold M.A. Magnetic resonance fingerprinting. Nature 2013, 495:187-192.
50. Marques P., Soares J.M., Alves V., Sousa N. BrainCAT - a tool for automated and combined functional magnetic resonance imaging and diffusion tensor imaging brain connectivity analysis. Front. Hum. Neurosci. 2013, 7:794.
51. Mazziotta J., Toga A., Evans A., Fox P., Lancaster J., Zilles K., Woods R., Paus T., Simpson G., Pike B., Holmes C., Collins L., Thompson P., MacDonald D., Iacoboni M., Schormann T., Amunts K., Palomero-Gallagher N., Geyer S., Parsons L., Narr K., Kabani N., Le Goualher G., Boomsma D., Cannon T., Kawashima R., Mazoyer B. A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 2001, 356:1293-1322.
52. Michel C.M., Murray M.M. Towards the utilization of EEG as a brain imaging tool. NeuroImage 2012, 61:371-385.
53. Moran R.J., Stephan K.E., Seidenbecher T., Pape H.C., Dolan R.J., Friston K.J. Dynamic causal models of steady-state responses. NeuroImage 2009, 44:796-811.
54. Neuner I., Kaffanke J.B., Langen K.J., Kops E.R., Tellmann L., Stoffels G., Weirich C., Filss C., Scheins J., Herzog H., Shah N.J. Multimodal imaging utilising integrated MR-PET for human brain tumour assessment. Eur. Radiol. 2012, 22:2568-2580.
55. Norris D.G. Principles of magnetic resonance assessment of brain function. J. Magn. Reson. Imaging 2006, 23:794-807.
56. Nunez P.L., Silberstein R.B. On the relationship of synaptic activity to macroscopic measurements: Does co-registration of EEG with fMRI make sense?. Brain Topogr. 2000, 13:79-96.
57. Obrig H., Israel H., Kohl-Bareis M., Uludag K., Wenzel R., Muller B., Arnold G., Villringer A. Habituation of the visually evoked potential and its vascular response: Implications for neurovascular coupling in the healthy adult. NeuroImage 2002, 17:1-18.
58. Oh S.H., Chung J.Y., In M.H., Zaitsev M., Kim Y.B., Speck O., Cho Z.H. Distortion correction in EPI at ultra-high-field MRI using PSF mapping with optimal combination of shift detection dimension. Magn. Reson. Med. 2012, 68:1239-1246.
59. Olman C.A., Harel N., Feinberg D.A., He S., Zhang P., Ugurbil K., Yacoub E. Layer-specific fMRI reflects different neuronal computations at different depths in human V1. PLoS One 2012, 7:e32536.
60. Pascual-Marqui R.D., Lehmann D., Koukkou M., Kochi K., Anderer P., Saletu B., Tanaka H., Hirata K., John E.R., Prichep L., Biscay-Lirio R., Kinoshita T. Assessing interactions in the brain with exact low-resolution electromagnetic tomography. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2011, 369:3768-3784.
61. Pourtois G., Delplanque S., Michel C., Vuilleumier P. Beyond conventional event-related brain potential (ERP): Exploring the time-course of visual emotion processing using topographic and principal component analyses. Brain Topogr. 2008, 20:265-277.
62. Pruessmann K.P., Weiger M., Scheidegger M.B., Boesiger P. SENSE: Sensitivity encoding for fast MRI. Magn. Reson. Med. 1999, 42:952-962.
63. Ritter P., Villringer A. Simultaneous EEG-fMRI. Neurosci. Biobehav. Rev. 2006, 30:823-838.
64. Ritter P., Becker R., Graefe C., Villringer A. Evaluating gradient artifact correction of EEG data acquired simultaneously with fMRI. Magn. Reson. Imaging 2007, 25:923-932.
65. Roebroeck A., Formisano E., Goebel R. The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. NeuroImage 2011, 58:296-302.
66. Roebroeck A., Seth A.K., Valdes-Sosa P. Causal time series analysis of functional magnetic resonance imaging data. J. Mach. Learn. Res. Work. Conf. Proc. 2011, 12:65-94.
67. Rosenkranz K., Lemieux L. Present and future of simultaneous EEG-fMRI. MAGMA 2010, 23:309-316.
68. Sauter A.W., Wehrl H.F., Kolb A., Judenhofer M.S., Pichler B.J. Combined PET/MRI: one step further in multimodality imaging. Trends Mol Med 2010, 16:508-515.
69. Scheeringa R., Mazaheri A., Bojak I., Norris D.G., Kleinschmidt A. Modulation of visually evoked cortical FMRI responses by phase of ongoing occipital alpha oscillations. J. Neurosci. 2011, 31:3813-3820.
70. Schmithorst V.J., Farah R., Keith R.W. Left ear advantage in speech-related dichotic listening is not specific to auditory processing disorder in children: A machine-learning fMRI and DTI study. NeuroImage Clin. 2013, 3:8-17.
71. Schroeder C.E., Steinschneider M., Javitt D.C., Tenke C.E., Givre S.J., Mehta A.D., Simpson G.V., Arezzo J.C., Vaughan H.G. Localization of ERP generators and identification of underlying neural processes. Electroencephalogr. Clin. Neurophysiol. Suppl. 1995, 44:55-75.
72. Shmuel A., Yacoub E., Chaimow D., Logothetis N.K., Ugurbil K. Spatio-temporal point-spread function of fMRI signal in human gray matter at 7 Tesla. NeuroImage 2007, 35:539-552.
73. Sirotin Y.B., Das A. Anticipatory haemodynamic signals in sensory cortex not predicted by local neuronal activity. Nature 2009, 457:475-479.
74. Sui J., Adali T., Yu Q., Chen J., Calhoun V.D. A review of multivariate methods for multimodal fusion of brain imaging data. J. Neurosci. Methods 2012, 204:68-81.
75. Toga A.W., Thompson P.M., Mori S., Amunts K., Zilles K. Towards multimodal atlases of the human brain. Nat. Rev. Neurosci. 2006, 7:952-966.
76. Triantafyllou C., Hoge R.D., Krueger G., Wiggins C.J., Potthast A., Wiggins G.C., Wald L.L. Comparison of physiological noise at 1.5 T, 3 T and 7 T and optimization of fMRI acquisition parameters. NeuroImage 2005, 26:243-250.
77. Tsuzuki D., Dan I. Spatial registration for functional near-infrared spectroscopy: From channel position on the scalp to cortical location in individual and group analyses. NeuroImage 2014, 85(Pt 1):92-103.
78. Valdes-Sosa P.A., Sanchez-Bornot J.M., Sotero R.C., Iturria-Medina Y., Aleman-Gomez Y., Bosch-Bayard J., Carbonell F., Ozaki T. Model driven EEG/fMRI fusion of brain oscillations. Hum. Brain Mapp. 2009, 30:2701-2721.
79. Valdes-Sosa P., Roebroeck A., Daunizeau J., Friston K. Effective connectivity: Influence, causality and biophysical modeling. NeuroImage 2012, 58(2):339-361.
80. van Zijl P.C., Hua J., Lu H. The BOLD post-stimulus undershoot, one of the most debated issues in fMRI. NeuroImage 2012, 62:1092-1102.
81. Viard R., Betrouni N., Vermandel M., Mordon S., Rousseau J., Vanhoutte M. Characterization and 3D correction of geometric distortion in low-field open-magnet MRI. Conference proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Conference 2008 2008, 3649-3652.
82. Villringer A., Chance B. Non-invasive optical spectroscopy and imaging of human brain function. Trends Neurosci. 1997, 20:435-442.
83. Vulliemoz S., Carmichael D.W., Rosenkranz K., Diehl B., Rodionov R., Walker M.C., McEvoy A.W., Lemieux L. Simultaneous intracranial EEG and fMRI of interictal epileptic discharges in humans. NeuroImage 2011, 54:182-190.
84. Wakana S., Jiang H., Nagae-Poetscher L.M., van Zijl P.C., Mori S. Fiber tract-based atlas of human white matter anatomy. Radiology 2004, 230:77-87.
85. Zeeberg B.R., Gibson R.E., Reba R.C. Accuracy of in vivo neuroreceptor quantification by PET and review of steady-state, transient, double injection, and equilibrium models. IEEE Trans. Med. Imaging 1988, 7:203-212.
86. Zhang K., Herzog H., Mauler J., Filss C., Okell T.W., Kops E.R., Tellmann L., Fischer T., Brocke B., Sturm W., Coenen H.H., Shah N.J. Comparison of cerebral blood flow acquired by simultaneous [15O]water positron emission tomography and arterial spin labeling magnetic resonance imaging. J. Cereb. Blood Flow Metab. 2014, 1-8.
87. Zimmermann J., Goebel R., De Martino F., van de Moortele P.F., Feinberg D., Adriany G., Chaimow D., Shmuel A., Ugurbil K., Yacoub E. Mapping the organization of axis of motion selective features in human area MT using high-field fMRI. PLoS One 2011, 6:e28716.