MEG and fMRI fusion for non-linear estimation of neural and BOLD signal changes

Frontiers in Neuroinformatics

Volumn 4, Issue NOV, 2010, Pages

  Plis, Sergey M ^a   Calhoun, Vince D ^a   Weisend, Michael P ^a   Eichele, Tom ^b   Lane, Terran ^c  

^a MIND RESEARCH NETWORK   (United States)

^b UNIVERSITY OF BERGEN   (Norway)

^c University of New Mexico   (United States)

Author keywords

Dynamic Bayesian networks; Latent variable inference; Multimodal data fusion; Particle filtering

Indexed keywords

EID: 84855185103     PISSN: 16625196     EISSN: None     Source Type: Journal    
DOI: 10.3389/fninf.2010.00114     Document Type: Article

References (64)

1. Arulampalam, S., Maskell, S., Gordon, N., and Clapp, T. (2002). A tutorial on particle filters for on-line non-linear/ non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50, 174-188.
2. Babajani, A., and Soltanian-Zadeh, H. (2006). Integrated MEG/EEG and fMRI model based on neural masses. IEEE Trans. Biomed. Eng. 53, 1794-1801.
3. Bertrand, C., Ohmi, M., Suzuki, R., and Kado, H. (2001). A probabilistic solution to the MEG inverse problem via MCMC methods: the reversible jump and parallel tempering algorithms. IEEE Trans. Biomed. Eng. 48, 533-542.
4. Besada-Portas, E., Plis, S., de la Cruz, J., and Lane, T. (2009). "Parallel subspace sampling for particle filtering in dynamic Bayesian networks," in Machine Learning and Knowledge Discovery in Databases, Vol. 5781, Lecture Notes in Computer Science, eds W. Buntine, M. Grobelnik, D. Mladenic, and J. Shawe-Taylorpages (Berlin/Heidelberg: Springer), 131-146.
5. Bießmann, F., Meinecke, F. C., Gretton, A., Rauch, A., Rainer, G., Logothetis, N. K., and Müller, K. R. (2010). Temporal kernel CCA and its application in multimodal neuronal data analysis. Mach. Learn. 79, 5-27.
6. Burge, J., Lane, T., Link, H., Qiu, S., and Clark, V. P. (2007). Discrete dynamic Bayesian network analysis of fMRI data. Hum. Brain Mapp. 30, 122-137. ISSN 1065-9471.
7. Buxton, R. B., Wong, E. C., and Frank, L. R. (1998). Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magn. Reson. Med. 39, 855-864.
8. Calhoun, V. D., Adali, T., Pearlson, G. D., and Kiehl, K. A. (2006). Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential data. Neuroimage 30, 544-553.
9. Campi, C., Pascarella, A., Sorrentino, A., and Piana, M. (2008). A RaoBlackwellized particle filter for magnetoencephalography. Inverse Probl. 24, 25023-25037.
10. Dale, A. M., Liu, A. K., Fischl, B. R., Buckner, R. L., Belliveau, J. W., Lewine, J. D., and Halgren, E. (2000). Dynamic statistical parametric mapping combining fMRI and MEG for high-resolution imaging of cortical activity. Neuron 26, 55.
11. Dale, A. M., and Sereno, M. I. (1993). Improved localizadon of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach. J. Cogn. Neurosci. 5, 162-176.
12. Daunizeau, J., Grova, C., Marrelec, G., Mattout, J., Jbabdi, S., Pélégrini-Issac, M., Lina, J. M., and Benali, H. (2007). Symmetrical event-related EEG/fMRI information fusion in a variational Bayesian framework. Neuroimage 36, 69-87.
13. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B (Methodol.) 39, 1-38.
14. Deneux, T., and Faugeras, O. (2006). "EEG-fMRI fusion of non-triggered data using Kalman filtering," in Biomedical Imaging: Nano to Macro, 2006. Third IEEE International Symposium on April 2006, Arlington, VA, 1068-1071.
15. Doucet, A., de Freitas, N., and Gordon, N. (eds). (2001). Sequential Monte Carlo Methods in Practice. Berlin: Springer-Verlag.
16. Eichele, T., Calhoun, V. D., Moosmann, M., Specht, K., Jongsma, M. L. A., Quiroga, R. Q., Nordby, H., and Hugdahl, K. (2008). Unmixing concurrent EEGfMRI with parallel independent component analysis. Int. J. Psychophysiol. 67, 222-234.
17. Eichele, T., Specht, K., Moosmann, M., Jongsma, M. L. A., Quiroga, R. Q., Nordby, H., and Hugdahl, K. (2005). Assessing the spatiotemporal evolution of neuronal activation with single- trial event-related potentials and functional MRI. Proc. Natl. Acad. Sci. U.S.A. 102, 17798.
18. Fischl, B., Sereno, M. I., and Dale, A. M. (1999). Cortical surface-based analysis. II: Inflation, flattening, and a surface- based coordinate system. Neuroimage 9, 195-207.
19. Freire, L., and Mangin, J. F. (2001). Motion correction algorithms may create spurious brain activations in the absence of subject motion. Neuroimage 14, 709-722.
20. Freire, L., Roche, A., and Mangin, J. F. (2002). What is the best similarity measure for motion correction in fMRI. IEEE Trans. Med. Imaging 21, 470-484.
21. Friston, K. J., Ashburner, J., Frith, C. D., Poline, J. B., Heather, J. D., and Frackowiak, R. S. J. (1995). Spatial registration and normalization of images. Hum. Brain Mapp. 3, 165-189.
22. Friston, K. J., Harrison, L., and Penny, W. (2003). Dynamic causal modelling. Neuroimage 19, 1273-1302.
23. Friston, K. J., Mechelli, A., Turner, R., and Price, C. J. (2000). Nonlinear responses in fMRI: the Balloon model, Volterra kernel, and other hemodynamics. Neuroimage 12, 466-477.
24. Friston, K. J., Trujillo-Barreto, N., and Daunizeau, J. (2008). DEM: a variational treatment of dynamic systems. Neuroimage 41, 849-885.
25. Gelman, A., Carlin, J. B., Stern, H. S., and Rubin, D. B. (2003). Bayesian Data Analysis, 2nd Edn. Boca Raton: Chapman & Hall/CRC. ISBN 158488388X.
26. Halchenko, Y. O., Hanson, S. J., and Pearlmutter, B. A. (2005). "Multimodal integration: fMRI, MRI, EEG, and MEG (chapter 8)," in Signal Processing and Communications, eds L. Landini, V. Positano, and M. F. Santarelli (New York, NY: Marcel Dekker), 223-265. ISBN 0824725425.
27. Hämäläinen, M. S. (2005). MNE Software User's Guide. Available at http://www.nmr.mgh.harvard.edu/martinos/user-Info/data/sofMNE.php
28. Hämäläinen, M. S., Hari, R., Ilmoniemi, R. J., Knuutila, J., and Lounasmaa, O. V. (1993). Magnetoencephalography: theory, instrumentation, and applications to noninvasive studies of the working human brain. Rev. Mod. Phys. 65, 413-497.
29. Hämäläinen, M. S., and Sarvas, J. (1989). Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data. IEEE Trans. Biomed. Eng. 36, 165-171.
30. Huettel, S. A., Song, A. W., and McCarthy, G. (2004). Functional Magnetic Resonance Imaging. Sunderland, MA: Sinauer Associates, Publishers. ISBN 0-87893-288-7.
31. Jimenez, J. C., Shoji, I., and Ozaki, T. (1999). Simulation of stochastic differential equations through the local linearization method. A comparative study. J. Stat. Phys. 94, 587.
32. Johnston, L. A., Duff, E., Mareels, I., and Egan, G. F. (2008). Nonlinear estimation of the bold signal. Neuroimage 40, 504-514.
33. Jun, S.-C., George, J. S., Kim, W., Paré-Blagoev, J., Plis, S., Ranken, D. M., and Schmidt, D. M. (2008). Bayesian brain source imaging based on combined MEG/EEG and fMRI using MCMC. Neuroimage 40, 1581-1594.
34. Jun, S.-C., George, J. S., Pare-Blagoev, J., Plis, S. M., Ranken, D. M., Schmidt, D. M., and Wood, C. C. (2005). Spatiotemporal Bayesian inference dipole analysis for MEG neuroimaging data. Neuroimage 28, 84-98.
35. Kloeden, P. E., and Platen, E. (1992). Numerical Solution of Stochastic Differential Equations. Berlin: Springer.
36. Liu, J. S. (2002). Monte Carlo Strategies in Scientific Computing. New York: Springer. ISBN 0387952306.
37. Logothetis, N. K., and Wandell, B. A. (2004). Interpreting the bold signal. Annu. Rev. Physiol. 66, 735-769.
38. Mackay, D. J. C. (2002). Information Theory, Inference and Learning Algorithms. Cambridge: Cambridge University Press. ISBN 0521642981.
39. Mallick, M., Kirubarajan, T., and Arulampalam, S. (2002). "Out-ofsequence measurement processing for tracking ground target using particle filters," in Aerospace Conference Proceedings, 2002, Vol. 4 (IEEE), 1809-1818. Available at http://ieeexplore.ieee.org/xpls/abs_all. jsp?arnumber=1036893
40. Mandeville, J. B., Marota, J. J., Ayata, C., Zaharchuk, G., Moskowitz, M. A., Rosen, B. R., and Weisskoff, R. M. (1999). Evidence of a cerebrovascular postarteriole windkessel with delayed compliance. J. Cereb. Blood Flow Metab. 19, 679-689. ISSN 0271-678X.
41. Moosmann, M., Eichele, T., Nordby, H., Hugdahl, K., and Calhoun, V. D. (2008). Joint independent component analysis for simultaneous EEGfMRI: principle and simulation. Int. J. Psychophysiol. 67, 212-221.
42. Mosher, J. C., Leahy, R. M., and Lewis, P. S. (1999). EEG and MEG: forward solutions for inverse methods. IEEE Trans. Biomed. Eng. 46, 245-259. ISSN 0018-9294.
43. Mukamel, R., Gelbard, H., Arieli, A., Hasson, U., Fried, I., and Malach, R. (2005). Coupling between neuronal firing, field potentials, and fMRI in human auditory cortex. Science 309, 951-954.
44. Murphy, K. (2002). Dynamic Bayesian Networks: Representation, Inference and Learning. Ph.D. thesis, UC Berkeley.
45. Murray, L., and Storkey, A. (2008). "Continuous time particle filtering for fMRI," in Advances in Neural Information Processing Systems, Vol. 20, eds J. C. Platt, D. Koller, Y. Singer, and S. Roweis (Cambridge, MA: MIT Press), 1049-1056.
46. Obata, T., Liu, T. T., Miller, K. L., Luh, W.-M., Wong, E. C., Frank, L. R., and Buxton, R. B. (2004). Discrepancies between bold and flow dynamics in primary and supplementary motor areas: application of the balloon model to the interpretation of bold transients. Neuroimage 21, 144.
47. Orton, M., and Marrs, A. (2001). "A Bayesian approach to multi-target tracking and data fusion with out-ofsequence measurements," in Target Tracking: Algorithms and Applications (Ref. No. 2001/174), Vol. 1 (IEEE), 15/1-15/5.
48. Ostwald, D., Porcaro, C., and Bagshaw, A. P. (2010). An information theoretic approach to EEG-fMRI integration of visually evoked responses. Neuroimage 49, 498-516. ISSN 1053-8119.
49. Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257-286. ISSN 0018-9219.
50. Raichle, M. E., and Mintun, M. A. (2006). Brain work and brain imaging. Annu. Rev. Neurosci. 29, 449-476.
51. Rajapakse, J. C., and Zhou, J. (2007). Learning effective brain connectivity with dynamic Bayesian networks. Neuroimage 37, 749-760.
52. Riera, J. J., Jimenez, J. C., Wan, X., Kawashima, R., and Ozaki, T. (2007). Nonlinear local electrovascular coupling. II: from data to neuronal masses. Hum. Brain Mapp. 28, 335-354.
53. Riera, J. J., Wan, X., Jimenez, J. C., and Kawashima, R. (2006). Nonlinear local electro-vascular coupling. Part I: a theoretical model. Hum. Brain Mapp. 27, 896-914.
54. Riera, J. J., Watanabe, J., Kazuki, I., Naoki, M., Aubert, E., Ozaki, T., and Kawashima, R. (2004). A state-space model of the hemodynamic approach: nonlinear filtering of BOLD signals. Neuroimage 21, 547-567. ISSN 1053- 8119.
55. Sarvas, J. (1987). Basic mathematical and electromagnetic concepts of the biomagnetic inverse problem. Phys. Med. Biol. 32, 11-22.
56. Schmidt, D. M., George, J. S., and Wood, C. C. (1999). Bayesian inference applied to the electromagnetic inverse problem. Hum. Brain Mapp. 7, 195-212.
57. Sekihara, K., Nagarajan, S. S., Poeppel, D., Marantz, A., and Miyashita, Y. (2001). Reconstructing spatiotemporal activities of neural sources using an MEG vector beamformer technique. IEEE Trans. Biomed. Eng. 48, 760-771.
58. Somersalo, E., Voutilainen, A., and Kaipio, J. P. (2003). Non-stationary magnetoencephalography by Bayesian filtering of dipole models. Inverse Probl. 19, 1047-1063.
59. Stephan, K. E., Weiskopf, N., Drysdale, P. M., Robinson, P. A., and Friston, K. J. (2007). Comparing hemodynamic models with DCM. Neuroimage 38, 387-401.
60. Talairach, J., and Tournoux, P. (1988). Co-planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging. New York: Thieme.
61. Vakorin, V. A., Krakovska, O. O., Borowsky, R., and Sarty, G. E. (2007). Inferring neural activity from bold signals through nonlinear optimization. Neuroimage 38, 248.
62. Valdes-Sosa, P. A., Sanchez-Bornot, J. M., Sotero, R. C., Iturria-Medina, Y., Aleman-Gomez, Y., Bosch-Bayard, J., Carbonell, F., Ozaki, T., Center, C. N., and Havana, C. (2009). Model driven/ fMRI fusion of brain oscillations. Hum. Brain Mapp. 30, 2701-2721.
63. Zhang, L., Samaras, D., Alia-Klein, N., Volkow, N., and Goldstein, R. (2006). "Modeling neuronal interactivity using dynamic Bayesian networks," in Advances in Neural Information Processing Systems, Vol. 18, eds Y. Weiss, B. Schölkopf, and J. Platt (Cambridge, MA: MIT Press), 1593-1600.
64. Zhenghui, H., Xiaohu, Z., Huafeng, L., and Pengcheng, S. (2009). Nonlinear analysis of the bold signal. EURASIP J. Adv. Signal Process. 2009, 13. doi:10.1155/2009/215409.