Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI

NeuroImage

Volumn 50, Issue 4, 2010, Pages 1438-1445

  Correa, Nicolle M ^a   Eichele, Tom ^b   Adali, Tülay ^a   Li, Yi Ou ^a   Calhoun, Vince D ^c  

^a University of Marylandw Baltimore County   (United States)

^b UNIVERSITY OF BERGEN   (Norway)

^c UNIVERSITY OF NEW MEXICO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMPLITUDE MODULATION; ARTICLE; AUDITORY DISCRIMINATION; BRAIN FUNCTION; BRAIN MAPPING; CONTROLLED STUDY; CORRELATION ANALYSIS; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; MALE; MOTOR CORTEX; NORMAL HUMAN; ORBITAL CORTEX; PARIETAL LOBE; PATTERN RECOGNITION; PRIORITY JOURNAL; TASK PERFORMANCE; TEMPORAL LOBE;

ACOUSTIC STIMULATION; ADULT; ALGORITHMS; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MALE; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS; YOUNG ADULT;

EID: 77950594241     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.01.062     Document Type: Article

References (41)

1. Bledowski C., Prvulovic D., Hoechstetter K., Scherg M., Wibral M., Goebel R., and Linden D.E.J. Localizing P300 generators in visual target and distractor processing: a combined event-related potential and functional magnetic resonance imaging study. J. Neurosci. 24 (2004) 9353-9360
2. Bonmassar G., Schwartz D.P., Liu A.K., Kwong K.K., Dale A.M., and Belliveau J.W. Spatiotemporal brain imaging of visual-evoked activity using interleaved EEG and fMRI recordings. NeuroImage 13 (2001) 1035-1043
3. Calhoun V.D., and Adali{dotless} T. Feature-based fusion of medical imaging data. IEEE Trans. Inf. Technol. Biomed. 13 (2009) 1-10
4. Calhoun V.D., Adali{dotless} T., and Liu J. A feature-based approach to combine functional MRI, structural MRI, and EEG brain imaging data. Proc. EMBS 1 (2006) 3672-3675
5. Calhoun V.D., Adali{dotless} T., Pearlson G.D., and Kiehl K.A. Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential data. NeuroImage 30 (2006) 544-553
6. Correa N.M., Li Y.-O., Adali{dotless} T., and Calhoun V.D. Canonical correlation analysis for feature-based fusion of biomedical imaging modalities and its application to detection of associative networks in schizophrenia. IEEE J. Sel. Top. Sign. Proc. 2 6 (2008) 998-1007
7. Correa N.M., Li Y.-O., Adali{dotless} T., and Calhoun V.D. Fusion of fMRI, sMRI, and EEG data using canonical correlation analysis. Proc. IEEE Int. Conf. Acoust., Speech, Sign. Proc. (ICASSP) (2009) 385-388
8. Debener S., Ullsperger M., Siegel M., Fiehler K., Yves von Cramon D., and Engel A.K. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 25 (2005) 11730-11737
9. Debener S., Strobel A., Sorger B., Peters J., Kranczioch C., Engel A.K., and Goebel R. Improved quality of auditory event-related potentials recorded simultaneously with 3-T fMRI: removal of the ballistocardiogram artefact. NeuroImage 34 2 (2007) 587-597
10. Delorme A., and Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics. J. Neurosci. Methods 134 (2004) 9-24
11. Eichele T., Specht K., Moosmann M., Jongsma M., Quiroga R., Nordby H., and Hugdahl K. Assessing the spatio-temporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. Proc. Nat. Acad. Sci. (PNAS) 102 (2005) 17798-17803
12. Eichele T., Calhoun V., Moosmann M., Specht K., Jongsma M., Quiroga R., Nordby H., and Hugdahl K. Unmixing concurrent EEG-fMRI with parallel independent component analysis. Int. J. Psychophysiol. 67 3 (2008) 222-234
13. Fox M.D., Snyder A.Z., Vincent J.L., Corbetta M., Van Essen D.C., and Raichle M.E. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Nat. Acad. Sci. (PNAS) 102 27 (2005) 9673-9678
14. Fox M.D., Zhang D., Snyder A.Z., and Raichle M.E. The global signal and observed anticorrelated resting state brain networks. J. Neurophysiology 101 (2009) 3270-3283
15. Friman O., Borga M., Lundberg P., and Knutsson H. Exploratory fMRI analysis by autocorrelation maximization. Neuroimage 16 (2002) 454-464
16. Goldman R.I., Stern J.M., Engel Jr. J., and Cohen M.S. Acquiring simultaneous EEG and functional MRI. Clinical Neurophysiology 111 (2000) 1974-1980
17. Hall D.A., Haggard M.P., Akeroyd M.A., Palmer A.R., Summerfield A.Q., Elliott M.R., Gurney E.M., and Bowtell R.W. "Sparse" temporal sampling in auditory fMRI. Hum. Brain Mapp. 7 3 (1999) 213-223
18. Hopfinger J.B., Khoe W., and Song A.W. Combining electrophysiology with structural and functional neuroimaging: ERPs, PET, MRI, and fMRI. In: Handy T.C. (Ed). Event Related Potentials. A Methods Handbook (2005), MIT Press, Cambridge 345-380
19. Horwitz B., and Poeppel D. How can EEG/MEG and fMRI/PET data be combined?. Hum. Brain Mapp. 17 1 (2002) 1-3
20. Hotelling H. Relations between two sets of variates. Biometrika 28 (1936) 321-377
21. Jung T.P., Makeig S., Humphries C., Lee T.W., Mckeown M.J., Iragui V., and Sejnowski TJ. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37 (2000) 163-178
22. Kettenring J. Canonical analysis of several sets of variables. Biometrika 58 (1971) 433-451
23. Kim D., Manoach D.S., Mathalon D., Turner J., Brown G., Ford J.M., Gollub R.L., et al. Dysregulation of working memory and default-mode networks in schizophrenia during a Sternberg item recognition paradigm: an independent component analysis of the multisite Mind and fBIRN studies. Hum. Brain Mapp. 30 11 (2009) 3795-3811
24. Liu A.K., Belliveau J.W., and Dale A.M. Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography data: Monte Carlo simulations. Proc. Natl. Acad. Sci. (PNAS) 95 (1998) 8945-8950
25. Li Y.O., Wang W., Adali{dotless} T., and Calhoun V.D. CCA for joint blind source separation of multiple datasets with application to group fMRI analysis. Proc. IEEE Int. Conf. Acoust., Speech, Sign. Proc. (ICASSP) (2008) 1837-1840
26. Li, Y.-O., Wang, W., Adali{dotless}, T., Calhoun, V.D., 2009. A group study of simulated driving fMRI data by multi-set canonical correlation analysis. NeuroImage 47 (Supplement 1) (July 2009), S124.
27. Li Y.-O., Wang W., Adali{dotless} T., and Calhoun V.D. Joint blind source separation by multi-set canonical correlation analysis. IEEE Trans. Sign. Proc. 57 10 (2009) 3918-3929
28. Makeig S., Jung T.P., and Sejnowski T.J. Having your voxels and timing them too?. In: Sommer F., and Wichert A. (Eds). Exploratory Analysis and Data Modeling in Functional Neuroimaging (2002), The MIT Press, Cambridge 195-207
29. Martinez-Montes E., Valdes-Sosa P., Miwakeichi F., Goldman R., and Cohen M. Concurrent EEG/fMRI analysis by multiway partial least squares. NeuroImage 22 (2004) 1023-1034
30. Moosmann M., Eichele T., Nordby H., Hudgdahl K., and Calhoun V. Joint independent component analysis for simultaneous EEG-fMRI: principle and simulation. Int. J. Psychophysiology 67 (2008) 212-221
31. Quian Quiroga R., and Garcia H. Single-trial event-related potentials with wavelet denoising. Clin. Neurophysiol. 114 2 (2003) 376-390
32. Ravicz M.E., Melcher J.R., and Kiang N.Y. Acoustic noise during functional magnetic resonance imaging. J. Acoust. Soc. Am. 108 (2000) 1683-1696
33. Sargi{dotless}n M., Yemez Y., Erzin E., and Murat A.M. Audiovisual synchronization and fusion using canonical correlation analysis. IEEE Trans. Multimedia 9 7 (2007) 1396-1403
34. Shan C., Gong S., and McOwan P. Beyond facial expressions: learning human emotion from body gestures. British Machine Vision Conference (2007)
35. Spencer K.M. Averaging, detection, and classification of single-trials ERPs. In: Handy T.C. (Ed). Event Related Potentials. A Methods Handbook (2005), MIT Press, Cambridge, MA 209-228
36. Stevens M., Calhoun V.D., and Kiehl K.A. fMRI in an oddball task: effects of target-to-target interval. Psychophysiology 42 (2005) 636-642
37. Sun Q.-S., Zeng S.-G., Heng P.-A., and Xia D.S. Feature fusion method based on canonical correlation analysis and handwritten character recognition. Proc. Int. Conf. Control, Automation, Robotics, and Vision (2004) 1547-1552
38. Tzourio-Mazoyer N., Landeau B., Papathanassiou D., Crivello F., Etard O., et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15 (2002) 273-289
39. Uddin L.Q., Clare Kelly A.M., Biswal B.B., Castellanos F.X., and Milham M.P. Functional connectivity of default mode network components: correlation, anticorrelation, and causality. Hum. Brain Mapp. 30 (2009) 625-637
40. Xu X., and Mu Z. Feature fusion method based on KCCA for ear and profile face based multimodal recognition. Proc. Int. Conf. Automation and Linguistics (2007) 620-623
41. Yan X., Cao L., Huang D.-S., Li K., and Irwin G. A novel feature fusion approach based on blocking and its application in image recognition. Proc. Int. Conf. Intell. Comput. Part 1 (2006) 1085-1091