Decoding word and category-specific spatiotemporal representations from MEG and EEG

NeuroImage

Volumn 54, Issue 4, 2011, Pages 3028-3039

  Chan, Alexander M ^a,b   Halgren, Eric ^c   Marinkovic, Ksenija ^c   Cash, Sydney S ^b  

^a HARVARD MIT DIVISION OF HEALTH SCIENCES AND TECHNOLOGY   (United States)

^b MASSACHUSETTS GENERAL HOSPITAL   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Decoding; EEG; Language; Machine learning; MEG; Semantic category

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDITORY STIMULATION; BRAIN MAPPING; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FRONTAL CORTEX; HUMAN; HUMAN EXPERIMENT; LANGUAGE ABILITY; MACHINE LEARNING; MAGNETOENCEPHALOGRAPHY; MALE; NORMAL HUMAN; OCCIPITAL CORTEX; PRIORITY JOURNAL; SEMANTICS; SENSOR; STIMULUS RESPONSE; SUPPORT VECTOR MACHINE; TASK PERFORMANCE; TEMPORAL CORTEX; VISUAL STIMULATION; WORD RECOGNITION;

ADULT; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; HUMANS; LANGUAGE; MAGNETOENCEPHALOGRAPHY; MALE; READING; SEMANTICS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 78650962780     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.10.073     Document Type: Article

References (54)

1. Baker J. The DRAGON system-an overview. IEEE Trans. Acoust. Speech Signal Process. 1975, 23:24-29.
2. Bentin S., Kutas M., Hillyard S.A. Electrophysiological evidence for task effects on semantic priming in auditory word processing. Psychophysiology 1993, 30:161-169.
3. Caramazza A., Mahon B.Z. The organization of conceptual knowledge: the evidence from category-specific semantic deficits. Trends Cogn. Sci. 2003, 7:354-361.
4. Caramazza A., Shelton J.R. Domain-specific knowledge systems in the brain the animate-inanimate distinction. J. Cogn. Neurosci. 1998, 10:1-34.
5. Caramazza A., Hillis A.E., Rapp B.C., Romani C. The multiple semantics hypothesis: multiple confusions?. Cogn. Neuropsychol. 1990, 7:161-189.
6. Chao L.L., Martin A. Representation of manipulable man-made objects in the dorsal stream. Neuroimage 2000, 12:478-484.
7. Chao L.L., Haxby J.V., Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat. Neurosci. 1999, 2:913-919.
8. Cohen D., Cuffin B.N. Demonstration of useful differences between magnetoencephalogram and electroencephalogram. Electroencephalogr. Clin. Neurophysiol. 1983, 56:38-51.
9. Crammer K., Singer Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2002, 2:265-292.
10. Cuffin B.N., Cohen D. Comparison of the magnetoencephalogram and electroencephalogram. Electroencephalogr. Clin. Neurophysiol. 1979, 47:132-146.
11. Damasio H., Grabowski T.J., Tranel D., Hichwa R.D., Damasio A.R. A neural basis for lexical retrieval. Nature 1996, 380:499-505.
12. Dehghani N., Cash S.S., Rossetti A.O., Chen C.C., Halgren E. Magnetoencephalography demonstrates multiple asynchronous generators during human sleep spindles. J. Neurophysiol. 2010, 104:179-188.
13. Dell G.S., O'Seaghdha P.G. Stages of lexical access in language production. Cognition 1992, 42:287-314.
14. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Meth. 2004, 134:9-21.
15. Devlin J.T., Moore C.J., Mummery C.J., Gorno-Tempini M.L., Phillips J.A., Noppeney U., Frackowiak R.S., Friston K.J., Price C.J. Anatomic constraints on cognitive theories of category specificity. Neuroimage 2002, 15:675-685.
16. Dhond R.P., Witzel T., Dale A.M., Halgren E. Spatiotemporal cortical dynamics underlying abstract and concrete word reading. Hum. Brain Mapp. 2007, 28:355-362.
17. Francis W.N., Kucera H. Frequency Analysis of English Usage: Lexicon and Grammar 1982, Houghton Mifflin, Boston.
18. Gonzalez Andino S.L., Grave de Peralta R., Khateb A., Pegna A.J., Thut G., Landis T. A glimpse into your vision. Hum. Brain Mapp. 2007, 28:614-624.
19. Guenther F.H., Brumberg J.S., Wright E.J., Nieto-Castanon A., Tourville J.A., Panko M., Law R., Siebert S.A., Bartels J.L., Andreasen D.S., Ehirim P., Mao H., Kennedy P.R. A wireless brain-machine interface for real-time speech synthesis. PLoS ONE 2009, 4:e8218.
20. Hämäläinen M., Ilmoniemi R. Interpreting magnetic fields of the brain: minimum norm estimates. Med. Biol. Eng. Comput. 1994, 32:35-42.
21. Hauk O., Davis M.H., Kherif F., Pulvermuller F. Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging. Eur. J. Neurosci. 2008, 27:1856-1866.
22. Holcomb P.J., Neville H.J. Auditory and visual semantic priming in lexical decision: A comparison using event-related brain potentials. Lang. Cogn. Process. 1990, 5:281-312.
23. Hagoort P., Hald L., Bastiaansen M., Petersson K.M. Integration of word meaning and world knowledge in language comprehension. Science 2004, 304:438-441.
24. Huang M.X., Song T., Hagler D.J., Podgorny I., Jousmaki V., Cui L., Gaa K., Harrington D.L., Dale A.M., Lee R.R., Elman J., Halgren E. A novel integrated MEG and EEG analysis method for dipolar sources. Neuroimage 2007, 37:731-748.
25. Indefrey P., Levelt W.J. The spatial and temporal signatures of word production components. Cognition 2004, 92:101-144.
26. Joachims T. Making Large-Scale SVM Learning Practical. Advances in Kernel Methods-Support Vector Learning 1999, MIT Press, Cambridge. B. Scholkopf, C.J.C. Burges, A.J. Smola (Eds.).
27. Kellis S., Miller K., Thomson K., Brown R., House P., Greger B. Decoding spoken words using local field potentials recorded from the cortical surface. J. Neural Eng. 2010, 7:056007.
28. Kutas M., Hillyard S.A. Reading senseless sentences: brain potentials reflect semantic incongruity. Science 1980, 207:203-205.
29. Kutas M., Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature 1984, 307:161-163.
30. Low A., Bentin S., Rockstroh B., Silberman Y., Gomolla A., Cohen R., Elbert T. Semantic categorization in the human brain: spatiotemporal dynamics revealed by magnetoencephalography. Psychol. Sci. 2003, 14:367-372.
31. Marinkovic K., Dhond R.P., Dale A.M., Glessner M., Carr V., Halgren E. Spatiotemporal dynamics of modality-specific and supramodal word processing. Neuron 2003, 38:487-497.
32. Martin R.C. Language processing: functional organization and neuroanatomical basis. Annu. Rev. Psychol. 2003, 54:55-89.
33. Martin A., Chao L.L. Semantic memory and the brain: structure and processes. Curr. Opin. Neurobiol. 2001, 11:194-201.
34. Martin A., Wiggs C.L., Ungerleider L.G., Haxby J.V. Neural correlates of category-specific knowledge. Nature 1996, 379:649-652.
35. McCarthy R.A. Semantic Knowledge and Semantic Representations 1995, Psychology Press, New York.
36. Moore C.J., Price C.J. A functional neuroimaging study of the variables that generate category-specific object processing differences. Brain 1999, 122(Pt 5):943-962.
37. Mummery C.J., Patterson K., Hodges J.R., Wise R.J. Generating 'tiger' as an animal name or a word beginning with T: differences in brain activation. Proc. Biol. Sci. 1996, 263:989-995.
38. Mummery C.J., Patterson K., Hodges J.R., Price C.J. Functional neuroanatomy of the semantic system: divisible by what?. J. Cogn. Neurosci. 1998, 10:766-777.
39. Patterson K., Nestor P.J., Rogers T.T. Where do you know what you know? The representation of semantic knowledge in the human brain. Nat. Rev. Neurosci. 2007, 8:976-987.
40. Perani D., Cappa S.F., Bettinardi V., Bressi S., Gorno-Tempini M., Matarrese M., Fazio F. Different neural systems for the recognition of animals and man-made tools. NeuroReport 1995, 6:1637-1641.
41. Perani D., Schnur T., Tettamanti M., Gorno-Tempini M., Cappa S.F., Fazio F. Word and picture matching: a PET study of semantic category effects. Neuropsychologia 1999, 37:293-306.
42. Pulvermuller F. Brain mechanisms linking language and action. Nat. Rev. Neurosci. 2005, 6:576-582.
43. Shinkareva S.V., Mason R.A., Malave V.L., Wang W., Mitchell T.M., Just M.A. Using FMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS ONE 2008, 3:e1394.
44. Suppes P., Han B. Brain-wave representation of words by superposition of a few sine waves. Proc. Natl Acad. Sci. USA 2000, 97:8738-8743.
45. Suppes P., Lu Z.-L., Han B. Brain wave recognition of words. Proc. Natl Acad. Sci. USA 1997, 94:14965-14969.
46. Suppes P., Han B., Epelboim J., Lu Z.-L. Invariance between subjects of brain wave representations of language. Proc. Natl Acad. Sci. USA 1999, 96:12953-12958.
47. Tranel D., Damasio H., Damasio A.R. A neural basis for the retrieval of conceptual knowledge. Neuropsychologia 1997, 35:1319-1327.
48. Tyler L.K., Moss H.E. Towards a distributed account of conceptual knowledge. Trends Cogn. Sci. 2001, 5:244-252.
49. Tyler L.K., Moss H.E., Durrant-Peatfield M.R., Levy J.P. Conceptual structure and the structure of concepts: a distributed account of category-specific deficits. Brain Lang. 2000, 75:195-231.
50. Vapnik V.N. The nature of statistical learning theory 1995, Springer-Verlag, New York.
51. Warrington E.K., McCarthy R. Category specific access dysphasia. Brain 1983, 106(Pt 4):859-878.
52. Warrington E.K., Shallice T. Category specific semantic impairments. Brain 1984, 107(Pt 3):829-854.
53. Weiss S., Mueller H.M. The contribution of EEG coherence to the investigation of language. Brain Lang. 2003, 85:325-343.
54. Wolters C.H., Anwander A., Tricoche X., Weinstein D., Koch M.A., MacLeod R.S. Influence of tissue conductivity anisotropy on EEG/MEG field and return current computation in a realistic head model: a simulation and visualization study using high-resolution finite element modeling. Neuroimage 2006, 30:813-826.