Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans

Journal of Neural Engineering

Volumn 8, Issue 4, 2011, Pages

  Pei, Xiaomei ^a   Barbour, Dennis L ^b   Leuthardt, Eric C ^b,c   Schalk, Gerwin ^a,c,d,e,f  

^a WADSWORTH CENTER   (United States)

^b WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^c WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d ALBANY MEDICAL COLLEGE   (United States)

^e RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^f STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN SIGNALS; CORTICAL AREAS; ELECTROCORTICOGRAPHIC SIGNALS; ELECTROCORTICOGRAPHY; EXPERIMENTAL EVIDENCE; LIMB MOVEMENTS; SPOKEN WORDS;

BRAIN; SPEECH COMMUNICATION;

LINGUISTICS;

ADOLESCENT; ADULT; BRAIN MAPPING; CLINICAL ARTICLE; CONFERENCE PAPER; CONSONANT; ELECTROCORTICOGRAPHY; FEMALE; HUMAN; MALE; PRIORITY JOURNAL; SIGNAL DETECTION; SPEECH DISCRIMINATION; VOWEL; WORD RECOGNITION; ARTICLE; BRAIN; BRAIN CORTEX; COMMUNICATION AID; COMPUTER INTERFACE; ELECTRODE; ELECTROENCEPHALOGRAPHY; EPILEPSY; HEMISPHERIC DOMINANCE; METHODOLOGY; MIDDLE AGED; MOVEMENT (PHYSIOLOGY); PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; SPEECH PERCEPTION; STATISTICAL ANALYSIS;

ADOLESCENT; ADULT; BRAIN; BRAIN MAPPING; CEREBRAL CORTEX; COMMUNICATION AIDS FOR DISABLED; DATA INTERPRETATION, STATISTICAL; DISCRIMINATION (PSYCHOLOGY); ELECTRODES, IMPLANTED; ELECTROENCEPHALOGRAPHY; EPILEPSY; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; MIDDLE AGED; MOVEMENT; SPEECH PERCEPTION; USER-COMPUTER INTERFACE;

EID: 79960777484     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/8/4/046028     Document Type: Conference Paper

References (61)

1. Wolpaw J R and McFarland D J 2004 Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans Proc. Natl Acad. Sci. USA. 101 17849-54 (Pubitemid 40051975)
2. Serruya M et al 2002 Instant neural control of a movement signal Nature 416 141-2 (Pubitemid 34246464)
3. Santhanam G et al 2006 A high-performance brain-computer interface Nature 442 195-8 (Pubitemid 44086565)
4. Velliste M et al 2008 Cortical control of a prosthetic arm for self-feeding Nature 453 1098-101
5. Leuthardt E C et al 2004 A brain-computer interface using electrocorticographic signals in humans J. Neural Eng. 1 63-71 (Pubitemid 41079659)
6. Wolpaw J R et al 2002 Brain-computer interfaces for communication and control Clin. Neurophysiol. 113 767-91 (Pubitemid 34621187)
7. Wolpaw J R 2007 Brain-computer interfaces as new brain output pathways J. Physiol. (Lond.) 579 613-9 (Pubitemid 46404345)
8. Sellers E and Donchin E 2006 A P300-based brain-computer interface: initial tests by ALS patients Clin. Neurophysiol. 117 538-48 (Pubitemid 43343986)
9. Hochberg L R et al 2006 Neuronal ensemble control of prosthetic devices by a human with tetraplegia Nature 442 164-71 (Pubitemid 44086558)
10. Blankertz B et al 2006 The Berlin brain-computer interface: EEG-based communication without subject training IEEE Trans. Neural Syst. Rehabil. Eng. 14 147-52 (Pubitemid 44150229)
11. Guenther F H et al 2009 A wireless brain-machine interface for real-time speech synthesis PLoS ONE 4 e8218
12. Price C J 2000 The anatomy of language: contributions from functional neuroimaging J. Anat. 197 (Pt 3) 335-59
13. Fiez J A and Petersen S E 1998 Neuroimaging studies of word reading Proc. Natl Acad. Sci. USA 95 914-21 (Pubitemid 28124886)
14. Hickok G and Poeppel D 2007 The cortical organization of speech processing Nat. Rev. Neurosci. 8 393-402 (Pubitemid 46652465)
15. Mitchell T M et al 2008 Predicting human brain activity associated with the meanings of nouns Science 320 1191-5 (Pubitemid 351929502)
16. Suppes P and Han B 2000 Brain-wave representation of words by superposition of a few sine waves Proc. Natl Acad. Sci. USA 97 8738-43 (Pubitemid 30639743)
17. Formisano E et al 2008 'Who' is saying "what"? Brain-based decoding of human voice and speech Science 322 970-3
18. DaSalla C S et al 2009 Single-trial classification of vowel speech imagery using common spatial patterns Neural Netw. 22 1334-9
19. Deng S et al 2010 EEG classification of imagined syllable rhythm using Hilbert spectrum methods J. Neural Eng. 7 046006
20. Kellis S et al 2010 Decoding spoken words using local field potentials recorded from the cortical surface J. Neural Eng. 7 056007
21. Carreiras M and Price C J 2008 Brain activation for consonants and vowels Cereb. Cortex 18 1727-35 (Pubitemid 351882049)
22. Caramazza A et al 2000 Separable processing of consonants and vowels Nature 403 428-30 (Pubitemid 30073091)
23. Ferreres A R et al 2003 Phonological alexia with vowel-consonant dissociation in non-word reading Brain Lang. 84 399-413 (Pubitemid 36349296)
24. Boatman D, Hall C, Goldstein M H, Lesser R P and Gordon B1997 Neuroperceptual differences in consonant and vowel discrimination: as revealed by direct cortical electrical interference Cortex 33 83-98 (Pubitemid 27154113)
25. Sharp D J et al 2005 Lexical retrieval constrained by sound structure: the role of the left inferior frontal gyrus Brain Lang. 92 309-19 (Pubitemid 40249676)
26. Crone N E et al 2001 Induced electrocorticographic gamma activity during auditory perception. Brazier award-winning article 2001 Clin. Neurophysiol. 112 565-82 (Pubitemid 32245629)
27. Crone N, Hao L, Hart J, Boatman D, Lesser R P, Irizarry R and Gordon B 2001 Electrocorticographic gamma activity during word production in spoken and sign language Neurology 57 2045-53 (Pubitemid 33126873)
28. Sinai A et al 2005 Electrocorticographic high gamma activity versus electrical cortical stimulation mapping of naming Brain 128 1556-70 (Pubitemid 41373675)
29. Canolty R T et al 2007 Spatiotemporal dynamics of word processing in the human brain Front Neurosci 1 185-96
30. Towle V L et al 2008 ECoG gamma activity during a language task: differentiating expressive and receptive speech areas Brain 131 2013-27
31. Edwards E et al 2005 High gamma activity in response to deviant auditory stimuli recorded directly from human cortex J. Neurophysiol. 94 4269-80 (Pubitemid 41691784)
32. Edwards E et al 2009 Comparison of time-frequency responses and the event-related potential to auditory speech stimuli in human cortex J. Neurophysiol. 102 377-86
33. Chang E F et al 2010 Categorical speech representation in human superior temporal gyrus Nat. Neurosci. 13 1428-32
34. Aoki F et al 1999 Increased gamma-range activity in human sensorimotor cortex during performance of visuomotor tasks Clin. Neurophysiol. 110 524-37 (Pubitemid 29207503)
35. Aoki F et al 2001 Changes in power and coherence of brain activity in human sensorimotor cortex during performance of visuomotor tasks Biosystems 63 89-99 (Pubitemid 32928491)
36. Leuthardt E C et al 2007 Electrocorticographic frequency alteration mapping: a clinical technique for mapping the motor cortex Neurosurgery 60 260-70 discussion 270-1
37. Miller K J et al 2007 Spectral changes in cortical surface potentials during motor movement J. Neurosci. 27 2424-32 (Pubitemid 46340971)
38. Brunner P et al 2009 A practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans Epilepsy Behav. 15 278-86
39. Schalk G et al 2007 Decoding two-dimensional movement trajectories using electrocorticographic signals in humans J. Neural Eng. 4 264-75
40. Kubanek J et al 2009 Decoding flexion of individual fingers using electrocorticographic signals in humans J. Neural Eng. 6 066001
41. Pistohl T et al 2008 Prediction of arm movement trajectories from ECoG-recordings in humans J. Neurosci. Methods 167 105-14 (Pubitemid 350180091)
42. Blakely T, Miller K J, Rao R P, Holmes M D and Ojemann J G 2008 Localization and classification of phonemes using high spatial resolution electrocorticography (ECoG) grids Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008 4964-7
43. Chao Z C, Nagasaka Y and Fujii N 2010 Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys Front. Neuroeng. 3 3
44. Gunduz A et al 2009 Mapping broadband electrocorticographic recordings to two-dimensional hand trajectories in humans Motor control features Neural Netw. 22 1257-70
45. Schalk G et al 2004 BCI2000: a general-purpose brain-computer interface (BCI) system IEEE Trans. Biomed. Eng. 51 1034-43 (Pubitemid 38661459)
46. Mellinger J et al 2007 An MEG-based brain-computer interface (BCI) Neuroimage 36 581-93 (Pubitemid 46915502)
47. Miller K J et al 2007 Cortical electrode localization from x-rays and simple mapping for electrocorticographic research: the 'Location on Cortex' (LOC) package for MATLAB J. Neurosci. Methods 162 303-8 (Pubitemid 46527928)
48. Fox P et al 1985 A stereotactic method of anatomical localization for positron emission tomography J. Comput. Assist. Tomogr. 9 141-53 (Pubitemid 15199649)
49. Talairach J and Tournoux P 1988 Co-Planar Sterotaxic Atlas of the Human Brain (New York: Thieme Medical)
50. Marple S L 1987 Digital Spectral Analysis: with Applications (Englewood Cliffs, NJ: Prentice-Hall)
51. Pei X et al 2011 Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition Neuroimage 54 2960-72
52. Crone N E et al 2006 High-frequency gamma oscillations and human brain mapping with electrocorticography Prog. Brain Res. 159 275-95 (Pubitemid 44634651)
53. Crone N E et al 1998 Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis: II. Event-related synchronization in the gamma band Brain 121 (Pt 12) 2301-15 (Pubitemid 28552467)
54. Miller K J et al 2008 Beyond the gamma band: the role of high-frequency features in movement classification IEEE Trans. Biomed. Eng. 55 1634-7 (Pubitemid 351550734)
55. Ball T et al 2009 Differential representation of arm movement direction in relation to cortical anatomy and function J. Neural Eng. 6 016006
56. Gaona C M et al 2011 Non-uniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex J. Neurosci. 31 2091-100
57. Peng H C et al 2005 Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans. Pattern Anal. Mach. Intell. 27 1226-38
58. Miller K J et al 2010 Cortical activity during motor execution, motor imagery, and imagery-based online feedback Proc. Natl Acad. Sci. USA 107 4430-5
59. Pulvermuller F et al 2006 Motor cortex maps articulatory features of speech sounds Proc. Natl Acad. Sci. USA 103 7865-70
60. Pulvermuller F and Fadiga L 2010 Active perception: sensorimotor circuits as a cortical basis for language Nat. Rev. Neurosci. 11 351-60
61. Huang J et al 2002 Comparing cortical activations for silent and overt speech using event-related fMRI Hum. Brain Mapp. 15 39-53 (Pubitemid 34020612)