Decoding spoken words using local field potentials recorded from the cortical surface

Journal of Neural Engineering

Volumn 7, Issue 5, 2010, Pages

  Kellis, Spencer ^a   Miller, Kai ^b   Thomson, Kyle ^a   Brown, Richard ^a   House, Paul ^c   Greger, Bradley ^a  

^a Department of Electrical and Computer Engineering   (United States)

^b UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMYOTROPHIC LATERAL SCLEROSIS; BRAINSTEM; CEREBRAL CORTEX; CORTICAL SURFACES; ELECTROCORTICOGRAPHY; LOCAL FIELD POTENTIALS; LOCKED-IN SYNDROME; MOTOR CORTEX; NEURAL SIGNALS; NEURAL-PROCESSING; PATHOLOGICAL CONDITIONS; RAPID COMMUNICATION; SPOKEN WORDS;

ELECTRODES; INTERFACES (COMPUTER); RESTORATION; SPEECH COMMUNICATION;

BRAIN COMPUTER INTERFACE;

ACCURACY; AMYOTROPHIC LATERAL SCLEROSIS; ARTICLE; BRAIN COMPUTER INTERFACE; BRAIN CORTEX; BRAIN REGION; BRAIN STEM INJURY; CASE REPORT; DISEASE SEVERITY; ELECTROCORTICOGRAPHY; EVENT RELATED POTENTIAL; HUMAN; LANGUAGE; LOCKED IN SYNDROME; MALE; MICROELECTRODE; PARALYSIS; PRIORITY JOURNAL; SIGNAL PROCESSING; SPEECH; AUDITORY STIMULATION; COMPARATIVE STUDY; ELECTROENCEPHALOGRAPHY; EVOKED MUSCLE RESPONSE; METHODOLOGY; MOTOR CORTEX; PHYSIOLOGY; TEMPORAL LOBE;

ACOUSTIC STIMULATION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, MOTOR; HUMANS; MALE; MOTOR CORTEX; SPEECH; TEMPORAL LOBE;

EID: 78649278309     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/7/5/056007     Document Type: Article

References (71)

1. Smith E and Delargy M 2005 Locked-in syndrome Br. Med. J. 330 406-9
2. Majaranta P and Räihä K-J 2002 Twenty years of eye typing: systems and design issues Proc. 2002 Symp. on Eye Tracking Research & Applications (New Orleans, LA: ACM) pp 15-22
3. Bauer G, Gerstenbrand F and Rumpl E 1979 Varieties of the locked-in syndrome J. Neurol. 221 77-91
4. Leon-Carrion J, van Eeckhout P, Dominguez-Morales Mdel R and Perez-Santamaria F J 2002 The locked-in syndrome: a syndrome looking for a therapy Brain Inj. 16 571-82
5. Birbaumer N 2006 Breaking the silence: brain-computer interfaces (BCI) for communication and motor control Psychophysiology 43 517-32
6. Hochberg L R et al 2006 Neuronal ensemble control of prosthetic devices by a human with tetraplegia Nature 442 164-71
7. Bartels J et al 2008 Neurotrophic electrode: method of assembly and implantation into human motor speech cortex J. Neurosci. Methods 174 168-76
8. Kennedy P R, Bakay R A, Moore M M, Adams K and Goldwaithe J 2000 Direct control of a computer from the human central nervous system IEEE Trans. Rehabil. Eng. 8 198-202
9. Guenther F H et al 2009 A wireless brain-machine interface for real-time speech synthesis PloS one 4 e8218
10. Guenther F H, Ghosh S S and Tourville J A 2006 Neural modeling and imaging of the cortical interactions underlying syllable production Brain Lang. 96 280-301
11. Birbaumer N et al 1999 A spelling device for the paralysed Nature 398 297-8
12. Daly J J and Wolpaw J R 2008 Brain-computer interfaces in neurological rehabilitation Lancet Neurol. 7 1032-43
13. Donchin E, Spencer K M and Wijesinghe R 2000 The mental prosthesis: assessing the speed of a P300-based brain-computer interface IEEE Trans. Rehabil. Eng. 8 174-9
14. Farwell L A and Donchin E 1988 Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials Electroencephalogr. Clin. Neurophysiol. 70 510-23
15. Kübler A et al 1999 The thought translation device: a neurophysiological approach to communication in total motor paralysis Exp. Brain Res. 124 223-32 (Pubitemid 29134422)
16. Nijboer F et al 2008 A P300-based brain-computer interface for people with amyotrophic lateral sclerosis Clin. Neurophysiol. 119 1909-16
17. Wolpaw J R and McFarland D J 1994 Multichannel EEG-based brain-computer communication Electroencephalogr. Clin. Neurophysiol. 90 444-9
18. McFarland D J, Krusienski D J, Sarnacki W A and Wolpaw J R 2008 Emulation of computer mouse control with a noninvasive brain-computer interface J. Neural. Eng. 5 101-10
19. Zanos S, Miller K J and Ojemann J G 2008 Electrocorticographic spectral changes associated with ipsilateral individual finger and whole hand movement Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008 5939-42
20. Miller K J, Zanos S, Fetz E E, den Nijs M and Ojemann J G 2009 Decoupling the cortical power spectrum reveals real-time representation of individual finger movements in humans J. Neurosci. 29 3132-7
21. Scherer R, Zanos S P, Miller K J, Rao R P N and Ojemann J G 2009 Classification of contralateral and ipsilateral finger movements for electrocorticographic brain-computer interfaces Neurosurg. Focus 27 E12
22. Bougrain L and Liang N 2009 Band-specific features improve finger flexion prediction from ECoG Jornadas Argentinas sobre Interfaces Cerebro Computadora 2009 1-4
23. Pistohl T, Ball T, Schulze-Bonhage A, Aertsen A and Mehring C 2008 Prediction of arm movement trajectories from ECoG-recordings in humans J. Neurosci. Methods 167 105-14 (Pubitemid 350180091)
24. Yanagisawa T et al 2009 Neural decoding using gyral and intrasulcal electrocorticograms Neuroimage 45 1099-106
25. Sanchez J C, Gunduz A, Carney P R and Principe J C 2008 Extraction and localization of mesoscopic motor control signals for human ECoG neuroprosthetics J. Neurosci. Methods 167 63-81 (Pubitemid 350180085)
26. Kellis S S, House P A, Thomson K E, Brown R and Greger B 2009 Human neocortical electrical activity recorded on nonpenetrating microwire arrays: applicability for neuroprostheses Neurosurg. Focus 27 E9
27. Schalk G et al 2007 Decoding two-dimensional movement trajectories using electrocorticographic signals in humans J. Neural. Eng. 4 264-75
28. Schalk G et al 2008 Two-dimensional movement control using electrocorticographic signals in humans J. Neural. Eng. 5 75-84
29. Lal T N et al 2005 Methods towards invasive human brain computer interfaces Advances in Neural Information Systems 17 ed L Saul, Y Weiss and L Bottou (Cambridge, MA: MIT Press) pp 737-44
30. Leuthardt E C, Schalk G, Wolpaw J R, Ojemann J G and Moran D W 2004 A brain-computer interface using electrocorticographic signals in humans J. Neural Eng. 1 63-71 (Pubitemid 41079659)
31. Blakely T, Miller K J, Rao R P, Holmes M D and Ojemann J G 2008 Localization and classification of phonemes using high spatial resolution electrocorticography (ECoG) grids Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008 4964-7
32. Crone N, Miglioretti D, Gordon B and Lesser R 1998 Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis: II. Event-related synchronization in the gamma band Brain 121 2301-15
33. Crone N E et al 2001 Electrocorticographic gamma activity during word production in spoken and sign language Neurology 57 2045-53
34. Edwards E et al 2010 Spatiotemporal imaging of cortical activation during verb generation and picture naming Neuroimage 50 291-301
35. Towle V L et al 2008 ECoG gamma activity during a language task: differentiating expressive and receptive speech areas Brain 131 2013-27
36. Cooper R, Winter A L, Crow H J and Walter W G 1965 Comparison of subcortical, cortical and scalp activity using chronically indwelling electrodes in man Electroencephalogr. Clin. Neurophysiol. 18 217-28
37. Pfurtscheller G and Cooper R 1975 Frequency dependence of the transmission of the EEG from cortex to scalp Electroencephalogr. Clin. Neurophysiol. 38 93-6
38. Crone N E, Sinai A and Korzeniewska A 2006 Event-Related Dynamics of Brain Oscillations (Amsterdam: Elsevier)
39. Menon V et al 1996 Spatio-temporal correlations in human gamma band electrocorticograms Electroencephalogr. Clin. Neurophysiol. 98 89-102
40. Buzsaki G and Chrobak J J 1995 Temporal structure in spatially organized neuronal ensembles: a role for interneuronal networks Curr. Opin. Neurobiol. 5 504-10
41. Singer W 1993 Synchronization of cortical activity and its putative role in information processing and learning Annu. Rev. Physiol. 55 349-74
42. Womelsdorf T et al 2007 Modulation of neuronal interactions through neuronal synchronization Science. 316 1609-12
43. Leuthardt E C, Freudenberg Z, Bundy D and Roland J 2009 Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces Neurosurg. Focus 27 E10
44. Miller K J et al 2007 Spectral changes in cortical surface potentials during motor movement J. Neurosci. 27 2424-32
45. Ohara S et al 2000 Movement-related change of electrocorticographic activity in human supplementary motor area proper Brain 123 1203-15
46. Pfurtscheller G, Graimann B, Huggins J E, Levine S P and Schuh L A 2003 Spatiotemporal patterns of beta desynchronization and gamma synchronization in corticographic data during self-paced movement Clin. Neurophysiol. 114 1226-36 (Pubitemid 36776820)
47. Kellis S, Miller K, Thomson K, Brown R, House P and Greger B 2010 Classification of spoken words using surface local field potentials 32nd Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS) (Buenos Aires, Argentina)
48. Hermes D, Miller K J, Noordmans H J, Vansteensel M J and Ramsey N F 2010 Automated electrocorticographic electrode localization on individually rendered brain surfaces J. Neurosci. Methods 185 293-8
49. Jolliffe I T 2002 Principal Component Analysis 2nd edn (New York: Springer)
50. Canolty R T et al 2006 High gamma power is phase-locked to theta oscillations in human neocortex Science 313 1626-8
51. Crone N et al 1998 Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization Brain 121 2271-99
52. Mountcastle V B 1957 Modality and topographic properties of single neurons of cat's somatic sensory cortex J. Neurophysiol. 20 408-34
53. Mountcastle V B 1978 Brain mechanisms for directed attention J. R. Soc. Med. 71 14-28
54. Singer W and Gray C M 1995 Visual feature integration and the temporal correlation hypothesis Annu. Rev. Neurosci. 18 555-86
55. von der Malsburg C 1995 Binding in models of perception and brain function Curr. Opin. Neurobiol. 5 520-6
56. Slutzky M W, Jordan L R, Krieg T, Chen M, Mogul D J and Miller L E 2010 Optimal spacing of surface electrode arrays for brain-machine interface applications J. Neural. Eng. 7 26004
57. Lichtheim L 1885 On aphasia Brain 7 433-84
58. Wernicke C 1874 Der aphasische Symptomenkomplex (Breslau: Cohn und Weigert)
59. Karbe H, Herholz K, Weber-Luxenburger G, Ghaemi M and Heiss W D 1998 Cerebral networks and functional brain asymmetry: evidence from regional metabolic changes during word repetition Brain Lang. 63 108-21
60. Murphy K et al 1997 Cerebral areas associated with motor control of speech in humans J. Appl. Physiol. 83 1438-47
61. Penfield W and Boldrey E 1937 Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation Brain 60 389-443
62. Smith A 2006 Speech motor development: integrating muscles, movements, and linguistic units J. Commun. Disord. 39 331-49
63. Bogen J E and Bogen G M 1976 Wernicke's region - Where is it? Ann. New York Acad. Sci. 280 834-43
64. Sahin N T, Pinker S, Cash S S, Schomer D and Halgren E 2009 Sequential processing of lexical, grammatical, and phonological information within Broca's area Science 326 445-9
65. Ojemann G A 1991 Cortical organization of language J. Neurosci. 11 2281-7
66. Wise R J S 2001 Separate neural subsystems within 'Wernicke's area' Brain 124 83-95
67. Selnes O A, Knopman D S, Niccum N and Rubens A B 1985 The critical role of Wernicke's area in sentence repetition Ann. Neurol. 17 549-57 (Pubitemid 15055571)
68. Naeser M A, Gaddie A, Palumbo C L and Stiassny-Eder D 1990 Late recovery of auditory comprehension in global aphasia. Improved recovery observed with subcortical temporal isthmus lesion versus Wernicke's cortical area lesion Arch. Neurol. 47 425-32
69. Hirano S et al 1997 Cortical processing mechanism for vocalization with auditory verbal feedback Neuroreport 8 2379-82
70. McGuire P K, Silbersweig D A and Frith C D 1996 Functional neuroanatomy of verbal self-monitoring Brain 119 907-17
71. Leuthardt E C, Miller K J, Schalk G, Rao R P and Ojemann J G 2006 Electrocorticography-based brain computer interface - the Seattle experience IEEE Trans. Neural Syst. Rehabil. Eng. 14 194-8