Using the electrocorticographic speech network to control a brain-computer interface in humans

Journal of Neural Engineering

Volumn 8, Issue 3, 2011, Pages

  Leuthardt, Eric C ^a,b   Gaona, Charles ^a   Sharma, Mohit ^a   Szrama, Nicholas ^a,b   Roland, Jarod ^b   Freudenberg, Zac ^b   Solis, Jamie ^b   Breshears, Jonathan ^b   Schalk, Gerwin ^b,c,d,e,f  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^b WASHINGTON UNIVERSITY   (United States)

^c WADSWORTH CENTER   (United States)

^d ALBANY MEDICAL COLLEGE   (United States)

^e RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^f STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN SIGNALS; COMPUTER CURSOR; CORTICAL NETWORK; DEVICE CONTROL; ELECTROCORTICOGRAPHY; FREQUENCY OSCILLATIONS; HUMAN PATIENTS; MICRO WIRE; MINIMALLY INVASIVE; SENSORIMOTOR CORTEX;

BRAIN; COMPUTER CONTROL SYSTEMS; ELECTROPHYSIOLOGY; INTERFACES (COMPUTER); MEDICAL COMPUTING; ROBUST CONTROL; SUBSTRATES;

BRAIN COMPUTER INTERFACE;

ADULT; ARTICLE; AUDITORY CORTEX; BRAIN COMPUTER INTERFACE; BRAIN CORTEX; CASE REPORT; DIAGNOSTIC ACCURACY; ELECTROCORTICOGRAPHY; ELECTRODE; FEMALE; HIGH FREQUENCY OSCILLATION; HUMAN; IMAGINATION; INTRACTABLE EPILEPSY; INVASIVE PROCEDURE; MALE; MICROARRAY ANALYSIS; NERVE CELL NETWORK; PHONEME; PHONETICS; PREMOTOR CORTEX; PRIORITY JOURNAL; SENSORIMOTOR CORTEX; SIGNAL PROCESSING; SPEECH; BRAIN; BRAIN MAPPING; COMPUTER; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEEDBACK SYSTEM; METHODOLOGY; MIDDLE AGED; PHYSIOLOGY; SPEECH ANALYSIS;

ADULT; BRAIN; BRAIN MAPPING; COMPUTER PERIPHERALS; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK, PHYSIOLOGICAL; FEMALE; HUMANS; IMAGINATION; MALE; MIDDLE AGED; NERVE NET; SPEECH PRODUCTION MEASUREMENT; USER-COMPUTER INTERFACE;

EID: 79957943444     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/8/3/036004     Document Type: Article

References (56)

1. Ball T, Kern M, Mutschler I, Aertsen A and Schulze-Bonhage A 2009 Signal quality of simultaneously recorded invasive and non-invasive EEG Neuroimage 46 708-16
2. Billingsley-Marshall R L, Clear T, Mencl W E, Simos P G, Swank P R, Men D, Sarkari S, Castillo E M and Papanicolaou A C 2007 A comparison of functional MRI and magnetoencephalography for receptive language mapping J. Neurosci. Methods 161 306-13
3. Binder J 2000 The new neuroanatomy of speech perception Brain 123 Pt 12 2371-2
4. Binder J R, Frost J A, Hammeke T A, Bellgowan P S, Springer J A, Kaufman J N and Possing E T 2000 Human temporal lobe activation by speech and nonspeech sounds Cereb. Cortex 10 512-28
5. Binder J R, Frost J A, Hammeke T A, Cox R W, Rao S M and Prieto T 1997 Human brain language areas identified by functional magnetic resonance imaging J. Neurosci. 17 353-62
6. Binder J R, McKiernan K A, Parsons M E, Westbury C F, Possing E T, Kaufman J N and Buchanan L 2003 Neural correlates of lexical access during visual word recognition J. Cogn. Neurosci. 15 372-93
7. Binder J R et al 1994 Functional magnetic resonance imaging of human auditory cortex Ann. Neurol. 35 662-72
8. Blakely T, Miller K J, Rao R P, Holmes M D and Ojemann J G 2008 Localization and classification of phonemes using high spatial resolution electrocorticography (ECoG) grids Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008 4964-7
9. Boulton A A, Baker G B and Vanderwolf C H 1990 Neurophysiological Techniques: II. Applications to Neural Systems (Chfton, NJ: Humana Press) http://www.springerprotocols.com/BookToc/doi/10.1385/0896031853
10. Bullara L A, Agnew W F, Yuen T G, Jacques S and Pudenz R H 1979 Evaluation of electrode array material for neural prostheses Neurosurgery 5 681-6
11. Chao Z C, Nagasaka Y and Fujii N 2010 Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys Front Neuroeng. 3 3
12. Crone N E, Boatman D, Gordon B and Hao L 2001a Induced electrocorticographic gamma activity during auditory perception. Brazier Award-winning article, 2001 Clin. Neurophysiol. 112 565-82
13. Crone N E, Hao L, Hart J Jr, Boatman D, Lesser R P, Irizarry R and Gordon B 2001b Electrocorticographic gamma activity during word production in spoken and sign language Neurology 57 2045-53
14. Crone N E, Miglioretti D L, Gordon B and Lesser R P 1998 Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis: II. Event-related synchronization in the gamma band Brain 121 Pt 12 2301-15
15. Dronkers N F, Wilkins D P, Van Valin R D Jr, Redfern B B and Jaeger J J 2004 Lesion analysis of the brain areas involved in language comprehension Cognition 92 145-77
16. Duffau H, Capelle L, Denvil D, Gatignol P, Sichez N, Lopes M, Sichez J P and Van Effenterre R 2003 The role of dominant premotor cortex in language: a study using intraoperative functional mapping in awake patients Neuroimage 20 1903-14
17. Fiez J A and Petersen S E 1998 Neuroimaging studies of word reading Proc. Natl Acad. Sci. USA 95 914-21
18. Freeman W J, Holmes M D, Burke B C and Vanhatalo S 2003 Spatial spectra of scalp EEG and EMG from awake humans Clin. Neurophysiol. 114 1053-68
19. Gaona C M, Sharma M, Freudenburg Z V, Breshears J D, Bundy D T, Roland J, Barbour D L, Schalk G and Leuthardt E C 2011 Nonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex J. Neurosci. 31 2091-100
20. Heim S, Opitz B and Friederici A D 2002 Broca's area in the human brain is involved in the selection of grammatical gender for language production: evidence from event-related functional magnetic resonance imaging Neurosci. Lett. 328 101-4
21. Heldman D A, Wang W, Chan S S and Moran D W 2006 Local field potential spectral tuning in motor cortex during reaching IEEE Trans. Neural Syst. Rehabil. Eng. 14 180-3
22. Hickok G and Poeppel D 2007 The cortical organization of speech processing Nat. Rev. Neurosci. 8 393-402
23. Hinterberger T, Widman G, Lal T N, Hill J, Tangermann M, Rosenstiel W, Scholkopf B, Elger C and Birbaumer N 2008 Voluntary brain regulation and communication with electrocorticogram signals Epilepsy Behav. 13 300-6
24. Kellis S, Miller K, Thomson K, Brown R, House P and Greger B 2010 Decoding spoken words using local field potentials recorded from the cortical surface J. Neural Eng. 7 056007
25. Leuthardt E C, Freudenberg Z, Bundy D and Roland J 2009a Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces Neurosurg. Focus 27 E10
26. Leuthardt E C, Miller K J, Schalk G, Rao R P and Ojemann J G 2006 Electrocorticography-based brain computer interface-the Seattle experience IEEE Trans. Neural Syst. Rehabil. Eng. 14 194-8
27. Leuthardt E C, Schalk G, Roland J, Rouse A and Moran D W 2009b Evolution of brain-computer interfaces: going beyond classic motor physiology Neurosurg. Focus 27 E4
28. Leuthardt E C, Schalk G, Wolpaw J R, Ojemann J G and Moran D W 2004 A brain-computer interface using electrocorticographic signals in humans J. Neural Eng. 1 63-71
29. Loeb G E, Walker A E, Uematsu S and Konigsmark B W 1977 Histological reaction to various conductive and dielectric films chronically implanted in the subdural space J. Biomed. Mater. Res. 11 195-210
30. Margalit E et al 2003 Visual and electrical evoked response recorded from subdural electrodes implanted above the visual cortex in normal dogs under two methods of anesthesia J. Neurosci. Methods 123 129-37
31. McFarland D J, Miner L A, Vaughan T M and Wolpaw J R 2000 Mu and beta rhythm topographies during motor imagery and actual movements Brain Topogr. 12 177-86
32. Miller K J, Makeig S, Hebb A O, Rao R P, denNijs M and Ojemann J G 2007 Cortical electrode localization from x-rays and simple mapping for electrocorticographic research: the 'Location on Cortex' (LOC) package for MATLAB J. Neurosci. Methods 162 303-8
33. Miller K J, Schalk G, Fetz E E, den Nijs M, Ojemann J G and Rao R P N 2010 Cortical activity during motor execution, motor imagery, and imagery-based online feedback Proc. Natl Acad. Sci. USA 107 4430-5
34. Palmer E D, Rosen H J, Ojemann J G, Buckner R L, Kelley W M and Petersen S E 2001 An event-related fMRI study of overt and covert word stem completion Neuroimage 14 182-93
35. Pei X, Leuthardt E C, Gaona C M, Brunner P, Wolpaw J R and Schalk G 2011 Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition Neuroimage 54 2960-72
36. Price C J, Wise R J, Warburton E A, Moore C J, Howard D, Patterson K, Frackowiak R S and Friston K J 1996 Hearing and saying. The functional neuro-anatomy of auditory word processing Brain 119 Pt 3 919-31
37. Pulvermuller F, Shtyrov Y, Ilmoniemi R J and Marslen-Wilson W D 2006 Tracking speech comprehension in space and time Neuroimage 31 1297-305
38. Ray S, Crone N E, Niebur E, Franaszczuk P J and Hsiao S S 2008 Neural correlates of high-gamma oscillations (60-200 Hz) in macaque local field potentials and their potential implications in electrocorticography J. Neurosci. 28 11526-36
39. Saur D et al 2008 Ventral and dorsal pathways for language Proc. Natl Acad. Sci. USA 105 18035-40
40. Schalk G, Anderson N, Wisneski K, Kim W, Smyth M D, Wolpaw J R, Barbour D L and Leuthardt E C 2007a Toward brain-computer interfacing using phonemes decoded from electrocorticography activity (ECoG) in humans Society for Neuroscience Annual Meeting (Washington, DC) http://www.sfn.org/am2007/skins/ main/pdf/pressbook2sectionb-final.pdf
41. Schalk G, Kubanek J, Miller K J, Anderson N R, Leuthardt E C, Ojemann J G, Limbrick D, Moran D, Gerhardt L A and Wolpaw J R 2007b Decoding two-dimensional movement trajectories using electrocorticographic signals in humans J. Neural Eng. 4 264-75
42. Schalk G, McFarland D J, Hinterberger T, Birbaumer N andWolpaw J R 2004 BCI2000: a general-purpose brain-computer interface (BCI) system IEEE Trans. Biomed. Eng. 51 1034-43
43. Schalk G and Mellinger J 2010 A Practical Guide to Brain-Computer Interfacing with BCI2000 (New York: Springer) http://www.springer.com/computer/ hci/book/978-1-84996-091-5
44. Schalk G, Miller K J, Anderson N R, Wilson J A, Smyth M D, Ojemann J G, Moran D W, Wolpaw J R and Leuthardt E C 2008a Two-dimensional movement control using electrocorticographic signals in humans J. Neural Eng. 5 75-84
45. Schalk G, Pei X, Anderson N R, Wisneski K, Smyth M D, Barbour D L, Wolpaw J R and Leuthardt E C 2008b Decoding spoken and imagined phonemes using electrocorticographic signals in humans Society for Neuroscience Annu. Meeting http://www.abstractsonline.com/Plan/ViewAbstract.aspx? sKey=fa317e68-3331-4f94- b0d9-6fa70986f1e4&cKey= bf311a55-8676-4aa7-92ad-51adb48eac6f&mKey= %7bAFEA068D-D012-4520-8E42-10E4D1AF7944%7d
46. Scott S K and Johnsrude I S 2003 The neuroanatomical and functional organization of speech perception Trends Neurosci. 26 100-7
47. Sinai A, Bowers C W, Crainiceanu C M, Boatman D, Gordon B, Lesser R P, Lenz F A and Crone N E 2005 Electrocorticographic high gamma activity versus electrical cortical stimulation mapping of naming Brain 128 1556-70
48. Slutzky M W, Jordan L R, Krieg T, Chen M, Mogul D J and Miller L E 2010 Optimal spacing of surface electrode arrays for brain-machine interface applications J. Neural Eng. 7 26004
49. Specht K and Reul J 2003 Functional segregation of the temporal lobes into highly differentiated subsystems for auditory perception: an auditory rapid event-related fMRI-task Neuroimage 20 1944-54
50. Towle V L, Yoon H A, Castelle M, Edgar J C, Biassou N M, Frim D M, Spire J P and Kohrman M H 2008 ECoG gamma activity during a language task: differentiating expressive and receptive speech areas Brain 131 2013-27
51. Vansteensel M J, Hermes D, Aarnoutse E J, Bleichner M G, Schalk G, van Rijen P C, Leijten F S and Ramsey N F 2010 Brain-computer interfacing based on cognitive control Ann. Neurol. 67 809-16
52. Wang W, Degenhart A D, Collinger J L, Vinjamuri R, Sudre G P, Adelson P D, Holder D L, Leuthardt E C, Moran D W, Boninger M L, Schwartz A B, Crammond D J, Tyler-Kabara E C and Weber D J 2009 Human motor cortical activity recorded with Micro-ECoG electrodes, during individual finger movements Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009 586-9
53. Wilson J A, Felton E A, Garell P C, Schalk G and Williams J C 2006 ECoG factors underlying multimodal control of a brain-computer interface IEEE Trans. Neural Syst. Rehabil. Eng. 14 246-50
54. Wisneski K J, Anderson N, Schalk G, Smyth M, Moran D and Leuthardt E C 2008 Unique cortical physiology associated with ipsilateral hand movements and neuroprosthetic implications Stroke 39 3351-9
55. Wu M, Wisneski K, Schalk G, Sharma M, Roland J, Breshears J, Gaona C and Leuthardt E C 2010 Electrocorticographic frequency alteration mapping for extraoperative localization of speech cortex Neurosurgery 66 E407-9
56. Yuen T G, Agnew W F and Bullara L A 1987 Tissue response to potential neuroprosthetic materials implanted subdurally Biomaterials 8 138-41