Decoding semantic information from human electrocorticographic (ECoG) signals

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

Volumn , Issue , 2011, Pages 6294-6298

  Wang, Wei ^a   Degenhart, Alan D ^a   Sudre, Gustavo P ^b   Pomerleau, Dean A ^b   Tyler Kabara, Elizabeth C ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MAPPING; COMMUNICATION DISORDERS; CORTICAL ACTIVITY; GAUSSIANS; HUMAN SUBJECTS; INTERFACE SYSTEM; RESEARCH AND DEVELOPMENT; SEMANTIC CATEGORY; SEMANTIC INFORMATION; SPEECH PRODUCTION; SUPERIOR TEMPORAL GYRUS; TEMPORAL SEQUENCES;

DATA PROCESSING; DECODING; ELECTROPHYSIOLOGY; INTERFACES (COMPUTER); LEARNING ALGORITHMS; PATTERN RECOGNITION; SEMANTICS;

BRAIN COMPUTER INTERFACE;

ADOLESCENT; ADULT; ARTICLE; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BRAIN; BRAIN MAPPING; CHILD; COMMUNICATION AID; COMPUTER INTERFACE; ELECTRODE; ELECTROPHYSIOLOGY; EPILEPSY; FEMALE; HUMAN; INTERPERSONAL COMMUNICATION; METHODOLOGY; NORMAL DISTRIBUTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOLOGY; PATHOPHYSIOLOGY; PHYSIOLOGY; SIGNAL PROCESSING;

ADOLESCENT; ADULT; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BRAIN; BRAIN MAPPING; CHILD; COMMUNICATION; COMMUNICATION AIDS FOR DISABLED; ELECTRODES; ELECTROPHYSIOLOGY; EPILEPSY; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; NORMAL DISTRIBUTION; SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 84864617645     PISSN: 1557170X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IEMBS.2011.6091553     Document Type: Conference Paper

References (24)

1. A.B. Schwartz, X.T. Cui, D.J. Weber, and D.W. Moran, " Braincontrolled interfaces: movement restoration with neural prosthetics," Neuron, vol. 52, (no. 1), pp. 205-20, Oct 5 2006.
2. L.R. Hochberg, M.D. Serruya, G.M. Friehs, J.A. Mukand, M. Saleh, A.H. Caplan, A. Branner, D. Chen, R.D. Penn, and J.P. Donoghue, "Neuronal ensemble control of prosthetic devices by a human with tetraplegia," Nature, vol. 442, (no. 7099), pp. 164-71, Jul 13 2006.
3. M. Velliste, S. Perel, M.C. Spalding, A.S. Whitford, and A.B. Schwartz, "Cortical control of a prosthetic arm for self-feeding," Nature, vol. 453, (no. 7198), pp. 1098-101, Jun 19 2008.
4. K. Patterson, P.J. Nestor, and T.T. Rogers, "Where do you know what you know? The representation of semantic knowledge in the human brain," Nat Rev Neurosci, vol. 8, (no. 12), pp. 976-87, Dec 2007.
5. A. Martin, "The representation of object concepts in the brain," Annu Rev Psychol, vol. 58, pp. 25-45, 2007.
6. S.V. Shinkareva, R.A. Mason, V.L. Malave, W. Wang, T.M. Mitchell, and M.A. Just, "Using FMRI brain activation to identify cognitive states associated with perception of tools and dwellings," PLoS ONE, vol. 3, (no. 1), pp. e1394, 2008.
7. E.C. Leuthardt, G. Schalk, J.R. Wolpaw, J.G. Ojemann, and D.W. Moran, "A brain-computer interface using electrocorticographic signals in humans," J Neural Eng, vol. 1, (no. 2), pp. 63-71, Jun 2004.
8. K.J. Miller, G. Schalk, E.E. Fetz, M. den Nijs, J.G. Ojemann, and R.P. Rao, "Cortical activity during motor execution, motor imagery, and imagery-based online feedback," Proc Natl Acad Sci U S A, vol. 107, (no. 9), pp. 4430-5, Mar 2 2010.
9. G. Schalk, K.J. Miller, N.R. Anderson, J.A. Wilson, M.D. Smyth, J.G. Ojemann, D.W. Moran, J.R. Wolpaw, and E.C. Leuthardt, "Twodimensional movement control using electrocorticographic signals in humans," J Neural Eng, vol. 5, (no. 1), pp. 75-84, Mar 2008.
10. W. Wang, A.D. Degenhart, J.L. Collinger, R. Vinjamuri, G.P. Sudre, P.D. Adelson, D.L. Holder, E. Leuthardt, D.W. Moran, M.L. Boninger, A.B. Schwartz, D.J. Crammond, E.C. Tyler-Kabara, and D.J. Weber, "Human motor cortical activity recorded with micro- ECoG electrodes during individual finger movements," in Proc. IEEE EMBC, 2009, pp. Pages.
11. K.J. Miller, S. Makeig, A.O. Hebb, R.P. Rao, M. denNijs, and J.G. Ojemann, "Cortical electrode localization from X-rays and simple mapping for electrocorticographic research: The "Location on Cortex" (LOC) package for MATLAB," J Neurosci Methods, vol. 162, (no. 1- 2), pp. 303-8, May 15 2007.
12. G. Schalk, D.J. McFarland, T. Hinterberger, N. Birbaumer, and J.R. Wolpaw, "BCI2000: a general-purpose brain-computer interface (BCI) system," IEEE Trans Biomed Eng, vol. 51, (no. 6), pp. 1034-43, Jun 2004.
13. D.J. McFarland, T. Lefkowicz, and J.R. Wolpaw, "Design and operation of an EEG-based brain-computer interface (BCI) with digital signal processing technology.," Behav Res Meth Instrum Comput, vol. 29, pp. 337-345, 1997.
14. E. Edwards, S.S. Nagarajan, S.S. Dalal, R.T. Canolty, H.E. Kirsch, N.M. Barbaro, and R.T. Knight, "Spatiotemporal imaging of cortical activation during verb generation and picture naming," Neuroimage, Dec 21 2009.
15. N.E. Crone, A. Sinai, and A. Korzeniewska, "High-frequency gamma oscillations and human brain mapping with electrocorticography," Prog Brain Res, vol. 159, pp. 275-95, 2006.
16. D.A. Heldman, W. Wang, S.S. Chan, and D.W. Moran, "Local field potential spectral tuning in motor cortex during reaching," IEEE Trans Neural Syst Rehabil Eng, vol. 14, (no. 2), pp. 180-3, Jun 2006.
17. T.M. Mitchell, Machine Learning: McGraw-Hill, 1997.
18. B.J. Baars, "Language," in Cognition, Brain, and Consciousness, B. J. Baars and N. M. Gage eds.: Elsevier Ltd., 2007.
19. D.M. Taylor, S.I. Tillery, and A.B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices," Science, vol. 296, (no. 5574), pp. 1829-32, Jun 7 2002.
20. W. Wang, S.S. Chan, D.A. Heldman, and D.W. Moran, "Motor cortical representation of position and velocity during reaching," J Neurophysiol, vol. 97, (no. 6), pp. 4258-70, Jun 2007.
21. E. Donchin, K.M. Spencer, and R. Wijesinghe, "The mental prosthesis: assessing the speed of a P300-based brain-computer interface," IEEE Trans Rehabil Eng, vol. 8, (no. 2), pp. 174-9, Jun 2000.
22. R.A. Andersen, J.W. Burdick, S. Musallam, B. Pesaran, and J.G. Cham, "Cognitive neural prosthetics," Trends Cogn Sci, vol. 8, (no. 11), pp. 486-93, Nov 2004.
23. N.F. Ramsey, M.P. van de Heuvel, K.H. Kho, and F.S. Leijten, "Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex," IEEE Trans Neural Syst Rehabil Eng, vol. 14, (no. 2), pp. 214-7, Jun 2006.
24. K.J. Miller, "Broadband spectral change: evidence for a macroscale correlate of population firing rate?," J Neurosci, vol. 30, (no. 19), pp. 6477-9, May 12.