Rapid communication with a "P300" matrix speller using electrocorticographic signals (ecog)

Frontiers in Neuroscience

Volumn , Issue FEB, 2011, Pages

  Brunner, Peter ^a,b,c   Ritaccio, Anthony L ^c   Emrich, Joseph F ^c   Bischof, Horst ^b   Schalk, Gerwin ^a,c,d,e,f  

^a WADSWORTH CENTER   (United States)

^b GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^c ALBANY MEDICAL COLLEGE   (United States)

^d WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e STATE UNIVERSITY OF NEW YORK   (United States)

^f RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Brain computer interface; Electrocorticography; Event related potential; P300; Speller

Indexed keywords

ADULT; AMPLIFIER; ANALOG DIGITAL CONVERTER; ARTICLE; BRAIN COMPUTER INTERFACE; CASE REPORT; COMMUNICATION AID; COMPUTER PROGRAM; COMPUTER TERMINAL; ELECTROCORTICOGRAPHY; ELECTRODE; EVENT RELATED POTENTIAL; EVOKED VISUAL RESPONSE; FEMALE; FRONTAL CORTEX; HUMAN; OCCIPITAL CORTEX; P300 MATRIX SPELLER BRAIN COMPUTER INTERFACE; PARIETAL CORTEX; PERFORMANCE; SIGNAL DETECTION; SPELLING; VISUAL CORTEX;

EID: 79960293074     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2011.00005     Document Type: Article

References (70)

1. Ball, T., Kern, M., Mutschler, I., Aertsen, A., and Schulze-Bonhage, A. (2009). Signal quality of simultaneously recorded invasive and non-invasive EEG. Neuroimage 46, 708-716.
2. Bin, G., Gao, X., Wang, Y., Hong, B., and Gao, S. (2009). VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier]. Comput. Intell. Mag. IEEE 4, 22-26.
3. Birbaumer, N., and Cohen, L. G. (2007). Brain-computer interfaces: communication and restoration of movement in paralysis. J. Physiol. 579(Pt 3), 621-636.
4. Brunner, P., Joshi, S., Briskin, S., Wolpaw, J. R., Bischof, H., and Schalk, G. (2010a). "Does the P300 speller depend on eye gaze?" in Presentation at the TOBI Workshop, Graz.
5. Brunner, P., Joshi, S., Briskin, S., Wolpaw, J. R., Bischof, H., and Schalk, G. (2010b). Does the "P300" speller depend on eye gaze? J. Neural Eng. 7, 056013.
6. Brunner, P., Ritaccio, A. L., Lynch, T. M., Emrich, J. F., Wilson, J. A., Williams, J. C., Aarnoutse, E. J., Ramsey, N. F., Leuthardt, E. C., Bischof, H., and Schalk, G. (2009). A practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans. Epilepsy Behav. 15, 278-286.
7. Chao, Z. C., Nagasaka, Y., and Fujii, N. (2010). Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys. Front. Neuroeng. 3:3. doi: 10.3389/ fneng.2010.00003
8. Cohen, B., and Caroscio, J. (1983). Eye movements in amyotrophic lateral sclerosis. J. Neural. Transm. (Suppl. 19), 305-315.
9. Daniel, P. M., and Whitteridge, D. (1961). The representation of the visual field on the cerebral cortex in monkeys. J. Physiol. 159, 203-221.
10. Davson, H. (1976). Review lecture. The blood-brain barrier. J. Physiol. 255, 1-28.
11. De Keyser, M., Vissenberg, I., and Neetens, A. (1990). Are visually evoked potentials (VEP) useful for determination of visual acuity? A clinical trial. Neuroophthalmology, 10, 153-163.
12. Di Russo, F., Martìnez, A., Sereno, M. I., Pitzalis, S., and Hillyard, S. A. (2002). Cortical sources of the early components of the visual evoked potential. Hum. Brain Mapp. 15, 95-111.
13. Donchin, E., and Arbel, Y. (2009). "P300 based brain computer interfaces: a progress report," in FAC '09: Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience (Heidelberg: Springer-Verlag), 724-731.
14. Engel, S. A., Glover, G. H., and Wandell, B. A. (1997). Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb. Cortex 7, 181-192.
15. Engel, S. A., Rumelhart, D. E., Wandell, B. A., Lee, A. T., Glover, G. H., Chichilnisky, E. J., and Shadlen, M. N. (1994). fMRI of human visual cortex. Nature 369, 525.
16. Farwell, L. A., and Donchin, E. (1988). Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70, 510-523.
17. Felton, E. A., Wilson, J. A., Williams, J. C., and Garell, P. C. (2007). Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. report of four cases. J. Neurosurg. 106, 495-500.
18. Fountas, K. N., and Smith, J. R. (2007). Subdural electrode-associated complications: a 20-year experience. Stereotact. Funct. Neurosurg. 85, 264-272.
19. Gao, X., Xu, D., Cheng, M., and Gao S. (2003). A BCI-based environmental controller for the motion-disabled. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 137-140.
20. Guger, C., Daban, S., Sellers, E., Holzner, C., Krausz, G., Carabalona, R., Gramatica, F., and Edlinger, G. (2009). How many people are able to control a P300-based brain-computer interface (BCI)? Neurosci. Lett. 462, 94-98.
21. Hamer, H. M., Morris, H. H., Mascha, E. J., Karafa, M. T., Bingaman, W. E., Bej, M. D., Burgess, R. C., Dinner, D. S., Foldvary, N. R., Hahn, J. F., Kotagal, P., Najm, I., Wyllie, E., and Lüders, H. O. (2002). Complications of invasive video-EEG monitoring with subdural grid electrodes. Neurology 58, 97-103.
22. Higson, G. R. (2002). Medical Device Safety: The Regulation of Medical Devices for Public Health and Safety, 1st Edn. London: Taylor & Francis.
23. Hill, N. J., Lal, T. N., Schröder, M., Hinterberger, T., Wilhelm, B., Nijboer, F., Mochty, U., Widman, G., Elger, C., Schölkopf, B., Kübler, A., and Birbaumer, N. (2006). Classifying EEG and ECoG signals without subject training for fast BCI implementation: comparison of nonparalyzed and completely paralyzed subjects. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 183-186.
24. Hubel, D. H., and Wiesel, T. N. (1959). Receptive fields of single neurones in the cat's striate cortex. J. Physiol. 148, 574-591.
25. Hubel, D. H., and Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160, 106-154.
26. Jennrich, R. I. (1977). Stepwise Regression. New York: John Wiley and Sons, 58-75.
27. Krusienski, D. J., Sellers, E. W., Cabestaing, F., Bayoudh, S., McFarland, D. J., Vaughan, T. M., and Wolpaw, J. R. (2006). A comparison of classification techniques for the P300 Speller. J. Neural Eng. 3, 299-305.
28. Kübler, A., and Birbaumer, N. (2008). Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clin. Neurophysiol. 119, 2658-2666.
29. Lenhardt, A., Kaper, M., and Ritter, H. J. (2008). An adaptive P300-based online brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 16, 121-130.
30. Leuthardt, E. C., Miller, K. J., Schalk, G., Rao, R. P., and Ojemann, J. G. (2006). Electrocorticography-based brain computer interface-the Seattle experience. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 194-198.
31. Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., and Moran, D. W. (2004). A brain-computer interface using electrocorticographic signals in humans. J. Neural Eng. 1, 63-71.
32. Majaranta, P., and Räihä, K. J. (2002). "Twenty years of eye typing: systems and design issues," in ETRA '02: Proceedings of the (2002). Symposium on Eye Tracking Research and Applications (New York, NY: ACM), 15-22.
33. Makeig, S., Westerfield, M., Jung, T. P., Enghoff, S., Townsend, J., Courchesne, E., and Sejnowski, T. J. (2002). Dynamic brain sources of visual evoked responses. Science 295, 690-694.
34. Martens, S. M., Hill, N. J., Farquhar, J., and Schölkopf, B. (2009). Overlap and refractory effects in a brain-computer interface speller based on the visual P300 event-related potential. J. Neural Eng. 6, 026003-026003.
35. McFarland, D. J., Sarnacki, W. A., and Wolpaw, J. R. (2003). Brain-computer interface (BCI) operation: optimizing information transfer rates. Biol. Psychol. 63, 237-251.
36. Mellinger, J., and Schalk, G. (2007). "BCI2000: A general-purpose software platform for BCI," in Toward Brain-Computer Interfacing, eds G. Dornhege, J. del R. Millan, T. Hinterberger, D. McFarland, and K. Müller (Cambridge: MIT Press), 359-367.
37. Middendorf, M., McMillan, G., Calhoun, G., and Jones, K. S. (2000). Brain-computer interfaces based on the steady-state visual-evoked response. IEEE Trans. Rehabil. Eng. 8, 211-214.
38. Miller, K. J., Leuthardt, E. C., Schalk, G., Rao, R. P., Anderson, N. R., Moran, D. W., Miller, J. W., and Ojemann, J. G. (2007). Spectral changes in cortical surface potentials during motor movement. J. Neurosci. 27, 2424-2432.
39. Miller, K. J., Schalk, G., Fetz, E. E., den Nijs, M., Ojemann, J. G., and Rao, R. P. (2010). Cortical activity during motor execution, motor imagery, and image-ry-based online feedback. Proc. Natl. Acad. Sci. U.S.A. 107, 4430-4435.
40. Miller, K. J., Shenoy, P., den Nijs, M., Sorensen, L. B., Rao, R. N., and Ojemann, J. G. (2008). Beyond the gamma band: the role of high-frequency features in movement classification. IEEE Trans. Biomed. Eng. 55, 1634-1637.
41. Müller, K. R., Tangermann, M., Dornhege, G., Krauledat, M., Curio, G., and Blankertz, B. (2008). Machine learning for real-time single-trial EEG-analysis: from brain-computer interfacing to mental state monitoring. J. Neurosci. Methods 167, 82-90.
42. Nijboer, F., Sellers, E. W., Mellinger, J., Jordan, M. A., Matuz, T., Furdea, A., Halder, S., Mochty, U., Krusienski, D. J., Vaughan, T. M., Wolpaw, J. R., Birbaumer, N., and Kübler, A. (2008). A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin. Neurophysiol. 119, 1909-1916.
43. Palmowski, A., Jost, W. H., Prudlo, J., Osterhage, J., Käsmann, B., Schimrigk, K., and Ruprecht, K. W. (1995). Eye movement in amyotrophic lateral sclerosis: a longitudinal study. Ger. J. Ophthalmol. 4, 355-362.
44. Pfurtscheller, G., Neuper, C., Müller, G. R., Obermaier, B., Krausz, G., Schlögl, A., Scherer, R., Graimann, B., Keinrath, C., Skliris, D., Wörtz, M., Supp, G., and Schrank, C. (2003). Graz-BCI: state of the art and clinical applications. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 177-180.
45. Raab, G. G., and Parr, D. H. (2006). From medical invention to clinical practice: the reimbursement challenge facing new device procedures and technology- part 2: coverage. J. Am. Coll. Radiol. 3, 772-777.
46. Reitan, R. M. (1958). Validity of the trail making test as an indicator of organic brain damage. Percept. Mot. Skills 8, 271-276.
47. Ritaccio, A. L., Brunner, P., Cervenka, M. C., Crone, N., Guger, C., Leuthardt, E. C., Oostenveld, R., Stacey, G., and Schalk, G. (2010). Proceedings of the first international workshop on advances in electrocorticography. Epilepsy Behav. 19, 204-215.
48. Schalk, G. (2008). Brain-computer symbiosis. J. Neural Eng. 5, 1-15.
49. Schalk, G. (2010). Can Electrocorticography (ECoG) support robust and powerful brain-computer interfaces? Front. Neuroeng. 3:9. doi: 10.3389/ fneng.2010.00009
50. Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., and Wolpaw, J. R. (2004). BCI2000: a general-purpose brain-computer interface (BCI) sys-tem. IEEE Trans. Biomed. Eng. 51, 1034-1043.
51. Schalk, G., and Mellinger, J. (2010). A Practical Guide to Brain-Computer Interfacing with BCI2000, 1st Edn. London: Springer.
52. Schalk, G., Miller, K. J., Anderson, N. R., Wilson, J. A., Smyth, M. D., Ojemann, J. G., Moran, D. W., Wolpaw, J. R., and Leuthardt, E. C. (2008). Twodimensional movement control using electrocorticographic signals in humans. J. Neural Eng. 5, 75-84.
53. Sellers, E. W., Krusienski, D. J., McFarland, D. J., Vaughan, T. M., and Wolpaw, J. R. (2006). A P300 event-related potential brain-computer interface (BCI): the effects of matrix size and inter stimulus interval on performance. Biol. Psychol. 73, 242-252.
54. Sellers, E. W., Kübler, A., and Donchin, E. (2006). Brain-computer interface research at the University of South Florida Cognitive Psychophysiology Laboratory: the P300 Speller. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 221-224.
55. Sellers, E. W., Vaughan, T. M., and Wolpaw, J. R. (2010). A brain-computer interface for long-term independent home use. Amyotroph Lateral Scler. 11, 449-455.
56. Serby, H., Yom-Tov, E., and Inbar, G. F. (2005). An improved P300-based brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 13, 89-98.
57. Sharbrough, F., Chatrian, G. E., Lesser, R. P., Luders, H., Nuwer, M., and Picton, T. W. (1991). American Electroencephalographic Society guidelines for standard electrode position nomenclature. Electroencephalogr. Clin. Neurophysiol. 8, 200-202.
58. Sherman, J. (1979). Visual evoked potential (VEP): basic concepts and clinical applications. J. Am. Optom. Assoc. 50, 19-30.
59. Talairach, J., and Tournoux, P. (1988). Co-Planar Sterotaxic Atlas of the Human Brain. New York: Thieme Medical Publishers, Inc.
60. Torres Valderrama, A., Oostenveld, R., Vansteensel, M. J., Huiskamp, G. M., and Ramsey, N. F. (2010). Gain of the human dura in vivo and its effects on invasive brain signal feature detection. J. Neurosci. Methods 187, 270-279.
61. Treder, M. S., and Blankertz, B. (2010). (C)overt attention and visual speller design in an ERP-based brain-computer interface. Behav. Brain Funct. 6, 28.
62. Van Gompel, J. J., Worrell, G. A., Bell, M. L., Patrick, T. A., Cascino, G. D., Raffel, C., Marsh, W. R., and Meyer, F. B. (2008). Intracranial electroencephalography with subdural grid electrodes: techniques, complications, and outcomes. Neurosurgery 63, 498-505.
63. Vansteensel, M. J., Hermes, D., Aarnoutse, E. J., Bleichner, M. G., Schalk, G., van Rijen, P. C., Leijten, F. S., and Ramsey, N. F. (2010). Brain-computer interfacing based on cognitive control. Ann. Neurol. 67, 809-816.
64. Vaughan, T. M., McFarland, D. J., Schalk, G., Sarnacki, W. A., Krusienski, D. J., Sellers, E. W., and Wolpaw, J. R. (2006). The Wadsworth BCI Research and Development Program: at home with BCI. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 229-233.
65. Wechsler, D. (1997). Weschsler Adult Intelligence Scale-III. Antonio, TX: The Psychological Corporation.
66. Wilson, J. A., Felton, E. A., Garell, P. C., Schalk, G., and Williams, J. C. (2006). ECoG factors underlying multimodal control of a brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 246-250.
67. Wolpaw, J. R., McFarland, D. J., Neat, G. W., and Forneris, C. A. (1991). An EEG-based brain-computer interface for cursor control. Electroencephalogr. Clin. Neurophysiol. 78, 252-259.
68. Wong, C. H., Birkett, J., Byth, K., Dexter, M., Somerville, E., Gill, D., Chaseling, R., Fearnside, M., and Bleasel, A. (2009). Risk factors for complications during intracranial electrode recording in presurgical evaluation of drug resistant partial epilepsy. Acta Neurochir. (Wien) 151, 37-50.
69. Yoshor, D., Bosking, W. H., Ghose, G. M., and Maunsell, J. H. (2007). Receptive fields in human visual cortex mapped with surface electrodes. Cereb. Cortex 17, 2293-2302.
70. Zeki, S., Watson, J. D., Lueck, C. J., Friston, K. J., Kennard, C., and Frackowiak, R. S. (1991). A direct demonstration of functional specialization in human visual cortex. J. Neurosci. 11, 641-649.