Toward a minimally invasive brain-computer interface using a single subdural channel: A visual speller study

NeuroImage

Volumn 71, Issue , 2013, Pages 30-41

  Zhang, Dan ^a   Song, Huaying ^a   Xu, Rui ^a   Zhou, Wenjing ^a   Ling, Zhipei ^b   Hong, Bo ^a  

^a Tsinghua University   (China)

^b CHINESE PLA GENERAL HOSPITAL   (China)

Author keywords

Brain computer interface; Electrocorticography; High gamma; Minimal invasive; Visual motion processing

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; BOLD SIGNAL; BRAIN COMPUTER INTERFACE; BRAIN REGION; CHILD; CLINICAL ARTICLE; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; DISEASE CLASSIFICATION; ELECTROCORTICOGRAPHY; ELECTRODE; EPILEPSY; EVENT RELATED POTENTIAL; EVOKED VISUAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GAMMA RADIATION; HUMAN; HUMAN TISSUE; INTERMETHOD COMPARISON; MALE; MINIMALLY INVASIVE PROCEDURE; OCCIPITAL LOBE; PARIETAL LOBE; PREOPERATIVE PERIOD; PRIORITY JOURNAL; SCHOOL CHILD; SYNAPSE; SYNAPTIC TRANSMISSION; TEMPORAL LOBE; VISUAL MOTION RESPONSE; VISUAL STIMULATION;

ADOLESCENT; BRAIN-COMPUTER INTERFACES; CHILD; ELECTRODES, IMPLANTED; EPILEPSY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MOTION PERCEPTION; YOUNG ADULT;

EID: 84873841662     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.12.069     Document Type: Article

References (81)

1. Blankertz B., Lemm S., Treder M., Haufe S., Muller K.R. Single-trial analysis and classification of ERP components-a tutorial. Neuroimage 2011, 56:814-825.
2. Brainard D.H. The Psychophysics Toolbox. Spat. Vis. 1997, 10:433-436.
3. Brunner P., Joshi S., Briskin S., Wolpaw J.R., Bischof H., Schalk G. Does the 'P300' speller depend on eye gaze?. J. Neural Eng. 2010, 7:56013.
4. Brunner P., Ritaccio A.L., Emrich J.F., Bischof H., Schalk G. Rapid Communication with a "P300" Matrix Speller Using Electrocorticographic Signals (ECoG). Front. Neurosci. 2011, 5:5.
5. Bullock T.H., McClune M.C., Achimowicz J.Z., Iragui-Madoz V.J., Duckrow R.B., Spencer S.S. EEG coherence has structure in the millimeter domain: subdural and hippocampal recordings from epileptic patients. Electroencephalogr. Clin. Neurophysiol. 1995, 95:161-177.
6. Chang C., Lin C. LIBSVM: a library for support vector machines Software available at. http://www.csie.ntu.edu.tw/~cjlin/libsvm/.
7. Chang E.F., Rieger J.W., Johnson K., Berger M.S., Barbaro N.M., Knight R.T. Categorical speech representation in human superior temporal gyrus. Nat. Neurosci. 2010, 13:1428-1432.
8. Chang E.F., Edwards E., Nagarajan S.S., Fogelson N., Dalal S.S., Canolty R.T., Kirsch H.E., Barbaro N.M., Knight R.T. Cortical spatio-temporal dynamics underlying phonological target detection in humans. J. Cogn. Neurosci. 2011, 23:1437-1446.
9. Chao Z.C., Nagasaka Y., Fujii N. Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys. Front. Neuroeng. 2010, 3:3.
10. Corbetta M., Shulman G.L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 2002, 3:201-215.
11. Crone N.E., Miglioretti D.L., Gordon B., Lesser R.P. Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. Brain 1998, 121(Pt 12):2301-2315.
12. Crone N.E., Miglioretti D.L., Gordon B., Sieracki J.M., Wilson M.T., Uematsu S., Lesser R.P. Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. Brain 1998, 121(Pt 12):2271-2299.
13. Crone N.E., Sinai A., Korzeniewska A. High-frequency gamma oscillations and human brain mapping with electrocorticography. Prog. Brain Res. 2006, 159:275-295.
14. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 1999, 9:179-194.
15. Daly J.J., Wolpaw J.R. Brain-computer interfaces in neurological rehabilitation. Lancet Neurol. 2008, 7:1032-1043.
16. Desikan R.S., Ségonne F., Fischl B., Quinn B.T., Dickerson B.C., Blacker D., Buckner R.L., Dale A.M., Maguire R.P., Hyman B.T., Albert M.S., Killiany R.J. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 2006, 31:968-980.
17. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 1995, 18:193-222.
18. DeYoe E.A., Carman G.J., Bandettini P., Glickman S., Wieser J., Cox R., Miller D., Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. Proc. Natl. Acad. Sci. U.S.A. 1996, 93:2382-2386.
19. Donchin E., Spencer K.M., Wijesinghe R. The mental prosthesis: assessing the speed of a P300-based brain-computer interface. IEEE Trans. Rehabil. Eng. 2000, 8:174-179.
20. Engel A.K., Fries P., Singer W. Dynamic predictions: oscillations and synchrony in top-down processing. Nat. Rev. Neurosci. 2001, 2:704-716.
21. Farwell L.A., Donchin E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 1988, 70:510-523.
22. Fischl B., Sereno M.I., Dale A.M. Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 1999, 9:195-207.
23. Gaona C.M., Sharma M., Freudenburg Z.V., Breshears J.D., Bundy D.T., Roland J., Barbour D.L., Schalk G., Leuthardt E.C. Nonuniform high-gamma (60-500Hz) power changes dissociate cognitive task and anatomy in human cortex. J. Neurosci. 2011, 31:2091-2100.
24. Gasser T., Bacher P., Mocks J. Transformations towards the normal distribution of broad band spectral parameters of the EEG. Electroencephalogr. Clin. Neurophysiol. 1982, 53:119-124.
25. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
26. Guo F., Hong B., Gao X., Gao S. A brain-computer interface using motion-onset visual evoked potential. J. Neural Eng. 2008, 5:477-485.
27. Guthrie D., Buchwald J.S. Significance testing of difference potentials. Psychophysiology 1991, 28:240-244.
28. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
29. Heeger D.J., Ress D. What does fMRI tell us about neuronal activity?. Nat. Rev. Neurosci. 2002, 3:142-151.
30. Heeger D.J., Boynton G.M., Demb J.B., Seidemann E., Newsome W.T. Motion opponency in visual cortex. J. Neurosci. 1999, 19:7162-7174.
31. Helfrich R.F., Becker H.G., Haarmeier T. Processing of coherent visual motion in topographically organized visual areas in human cerebral cortex. Brain Topogr. 2012, 10.1007/s10548-012-0226-1.
32. Hermes D., Miller K.J., Vansteensel M.J., Aarnoutse E.J., Leijten F.S., Ramsey N.F. Neurophysiologic correlates of fMRI in human motor cortex. Hum. Brain Mapp. 2012, 33:1689-1699.
33. Hollants-Gilhuijs M.A., Ruijter J.M., Spekreijse H. Visual half-field development in children: detection of motion-defined forms. Vision Res. 1998, 38:651-657.
34. Hollants-Gilhuijs M.A., De Munck J.C., Kubova Z., van Royen E., Spekreijse H. The development of hemispheric asymmetry in human motion VEPs. Vision Res. 2000, 40:1-11.
35. Hong B., Guo F., Liu T., Gao X., Gao S. N200-speller using motion-onset visual response. Clin. Neurophysiol. 2009, 120:1658-1666.
36. Huettel S.A., McKeown M.J., Song A.W., Hart S., Spencer D.D., Allison T., McCarthy G. Linking hemodynamic and electrophysiological measures of brain activity: evidence from functional MRI and intracranial field potentials. Cereb. Cortex 2004, 14:165-173.
37. Huk A.C., Dougherty R.F., Heeger D.J. Retinotopy and functional subdivision of human areas MT and MST. J. Neurosci. 2002, 22:7195-7205.
38. Jensen O., Kaiser J., Lachaux J.P. Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci. 2007, 30:317-324.
39. Jin J., Allison B.Z., Wang X., Neuper C. A combined brain-computer interface based on P300 potentials and motion-onset visual evoked potentials. J. Neurosci. Methods 2012, 205:265-276.
40. Johansson B.B. Current trends in stroke rehabilitation. A review with focus on brain plasticity. Acta Neurol. Scand. 2011, 123:147-159.
41. Kiss I., Dashieff R.M., Lordeon P. A parieto-occipital generator for P300: evidence from human intracranial recordings. Int. J. Neurosci. 1989, 49:133-139.
42. Kuba M., Kubova Z. Visual evoked potentials specific for motion onset. Doc. Ophthalmol. 1992, 80:83-89.
43. Kuba M., Kubova Z., Kremlacek J., Langrova J. Motion-onset VEPs: characteristics, methods, and diagnostic use. Vision Res. 2007, 47:189-202.
44. Kubanek J., Miller K.J., Ojemann J.G., Wolpaw J.R., Schalk G. Decoding flexion of individual fingers using electrocorticographic signals in humans. J. Neural Eng. 2009, 6:66001.
45. Kubova Z., Kuba M., Peregrin J., Novakova V. Visual evoked potential evidence for magnocellular system deficit in dyslexia. Physiol. Res. 1996, 45:87-89.
46. Lebedev M.A., Nicolelis M.A. Brain-machine interfaces: past, present and future. Trends Neurosci. 2006, 29:536-546.
47. Leuthardt E.C., Schalk G., Wolpaw J.R., Ojemann J.G., Moran D.W. A brain-computer interface using electrocorticographic signals in humans. J. Neural Eng. 2004, 1:63-71.
48. Leuthardt E.C., Freudenberg Z., Bundy D., Roland J. Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces. Neurosurg. Focus 2009, 27:E10.
49. Leuthardt E.C., Gaona C., Sharma M., Szrama N., Roland J., Freudenberg Z., Solis J., Breshears J., Schalk G. Using the electrocorticographic speech network to control a brain-computer interface in humans. J. Neural Eng. 2011, 8:36004.
50. Lippert M.T., Steudel T., Ohl F., Logothetis N.K., Kayser C. Coupling of neural activity and fMRI-BOLD in the motion area MT. Magn. Reson. Imaging 2010, 28:1087-1094.
51. Liu H., Agam Y., Madsen J.R., Kreiman G. Timing, timing, timing: fast decoding of object information from intracranial field potentials in human visual cortex. Neuron 2009, 62:281-290.
52. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
53. Matsumoto R., Ikeda A., Nagamine T., Matsuhashi M., Ohara S., Yamamoto J., Toma K., Mikuni N., Takahashi J., Miyamoto S., Fukuyama H., Shibasaki H. Subregions of human MT complex revealed by comparative MEG and direct electrocorticographic recordings. Clin. Neurophysiol. 2004, 115:2056-2065.
54. Mesgarani N., Chang E.F. Selective cortical representation of attended speaker in multi-talker speech perception. Nature 2012, 485:233-236.
55. Miller K.J., Schalk G., Fetz E.E., Den Nijs M., Ojemann J.G., Rao R.P. Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc. Natl. Acad. Sci. U.S.A. 2010, 107:4430-4435.
56. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., Malach R. Coupling between neuronal firing, field potentials, and FMRI in human auditory cortex. Science 2005, 309:951-954.
57. Murphy T.H., Corbett D. Plasticity during stroke recovery: from synapse to behaviour. Nat. Rev. Neurosci. 2009, 10:861-872.
58. Niessing J., Ebisch B., Schmidt K.E., Niessing M., Singer W., Galuske R.A. Hemodynamic signals correlate tightly with synchronized gamma oscillations. Science 2005, 309:948-951.
59. Nunez P.L., Srinivasan R. Electric fields of the brain: the neurophysics of EEG 2006, Oxford University Press, USA.
60. Pasley B.N., David S.V., Mesgarani N., Flinker A., Shamma S.A., Crone N.E., Knight R.T., Chang E.F. Reconstructing speech from human auditory cortex. PLoS Biol. 2012, 10:e1001251.
61. Pei X., Barbour D.L., Leuthardt E.C., Schalk G. Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. J. Neural Eng. 2011, 8:46028.
62. Pei X., Leuthardt E.C., Gaona C.M., Brunner P., Wolpaw J.R., Schalk G. Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition. Neuroimage 2011, 54:2960-2972.
63. Rauschecker A.M., Dastjerdi M., Weiner K.S., Witthoft N., Chen J., Selimbeyoglu A., Parvizi J. Illusions of visual motion elicited by electrical stimulation of human MT complex. PLoS One 2011, 6:e21798.
64. Rees G., Friston K., Koch C. A direct quantitative relationship between the functional properties of human and macaque V5. Nat. Neurosci. 2000, 3:716-723.
65. Schaeff S., Treder M.S., Venthur B., Blankertz B. Exploring motion VEPs for gaze-independent communication. J. Neural Eng. 2012, 9:45006.
66. Schalk G., Leuthardt E.C. Brain-computer interfaces using electrocorticographic signals. IEEE Rev. Biomed. Eng. 2011, 4:140-154.
67. Schoenfeld M.A., Hopf J.M., Martinez A., Mai H.M., Sattler C., Gasde A., Heinze H.J., Hillyard S.A. Spatio-temporal analysis of feature-based attention. Cereb. Cortex 2007, 17:2468-2477.
68. Sheikh H., McFarland D.J., Sarnacki W.A., Wolpaw J.R. Electroencephalographic (EEG)-based communication: EEG control versus system performance in humans. Neurosci. Lett. 2003, 345:89-92.
69. Sperling M.R. Clinical challenges in invasive monitoring in epilepsy surgery. Epilepsia 1997, 38(Suppl. 4):S6-S12.
70. Spiridon M., Kanwisher N. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 2002, 35:1157-1165.
71. Tootell R.B., Reppas J.B., Kwong K.K., Malach R., Born R.T., Brady T.J., Rosen B.R., Belliveau J.W. Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J. Neurosci. 1995, 15:3215-3230.
72. Townsend G., LaPallo B.K., Boulay C.B., Krusienski D.J., Frye G.E., Hauser C.K., Schwartz N.E., Vaughan T.M., Wolpaw J.R., Sellers E.W. A novel P300-based brain-computer interface stimulus presentation paradigm: moving beyond rows and columns. Clin. Neurophysiol. 2010, 121:1109-1120.
73. Vidal J.R., Freyermuth S., Jerbi K., Hamame C.M., Ossandon T., Bertrand O., Minotti L., Kahane P., Berthoz A., Lachaux J.P. Long-distance amplitude correlations in the high gamma band reveal segregation and integration within the reading network. J. Neurosci. 2012, 32:6421-6434.
74. Vinjamuri R., Weber D.J., Mao Z.H., Collinger J.L., Degenhart A.D., Kelly J.W., Boninger M.L., Tyler-Kabara E.C., Wang W. Toward synergy-based brain-machine interfaces. IEEE Trans. Inf. Technol. Biomed. 2011, 15:726-736.
75. Wells W.R., Viola P., Atsumi H., Nakajima S., Kikinis R. Multi-modal volume registration by maximization of mutual information. Med. Image Anal. 1996, 1:35-51.
76. Wilson J.A., Felton E.A., Garell P.C., Schalk G., Williams J.C. ECoG factors underlying multimodal control of a brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 2006, 14:246-250.
77. Wolpaw J.R., Birbaumer N., Heetderks W.J., McFarland D.J., Peckham P.H., Schalk G., Donchin E., Quatrano L.A., Robinson C.J., Vaughan T.M. Brain-computer interface technology: a review of the first international meeting. IEEE Trans. Rehabil. Eng. 2000, 8:164-173.
78. Wonnacott T.H., Wonnacott R. Introductory Statistics 1977, John Wiley and Sons, New York. 3rd edition.
79. Wu T., Lin C. Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. 2004, 16:529-536.
80. Zeki S., Watson J.D., Lueck C.J., Friston K.J., Kennard C., Frackowiak R.S. A direct demonstration of functional specialization in human visual cortex. J. Neurosci. 1991, 11:641-649.
81. Zhang D., Song H., Xu H., Wu W., Gao S., Hong B. An N200 speller integrating the spatial profile for the detection of the non-control state. J. Neural Eng. 2012, 9:26016.