Identifying the attended speaker using electrocorticographic (ECoG) signals

Brain-Computer Interfaces

Volumn 2, Issue 4, 2015, Pages 161-173

  Dijkstra, K V ^a,b,c   Brunner, P ^a,b   Gunduz, A ^a,d   Coon, W ^a,e   Ritaccio, A L ^b   Farquhar, J ^c   Schalk, G ^a,b,e  

^a WADSWORTH CENTER   (United States)

^b ALBANY MEDICAL COLLEGE   (United States)

^c RADBOUD UNIVERSITY   (Netherlands)

^d J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

^e STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

auditory attention; brain computer interface (BCI); cocktail party; electrocorticography (ECoG)

Indexed keywords

DISEASE CONTROL; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; MAPPING; NEURODEGENERATIVE DISEASES; SPEECH COMMUNICATION; SPEECH RECOGNITION;

AMYOTROPHIC LATERAL SCLEROSIS; ASSISTIVE COMMUNICATION DEVICES; AUDITORY ATTENTION; BRAIN COMPUTER INTERFACES (BCIS); COCKTAIL PARTY; ELECTROCORTICOGRAPHY (ECOG); REAL TIME PERFORMANCE; SUPERIOR TEMPORAL GYRUS;

BRAIN COMPUTER INTERFACE;

EID: 85006451037     PISSN: 2326263X     EISSN: 23262621     Source Type: Journal    
DOI: 10.1080/2326263X.2015.1063363     Document Type: Article

References (52)

1. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clin Neurophysiol. 2002;113(6):767–791.
2. Brunner P, Joshi S, Briskin S, Wolpaw JR, Bischof H, Schalk G. Does the ‘P300’ speller depend on eye gaze? J Neural Eng. 2010;7(5):056013.
3. Treder MS, Blankertz B. (C)overt attention and visual speller design in an ERP-based brain-computer interface. Behav Brain Funct. 2010;6(1):28.
4. Belitski A, Farquhar J, Desain P. P300 audio-visual speller. J Neural Eng. 2011;8(2):025022.
5. Furdea A, Halder S, Krusienski DJ, Bross D, Nijboer F, Birbaumer N, Kübler A. An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology. 2009;46(3):617–625.
6. Klobassa DS, Vaughan TM, Brunner P, Schwartz NE, Wolpaw JR, Neuper C, Sellers EW. Toward a high-throughput auditory P300-based brain-computer interface. Clin Neurophysiol. 2009;120(7):1252–1261.
7. Halder S, Rea M, Andreoni R, Nijboer F, Hammer EM, Kleih SC, Birbaumer N, Kübler A. An auditory oddball brain-computer interface for binary choices. Clin Neurophysiol. 2010;121(4):516–523.
8. Schreuder M, Blankertz B, Tangermann M., A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative cue. PLoS One. 2010;5(4).
9. Brouwer AM, van Erp JB. A tactile P300 brain-computer interface. Front Neurosci. 2010;4:19.
10. van der Waal M, Severens M, Geuze J, Desain P. Introducing the tactile speller: an ERP-based brain-computer interface for communication. J Neural Eng. 2012;9(4):045002.
11. Riccio A, Mattia D, Simione L, Olivetti M, Cincotti F. Eye-gaze independent EEG-based brain-computer interfaces for communication. J Neural Eng. 2012;9(4):045001.
12. Lopez-Gordo MA, Fernandez E, Romero S, Pelayo F, Prieto A. An auditory brain–computer interface evoked by natural speech. J Neural Eng. 2012;9(3):036013.
13. Shannon RV, Zeng FG, Kamath V, Wygonski J, Ekelid M. Speech recognition with primarily temporal cues. Science. 1995;270(5234):303–304.
14. Ray S, Crone NE, Niebur E, Franaszczuk PJ, Hsiao SS. Neural correlates of high-gamma oscillations (60–200 Hz) in macaque local field potentials and their potential implications in electrocorticography. J Neurosci. 2008;28(45):11526–11536.
15. Ball T, Kern M, Mutschler I, Aertsen A, Schulze-Bonhage A. Signal quality of simultaneously recorded invasive and non-invasive EEG. NeuroImage. 2009;46(3):708–716.
16. Martin S, Brunner P, Holdgraf C, Heinze HJ, Crone NE, Rieger J, Schalk G, Knight RT, Pasley B. Decoding spectrotemporal features of overt and covert speech from the human cortex. Front Neuroeng. 2014;7(14).
17. Potes C, Gunduz A, Brunner P, Schalk G. Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening. NeuroImage. 2012;61(4):841–848.
18. Potes C, Brunner P, Gunduz A, Knight RT, Schalk G. Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing. NeuroImage. 2014;97:188–195.
19. Pasley BN, David SV, Mesgarani N, Flinker A, Shamma SA, Crone NE, Knight RT, Chang EF. Reconstructing speech from human auditory cortex. PLoS Biology. 2012;10(1):e1001251.
20. Kubanek J, Brunner P, Gunduz A, Poeppel D, Schalk G. The tracking of speech envelope in the human cortex. PloS One. 2013;8(1):e53398
21. Zion Golumbic EM, Ding N, Bickel S, Lakatos P, Schevon CA, McKhann GM, Goodman RR, Emerson R, Mehta AD, Simon JZ, Poeppel D, Schroeder CE. Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”. Neuron. 2013;77(5):980–991.
22. Mesgarani N, Chang EF. Selective cortical representation of attended speaker in multi-talker speech perception. Nature. 2012;485(7397):233–236.
23. Kerlin JR, Shahin AJ, Miller LM. Attentional gain control of ongoing cortical speech representations in a “Cocktail party”. J Neurosci. 2010;30(2):620–628.
24. Horton C, Srinivasan R, D’Zmura M. Envelope responses in single-trial EEG indicate attended speaker in a cocktail party. J Neural Eng. 2014;11(4):046015.
25. Talairach J, Tournoux P. Co-planar stereotaxic atlas of the human brain. New York, NY: Thieme; 1988.
26. Wechsler D. Weschsler Adult Intelligence Scale-III. San Antonio, TX: The Psychological Corporation; 1997.
27. Wada J, Rasmussen T. Intracarotid injection of sodium amytal for the lateralization of cerebral speech dominance. J Neurosurg. 1960;17:266–282.
28. Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans Biomed Eng. 2004;51(6):1034–1043.
29. Mellinger J, Schalk G., BCI2000: A general-purpose software platform for BCI. In: Dornhege G, del R Millan J, Hinterberger T, McFarland D, Müller K, editors. Toward brain-computer interfacing. Cambridge, MA: MIT Press; 2007. p. 359–367.
30. Schalk G, Mellinger J. A practical guide to brain-computer interfacing with BCI2000. 1st ed. London: Springer; 2010.
31. Miller KJ, Sorensen LB, Ojemann JG, den Nijs M. Power-law scaling in the brain surface electric potential. PLoS Comput Biol. 2009;5(12):e1000609.
32. Zion Golumbic EM. Poeppel D, Schroeder CE. Temporal context in speech processing and attentional stream selection: a behavioral and neural perspective. Brain Lang. 2012;122(3):151–161.
33. Wolpaw JR, Ramoser H, McFarland DJ, Pfurtscheller G. EEG-based communication: Improved accuracy by response verification. IEEE Trans Rehab Engin. 1998;6:326–333.
34. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Series B Stat Methodol. 1995;57(1):289–300.
35. Wilson SM, Iacoboni M. Neural responses to non-native phonemes varying in producibility: Evidence for the sensorimotor nature of speech perception. NeuroImage. 2006;33(1):316–325.
36. Kübler A, Kotchoubey B, Kaiser J, Wolpaw JR, Birbaumer N. Brain-computer communication: unlocking the locked in. Psychol Bull. 2001;127(3):358–375.
37. Leuthardt EC, Freudenberg Z, Bundy D, Roland J., Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces. Neurosurg Focus. 2009;27(1):E10.
38. Davson H. Review lecture. The blood-brain barrier. J Physiol. 1976;255(1):1–28.
39. Hamer HM, Morris HH, Mascha EJ, Karafa MT, Bingaman WE, Bej MD, Burgess RC, Dinner DS, Foldvary NR, Hahn JF, Kotagal P, Najm I, Wyllie E, Lüders HO. Complications of invasive video-EEG monitoring with subdural grid electrodes. Neurology. 2002;58(1):97–103.
40. Fountas KN, Smith JR. Subdural electrode-associated complications: a 20-year experience. Stereotact Funct Neurosurg. 2007;85(6):264–272.
41. Van Gompel JJ, Worrell GA, Bell ML, Patrick TA, Cascino GD, Raffel C, Marsh WR, Meyer FB. Intracranial electroencephalography with subdural grid electrodes: techniques, complications, and outcomes. Neurosurgery. 2008;63(3):498–505.
42. Wong CH, Birkett J, Byth K, Dexter M, Somerville E, Gill D, Chaseling R, Fearnside M, Bleasel A. Risk factors for complications during intracranial electrode recording in presurgical evaluation of drug resistant partial epilepsy. Acta Neurochir (Wien). 2009;151(1):37–50.
43. Torres Valderrama A, Oostenveld R, Vansteensel MJ, Huiskamp GM, Ramsey NF. Gain of the human dura in vivo and its effects on invasive brain signal feature detection. J Neurosci Methods. 2010; 187(2):270–279.
44. Bundy DT, Zellmer E, Gaona CM, Sharma M, Szrama N, Hacker C, Freudenburg ZV, Daitch A, Moran DW, Leuthardt EC. Characterization of the effects of the human dura on macro and microelectrocorticographic recordings. J Neural Eng. 2014;11(1):016006.
45. Sillay KA, Rutecki P, Cicora K, Worrell G, Drazkowski J, Shih JJ, Sharan AD, Morrell MJ, Williams J, Wingeier B. Long-term measurement of impedance in chronically implanted depth and subdural electrodes during responsive neurostimulation in humans. Brain Stimul. 2013;6(5):718–726.
46. Stieglitz T., Miniaturized neural interfaces and implants in neurological rehabilitation. In: Jensen W, Andersen OKs, Akay M, editors. Replace, repair, restore, relieve bridging clinical and engineering solutions in neurorehabilitation. Vol. 7 of Biosystems & Biorobotics. New York: Springer; 2014. p. 9–14.
47. Owen AM, Coleman MR, Boly M, Davis MH, Laureys S, Pickard JD. Detecting awareness in the vegetative state. Science. 2006;313(5792):1402.
48. Hill NJ, Scholkopf B. An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli. J Neural Eng. 2012;9(2):026011.
49. Picton TW, Hillyard SA, Krausz HI, Galambos R., Human auditory evoked potentials. I: Evaluation of components. Electroen Clin Neuro. 1974;36:179–190.
50. McFarland DJ, McCane LM, Wolpaw JR. EEG-based communication and control: short-term role of feedback. IEEE Trans Rehabil Eng. 1998;6(1):7–11.
51. Miller KJ, Schalk G, Fetz EE, den Nijs M, Ojemann JG, Rao RP. Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc Natl Acad Sci U S A. 2010;107(9):4430–4435.
52. Allison BZ, Neuper C. Could anyone use a BCI? In: Tan DS, Nijholt A, editors. Brain-computer interfaces: applying our minds to human-computer interaction. London: Springer; 2010. p. 35–54.