Brain-computer interfaces for communication with nonresponsive patients

Annals of Neurology

Volumn 72, Issue 3, 2012, Pages 312-323

  Naci, Lorina ^a   Monti, Martin M ^b   Cruse, Damian ^a   Kübler, Andrea ^c   Sorger, Bettina ^d   Goebel, Rainer ^d   Kotchoubey, Boris ^e   Owen, Adrian M ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF WÜRZBURG   (Germany)

^d MAASTRICHT UNIVERSITY   (Netherlands)

^e UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN BLOOD FLOW; BRAIN COMPUTER INTERFACE; BRAIN INJURY; COGNITION; COMMUNICATION AID; DECISION MAKING; ELECTROCORTICOGRAPHY; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY; EXECUTIVE FUNCTION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HEMODYNAMICS; HUMAN; IMAGERY; LANGUAGE PROCESSING; NEAR INFRARED SPECTROSCOPY; NEUROFEEDBACK; NON INVASIVE PROCEDURE; OXYGENATION; PRIORITY JOURNAL; REVIEW; SENSORY STIMULATION; SIGNAL NOISE RATIO; UNCONSCIOUSNESS; VISUAL INFORMATION; WORKING MEMORY;

BRAIN; BRAIN-COMPUTER INTERFACES; CONSCIOUSNESS; ELECTRIC STIMULATION THERAPY; ELECTROENCEPHALOGRAPHY; HUMANS; NERVOUS SYSTEM DISEASES; NEUROIMAGING; USER-COMPUTER INTERFACE;

EID: 84867073729     PISSN: 03645134     EISSN: 15318249     Source Type: Journal    
DOI: 10.1002/ana.23656     Document Type: Review

References (98)

1. Lulé D, Zickler C, Häcker S, et al. Life can be worth living in locked-in syndrome. Prog Brain Res 2009; 177: 339-351.
2. Schnakers C, Majerus S, Goldman S, et al. Cognitive function in the locked-in syndrome. J Neurol 2008; 255: 323-330.
3. Pantke KH,. Locked-in: imprisoned in your own body. Pflege Aktuell 1998; 52: 240-244.
4. Tavalaro J, Tayson R,. Look up for yes. New York, NY: Kodansha International, 1997.
5. Kübler A, Kotchoubey B,. Brain-computer interfaces in the continuum of consciousness. Curr Opin Neurol 2007; 20: 643-649.
6. Bauer G, Gerstenbrand F, Rumpl E,. Varieties of the locked-in syndrome. J Neurol 1979; 221: 77-91.
7. Bruno M, Bernheim JL, Schnakers C, Laureys S,. Locked-in: don't judge a book by its cover. J Neurol Neurosurg Psychiatry 2008; 79: 2.
8. Kübler A, Birbaumer N,. Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clin Neurophysiol 2008; 119: 2658-2666.
9. Abe K, Fujimura H, Toyooka K, et al. Cognitive function in amyotrophic lateral sclerosis. J Neurol Sci 1997; 148: 95-100.
10. Abrahams S, Goldstein LH, Lloyd CM, et al. Cognitive deficits in non-demented amyotrophic lateral sclerosis patients: a neuropsychological investigation. J Neurol Sci 1995; 129 (suppl): 54-55.
11. Ludolph AC, Langen KJ, Regard M, et al. Frontal lobe function in amyotrophic lateral sclerosis: a neuropsychologic and positron emission tomography study. Acta Neurol Scand 1992; 85: 81-89.
12. The Multi-Society Task Force on PVS. Medical aspects of the persistent vegetative state. N Engl J Med 1994; 330: 1499-1508.
13. Laureys S, Owen AM, Schiff ND,. Brain function in coma, vegetative state, and related disorders. Lancet Neurol 2004; 3: 537-546.
14. Adams JH, Graham DI, Jennett B,. The neuropathology of the vegetative state after an acute brain insult. Brain 2000; 123: 1327-1338.
15. Laureys S, Celesia GG, Cohadon F, et al. Unresponsive wakefulness syndrome: a new name for the vegetative state or apallic syndrome. BMC Med 2010; 8: 68.
16. Giacino JT, Ashwal S, Childs N, et al. The minimally conscious state: definition and diagnostic criteria. Neurology 2002; 58: 349-353.
17. Owen AM, Coleman MR,. Using neuroimaging to detect awareness in disorders of consciousness. Funct Neurol 2008; 23: 189-194.
18. Monti MM, Coleman MR, Owen AM,. Neuroimaging and the vegetative state: resolving the behavioral assessment dilemma? Ann N Y Acad Sci 2009; 1157: 81-89.
19. Schnakers C, Vanhaudenhuyse A, Giacino J, et al. Diagnostic accuracy of the vegetative and minimally conscious state: clinical consensus versus standardized neurobehavioral assessment. BMC Neurol 2009; 9: 35.
20. Andrews K, Murphy L, Munday R, Littlewood C,. Misdiagnosis of the vegetative state: retrospective study in a rehabilitation unit. BMJ 1996; 313: 13-16.
21. Childs NL, Mercer WN, Childs HW,. Accuracy of diagnosis of persistent vegetative state. Neurology 1993; 43: 1465-1467.
22. Schnakers C, Majerus S, Laureys S,. Bispectral analysis of electroencephalogram signals during recovery from coma: preliminary findings. Neuropsychol Rehabil 2005; 15: 381-388.
23. Menon DK, Owen AM, Williams EJ, et al. Cortical processing in persistent vegetative state. Wolfson Brain Imaging Centre Team. Lancet 1998; 352: 200.
24. Kotchoubey B, Kaiser J, Bostanov V, et al. Recognition of affective prosody in brain-damaged patients and healthy controls: a neurophysiological study using EEG and whole-head MEG. Cogn Affect Behav Neurosci 2009; 9: 153-167.
25. Owen AM, Menon DK, Johnsrude IS, et al. Detecting residual cognitive function in persistent vegetative state. Neurocase 2002; 8: 394-403.
26. Coleman MR, Davis MH, Rodd JM, et al. Towards the routine use of brain imaging to aid the clinical diagnosis of disorders of consciousness. Brain 2009; 132: 2541-2552.
27. Fischer C, Dailler F, Morlet D,. Novelty P3 elicited by the subject's own name in comatose patients. Clin Neurophysiol 2008; 119: 2224-2230.
28. Coleman MR, Rodd JM, Davis MH, et al. Do vegetative patients retain aspects of language comprehension? Evidence from fMRI. Brain 2007; 130: 2494-2507.
29. Perrin F, Schnakers C, Schabus M, et al. Brain response to one's own name in vegetative state, minimally conscious state, and locked-in syndrome. Arch Neurol 2006; 63: 562-569.
30. Kotchoubey B, Lang S, Mezger G, et al. Information processing in severe disorders of consciousness: vegetative state and minimally conscious state. Clin Neurophysiol 2005; 116: 2441-2453.
31. Cruse D, Chennu S, Chatelle C, et al. Bedside detection of awareness in the vegetative state: a cohort study. Lancet 2011; 6736: 61224-61225.
32. Monti MM, Vanhaudenhuyse A, Coleman MR, et al. Willful modulation of brain activity in disorders of consciousness. N Engl J Med 2010; 362: 579-589.
33. Owen AM, Coleman MR, Boly M, et al. Detecting awareness in the vegetative state. Science 2006; 313: 1402.
34. van Gerven M, Farquhar J, Schaefer R, et al. The brain-computer interface cycle. J Neural Eng 2009; 6: 041001.
35. deCharms RC, Maeda F, Glover GH, et al. Control over brain activation and pain learned by using real-time functional MRI. Proc Natl Acad Sci U S A 2005; 102: 18626-18631.
36. Lee JH, Ryu J, Jolesz FA, et al. Brain-machine interface via real-time fMRI: preliminary study on thought-controlled robotic arm. Neurosci Lett 2009; 450: 1-6.
37. Sorger B, Dahmen B, Reithler J, et al. Another kind of "BOLD Response": answering multiple-choice questions via online decoded single-trial brain signals. Prog Brain Res 2009; 177: 275-292.
38. Nijboer F, Sellers EW, Mellinger J, et al. A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol 2008; 119: 1909-1916.
39. Sitaram R, Caria A, Veit R, et al. FMRI brain-computer interface: a tool for neuroscientific research and treatment. Comput Intell Neurosci 2007; 25487.
40. Yoo S-S, Fairneny T, Chen N-K, et al. Brain-computer interface using fMRI: spatial navigation by thoughts. Neuroreport 2004; 15: 1591-1595.
41. Gill-Thwaites H, Munday R,. The Sensory Modality Assessment and Rehabilitation Technique (SMART): a valid and reliable assessment for vegetative state and minimally conscious state patients. Brain Inj 2004; 18: 1255-1269.
42. Furdea A, Halder S, Krusienski DJ, et al. An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology 2009; 46: 617-625.
43. Klobassa DS, Vaughan TM, Brunner P, et al. Toward a high-throughput auditory P300-based brain-computer interface. Clin Neurophysiol 2009; 120: 1252-1261.
44. Schalk G, Miller KJ, Anderson NR, et al. Two-dimensional movement control using electrocorticographic signals in humans. J Neural Eng 2008; 5: 75-84.
45. Miller KJ, denNijs M, Shenoy P, et al. Real-time functional brain mapping using electrocorticography. Neuroimage 2007; 37: 504-507.
46. Ramsey NF, van de Heuvel MP, Kho KH, Leijten FSS,. Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex. IEEE Trans Neural Syst Rehabil Eng 2006; 14: 214-217.
47. Leuthardt EC, Schalk G, Wolpaw JR, et al. A brain-computer interface using electrocorticographic signals in humans. J Neural Eng 2004; 1: 63-71.
48. Guenther FH, Brumberg JS, Wright EJ, et al. A wireless brain-machine interface for real-time speech synthesis. PLoS One 2009; 4: e8218.
49. Ogawa S, Menon RS, Tank DW, et al. Functional brain mapping by blood oxygenation level-dependent contrast magnetic resonance imaging. A comparison of signal characteristics with a biophysical model. Biophys J 1993; 64: 803-812.
50. Kwong KK, Belliveau JW, Chesler DA, et al. Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proc Natl Acad Sci U S A 1992; 89: 5675-5679.
51. Boly M, Coleman MR, Davis MH, et al. When thoughts become action: an fMRI paradigm to study volitional brain activity in non-communicative brain injured patients. Neuroimage 2007; 36: 979-992.
52. Gsell W, De Sadeleer C, Marchalant Y, et al. The use of cerebral blood flow as an index of neuronal activity in functional neuroimaging: experimental and pathophysiological considerations. J Chem Neuroanat 2000; 20: 215-224.
53. Rossini PM, Altamura C, Ferretti A, et al. Does cerebrovascular disease affect the coupling between neuronal activity and local haemodynamics? Brain 2004; 127: 99-110.
54. Monti MM, Pickard JD, Owen AM,. Visual cognition in disorders of consciousness: from V1 to top-down attention. Hum Brain Mapp 2012. doi: 10.1002/hbm.21507. [Epub ahead of print].
55. Bardin JC, Fins JJ, Katz DI, et al. Dissociations between behavioural and functional magnetic resonance imaging-based evaluations of cognitive function after brain injury. Brain 2011; 134: 769-782.
56. Boly M,. Measuring the fading consciousness in the human brain. Curr Opin Neurol 2011; 24: 394-400.
57. Laureys S, Schiff ND,. Coma and consciousness: paradigms (re)framed by neuroimaging. Neuroimage 2012; 61: 478-491.
58. Bardin JC, Schiff ND, Voss HU,. Pattern classification of volitional functional magnetic resonance imaging responses in patients with severe brain injury. Arch Neurol 2012; 69: 176-181.
59. Friston KJ, Holmes AP, Poline JB, et al. Analysis of fMRI time-series revisited. Neuroimage 1995; 2: 45-53.
60. deCharms RC,. Reading and controlling human brain activation using real-time functional magnetic resonance imaging. Trends Cogn Sci 2007; 11: 473-481.
61. deCharms RC,. Applications of real-time fMRI. Nat Rev Neurosci 2008; 9: 720-729.
62. Haynes J-D, Rees G,. Decoding mental states from brain activity in humans. Nat Rev Neurosci 2006; 7: 523-534.
63. Chadwick MJ, Hassabis D, Weiskopf N, Maguire EA,. Decoding individual episodic memory traces in the human hippocampus. Curr Biol 2010; 20: 544-547.
64. Kay KN, Naselaris T, Prenger RJ, Gallant JL,. Identifying natural images from human brain activity. Nature 2008; 452: 352-355.
65. Caria A, Sitaram R, Birbaumer N,. Real-time fMRI: a tool for local brain regulation. Neuroscientist 2011 [Epub ahead of print].
66. Sitaram R, Lee S, Ruiz S, et al. Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage 2011; 56: 753-765.
67. Lee JH, Marzelli M, Jolesz FA, Yoo SS,. Automated classification of fMRI data employing trial-based imagery tasks. Med Image Anal 2009; 13: 392-404.
68. LaConte SM, Peltier SJ, Hu XP,. Real-time fMRI using brain-state classification. Hum Brain Mapp 2007; 28: 1033-1044.
69. Irani F, Platek SM, Bunce S, et al. Functional near infrared spectroscopy (fNIRS): an emerging neuroimaging technology with important applications for the study of brain disorders. Clin Neuropsychol 2007; 21: 9-37.
70. Villringer A, Chance B,. Non-invasive optical spectroscopy and imaging of human brain function. Trends Neurosci 1997; 20: 435-442.
71. Naito M, Michioka Y, Ozawa K, et al. Communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light. IEICE Trans Inf Syst 2007; 90: 1028-1037.
72. Joseph DK, Huppert TJ, Franceschini MA, Boas DA,. Diffuse optical tomography system to image brain activation with improved spatial resolution and validation with functional magnetic resonance imaging. Appl Opt 2006; 45: 8142-8151.
73. Niedermeyer E, da Silva L,. Electroencephalography: basic principles, clinical applications, and related fields. Philadelphia, PA: Lippincott Williams & Wilkins, 2005.
74. Donchin E,. Presidential address, 1980. Surprise Surprise? Psychophysiology 1981; 18: 493-513.
75. Duncan-Johnson CC, Donchin E,. On quantifying surprise: the variation of event-related potentials with subjective probability. Psychophysiology 1977; 14: 456-467.
76. Fischler I, Jin YS, Boaz TL, et al. Brain potentials related to seeing one's own name. Brain Lang 1987; 30: 24-62.
77. Lang S, Kotchoubey B, Lutz A, Birbaumer N,. What are you doing when you are doing nothing? ERP components without a cognitive task. Z Exp Psychol 1997; 44: 138-162.
78. Bastuji H, Perrin F, Garcia-Larrea L,. Semantic analysis of auditory input during sleep: studies with event related potentials. Int J Psychophysiol 2002; 46: 243-255.
79. Shevrin H,. Event-related markers of unconscious processes. Int J Psychophysiol 2001; 42: 209-218.
80. Schnakers C, Perrin F, Schabus M, et al. Detecting consciousness in a total locked-in syndrome: an active event-related paradigm. Neurocase 2009; 15: 271-277.
81. Schnakers C, Perrin F, Schabus M, et al. Voluntary brain processing in disorders of consciousness. Neurology 2008; 71: 1614-1620.
82. Farwell LA, Donchin E,. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol 1988; 70: 510-523.
83. Kleih SC, Kaufmann T, Zickler C, et al. Out of the frying pan into the fire-the P300-based BCI faces real-world challenges. Prog Brain Res 2011; 194: 27-46.
84. Sellers EW, Donchin E,. A P300-based brain-computer interface: initial tests by ALS patients. Clin Neurophysiol 2006; 117: 538-548.
85. Kübler A, Furdea A, Halder S, et al. A brain-computer interface controlled auditory event-related potential (p300) spelling system for locked-in patients. Ann N Y Acad Sci 2009; 1157: 90-100.
86. Iversen I, Ghanayim N, Kübler A, et al. Conditional associative learning examined in a paralyzed patient with amyotrophic lateral sclerosis using brain-computer interface technology. Behav Brain Funct 2008; 4: 53.
87. Iversen IH, Ghanayim N, Kübler A, et al. A brain-computer interface tool to assess cognitive functions in completely paralyzed patients with amyotrophic lateral sclerosis. Clin Neurophysiol 2008; 119: 2214-2223.
88. Kotchoubey B, Lang S, Herb E, et al. Stimulus complexity enhances auditory discrimination in patients with extremely severe brain injuries. Neurosci Lett 2003; 352: 129-132.
89. Cincotti F, Mattia D, Babiloni C, et al. The use of EEG modifications due to motor imagery for brain-computer interfaces. IEEE Trans Neural Syst Rehabil Eng 2003; 11: 131-133.
90. Wolpaw JR, McFarland DJ, Neat GW, Forneris CA,. An EEG-based brain-computer interface for cursor control. Electroencephalogr Clin Neurophysiol 1991; 78: 252-259.
91. Lotze M, Montoya P, Erb M, et al. Activation of cortical and cerebellar motor areas during executed and imagined hand movements: an fMRI study. J Cogn Neurosci 1999; 11: 491-501.
92. Kübler A, Nijboer F, Mellinger J, et al. Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology 2005; 64: 1775-1777.
93. Goldfine AM, Victor JD, Conte MM, et al. Determination of awareness in patients with severe brain injury using EEG power spectral analysis. Clin Neurophysiol 2011; 22: 2157-2168.
94. Giacino JT, Schnakers C, Rodriguez-Moreno D, et al. Behavioral assessment in patients with disorders of consciousness: gold standard or fool's gold? Prog Brain Res 2009; 177: 33-48.
95. Fins JJ, Schiff ND,. In the blink of the mind's eye. Hastings Cent Rep 2010; 40: 21-23.
96. Owen AM, Coleman MR, Menon DK, et al. Using a hierarchical approach to investigate residual auditory cognition in persistent vegetative state. Prog Brain Res 2005; 150: 457-471.
97. Kane NM, Butler SR, Simpson T,. Coma outcome prediction using event-related potentials: P(3) and mismatch negativity. Audiol Neurootol 2000; 5: 186-191.
98. Coleman MR, Bekinschtein T, Monti MM, et al. A multimodal approach to the assessment of patients with disorders of consciousness. Prog Brain Res 2009; 177: 231-248.