Brain-computer interface with language model-electroencephalography fusion for locked-in syndrome

Neurorehabilitation and Neural Repair

Volumn 28, Issue 4, 2014, Pages 387-394

  Oken, Barry S ^a   Orhan, Umut ^b   Roark, Brian ^a   Erdogmus, Deniz ^b   Fowler, Andrew ^a   Mooney, Aimee ^a   Peters, Betts ^a   Miller, Meghan ^a   Fried Oken, Melanie B ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b NORTHEASTERN UNIVERSITY   (United States)

Author keywords

brain computer interface; electroencephalography (EEG); language model; locked in syndrome; neuroengineering

Indexed keywords

ADULT; AGED; AREA UNDER THE CURVE; ARTICLE; BRAIN COMPUTER INTERFACE; CLASSIFIER; CLINICAL ARTICLE; CONTROLLED STUDY; ELECTROENCEPHALOGRAPHY; FEMALE; HUMAN; INTERPERSONAL COMMUNICATION; KEYBOARD; LANGUAGE MODEL FUSION; LOCKED IN SYNDROME; MACHINE LEARNING; MALE; RAPID SERIAL VISUAL PRESENTATION; SPASTICITY; SPELLING; STATISTICAL MODEL; TASK PERFORMANCE; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BRAIN; COMMUNICATION AID; LANGUAGE; LEARNING; MIDDLE AGED; PATHOPHYSIOLOGY; PROCEDURES; QUADRIPLEGIA; SIGNAL PROCESSING;

ADULT; AGED; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BRAIN; BRAIN-COMPUTER INTERFACES; COMMUNICATION AIDS FOR DISABLED; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; LANGUAGE; MALE; MIDDLE AGED; PRACTICE (PSYCHOLOGY); QUADRIPLEGIA; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84899432989     PISSN: 15459683     EISSN: 15526844     Source Type: Journal    
DOI: 10.1177/1545968313516867     Document Type: Article

References (35)

1. Bauer G, Gerstenbrand F, Rumpl E. Varieties of the locked-in syndrome. J Neurol. 1979 ; 221: 77-91
2. Smith E, Delargy M. Locked-in syndrome. BMJ. 2005 ; 330: 406-409
3. Laureys S, Pellas F, Van Eeckhout P, et al. The locked-in syndrome: what is it like to be conscious but paralyzed and voiceless?. Prog Brain Res. 2005 ; 150: 495-511
4. Schjolberg A, Sunnerhagen KS. Unlocking the locked in; a need for team approach in rehabilitation of survivors with locked-in syndrome. Acta Neurol Scand. 2012 ; 125: 192-198
5. Doble JE, Haig AJ, Anderson C, Katz R. Impairment, activity, participation, life satisfaction, and survival in persons with locked-in syndrome for over a decade: follow-up on a previously reported cohort. J Head Trauma Rehabil. 2003 ; 18: 435-444
6. Cassanova E, Lazzari RE, Lotta S, Mazzuchi A. Locked-in syndrome: improvement in the prognosis after an early intensive multidisciplinary rehabilitation. Arch Phys Med Rehabil. 2003 ; 84: 862-867
7. BeaudoinNDe SerresL. Locked-in syndrome. In: StoneJHBlouinM, eds. International Encyclopedia of Rehabilitation. http://cirrie.buffalo.edu/ encyclopedia/en/article/303/. Accessed December 2, 2013.
8. Trojano L, Moretta P, Estraneo A, Santoro L. Neuropsychologic assessment and cognitive rehabilitation in a patient with locked-in syndrome and left neglect. Arch Phys Med Rehabil. 2010 ; 91: 498-502
9. Ball LJ, Beukelman DR, Fager SK, et al. Eye-gaze access to AAC technology for people with amyotrophic lateral sclerosis. J Med Speech Lang Pathol. 2010 ; 18: 11-23
10. Soderholm S, Meinander M, Alaranta H. Augmentative and alternative communication methods in locked-in syndrome. J Rehabil Med. 2001 ; 33: 235-239
11. Fager S, Beukelman D, Karantounis R, Jakobs T. Use of safe-laser access technology to increase head movement in persons with severe motor impairment: a series of case reports. Augment Altern Commun. 2006 ; 22: 222-229
12. Murguialday AR, Hill J, Bensch M, et al. Transition from the locked in to the completely locked-in state: a physiological analysis. Clin Neurophysiol. 2011 ; 122: 925-933
13. Ball LJ, Fager S, Fried-Oken M. Augmentative and alternative communication for people with progressive neuromuscular disease. Phys Med Rehabil Clin North Am. 2012 ; 23: 689-699
14. Fager S, Beukelman DR, Fried-Oken M, Jakobs T, Baker J. Access interface strategies. Assist Technol. 2011 ; 24: 25-33
15. Brain-Computer Interfaces: Principles and Practice. Wolpaw JR Wolpaw EW, ed. New York, NY: Oxford University Press ; 2012 :
16. Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans Biomed Eng. 2004 ; 51: 1034-1043
17. Farwell LA, Donchin E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol. 1988 ; 70: 510-523
18. Fabiani M, Gratton G, Karis D, Donchin E. Definition, identification, and reliability of measurement of the P300 component of the event-related brain potential. Adv Psychophysiol. 1987 ; 2: 1-78
19. Krusienski DJ, Sellers EW, McFarland DJ, Vaughan TM, Wolpaw JR. Toward enhanced P300 speller performance. J Neurosci Methods. 2008 ; 167: 15-21
20. Blankertz B, Dornhege G, Krauledat M, et al. The Berlin Brain-Computer Interface presents the novel mental typewriter Hex-o-Spell. Proceedings of the 3rd International Brain-Computer Interface Workshop and Training Course ; 2006 Graz, Austria: Verlag der Technischen Universität Graz ; 2006. 108.
21. Treder MS, Schmidt NM, Blankertz B. Towards gaze-independent visual brain-computer interfaces. Conference Abstract: Bernstein Conference on Computational Neuroscience ; 2010 ; 2010..
22. Ryan DB, Frye GE, Townsend G, et al. Predictive spelling with a P300-based brain-computer interface: increasing the rate of communication. Int J Hum Comput Interact. 2011 ; 27: 69-84
23. Higginbotham J, Moulton B, Lesher G, Roark B. The application of natural language processing to augmentative and alternative communication. Assist Technol. 2012 ; 24: 14-24
24. Fried-OkenMOkenBErdogmusD. A brain computer interface using the RSVP keyboard for users who are locked-in. Paper presented at: International Society on Augmentative and Alternative Communication; 2012; Pittsburgh, PA. http://aac-rerc.psu.edu/documents/Fried-Oken-et-al-RSVP-2012.pdf. Accessed December 3, 2013.
25. Fried-Oken M, Mooney A, Peters B, Oken B. A clinical screening protocol for the RSVP keyboard brain-computer interface. Disability and Rehabilitation: Assistive Technology. In press ;:
26. Orhan U, Hild KE, Erdogmus D, Roark B, Oken B, Fried-Oken M. RSVP Keyboard: an EEG based typing interface. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) ; 2012 ; 2012. 645.
27. MacKenzie IS, Soukoreff RW. Phrase sets for evaluating text entry techniques. ACM Conference on Human Factors in Computing Systems (CHI) ; 2003 ; 2003. 754.
28. Soukoreff RW Quantifying Text Entry Performance. Toronto, Ontario, Canada: York University ; 2010 :
29. Friedman JH. Regularized discriminant analysis. J Am Stat Assoc. 1989 ; 84: 165-175
30. Roark B, Beckley R, Gibbons C, Fried-Oken M. Huffman scanning: using language models within fixed-grid keyboard emulation. Comput Speech Lang. 2013 ; 27: 1212-1234
31. Brunner P, Joshi S, Briskin S, Wolpaw JR, Bischof H, Schalk G. Does the 'P300' speller depend on eye gaze?. J Neural Eng. 2010 ; 7: 056013
32. Meador KJ. Cognitive side effects of medications. Neurol Clin. 1998 ; 16: 141-155
33. Polich J, Criado JR. Neuropsychology and neuropharmacoogy of P3a and P3b. Int J Psychophysiol. 2006 ; 60: 172-185
34. Jung T-P, Makeig S, Humphries C, et al. Removing electroencephalographic artifacts by blind source separation. Psychophysiology. 2000 ; 37: 163-178
35. Oken BS, Salinsky MC, Elsas SM. Vigilance, alertness, or sustained attention: physiological basis and measurement. Clin Neurophysiol. 2006 ; 117: 1885-1901