The emerging world of motor neuroprosthetics: A neurosurgical perspective

Neurosurgery

Volumn 59, Issue 1, 2006, Pages 1-13

  Leuthardt, Eric C ^a,e   Schalk, Gerwin ^b,c   Moran, Daniel ^d   Ojemann, Jeffrey G ^a  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b WADSWORTH CENTER   (United States)

^c STATE UNIVERSITY OF NEW YORK   (United States)

^d WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^e WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Brain computer interface; Brain machine interface; Electrocorticography; Electroencephalography; Neuroprosthetics; Single units

Indexed keywords

PROTEIN P300;

BRAIN COMPUTER INTERFACE; DEVICE; ELECTROCORTICOGRAPHY; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; ENGINEERING; EVOKED RESPONSE; MEDICAL RESEARCH; MOTOR DYSFUNCTION; NEUROMUSCULAR DISEASE; NEUROSCIENCE; NEUROSURGERY; PRIORITY JOURNAL; PROSTHESIS; REVIEW; SENSORIMOTOR CORTEX; SPINAL CORD INJURY; STROKE; SURGEON;

BRAIN; HUMANS; MAN-MACHINE SYSTEMS; MOVEMENT; NEUROSURGERY; PROSTHESES AND IMPLANTS; USER-COMPUTER INTERFACE;

EID: 33745799090     PISSN: 0148396X     EISSN: None     Source Type: Journal    
DOI: 10.1227/01.NEU.0000221506.06947.AC     Document Type: Review

References (96)

1. Adams JS, Hasenstab MS, Pippin GW, Sismanis A: Telephone use and understanding in patients with cochlear implants. Ear Nose Throat J 83:99-103, 2004.
2. Andersen RA, Burdick JW, Musallam S, Pesaran B, Cham JG: Cognitive neural prosthetics. Trends Cogn Sci 8:486-493, 2004.
3. Bak M, Girvin JP, Hambrecht FT, Kufta CV, Loeb GE, Schmidt EM: Visual sensations produced by intracortical microstimulation of the human occipital cortex. Med Biol Eng Comput 28:257-259, 1990.
4. Birbaumer N: Slow Cortical Potentials: Their Origin, Meaning, and Clinical Use. Tilburg, Tilburg University Press, 1997.
5. Birbaumer N, Ghanayim N, Hinterberger T, Iversen I, Kotchoubey B, Kubler A, Perelmouter J, Taub E, Flor H: A spelling device for the paralyzed. Nature 398:297-298, 1999.
6. Birbaumer N, Kubler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, Iversen I, Kotchoubey B, Neumann N, Flor H: The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 8:190-193, 2000.
7. Boulton AA, Baker GB, Vanderwolf CH: Neurophysiological Techniques: Applications to Neural Systems. Totowa, Humana Press, 1990, pp 277-312.
8. Brown JA, Barbaro NM: Motor cortex stimulation for central and neuropathic pain: Current status. Pain 104:431-435, 2003.
9. Brown JA, Pilitsis JG: Motor cortex stimulation for central and neuropathic facial pain: A prospective study of 10 patients and observations of enhanced sensory and motor function during stimulation. Neurosurgery 56:290-297, 2005.
10. Bullara LA, Agnew WF, Yuen TG, Jacques S, Pudenz RH: Evaluation of electrode array material for neural prostheses. Neurosurgery 5:681-686, 1979.
11. Chow AY, Chow VY, Packo KH, Pollack JS, Peyman GA, Schuchard R: The artificial silicon retina microchip for the treatment of vision loss from retinitis pigmentosa. Arch Ophthalmol 122:460-469, 2004.
12. Colletti V, Carner M, Miorelli V, Guida M, Colletti L, Fiorino F: Auditory brainstem implant (ABI): New frontiers in adults and children. Otolaryngol Head Neck Surg 133:126-138, 2005.
13. Crone NE, Boatman D, Gordon B, Hao L: Induced electrocorticographic γ activity during auditory perception. Brazier Award-winning article, 2001. Clin Neurophysiol 112:565-582, 2001.
14. Crone NE, Hao L, Hart J Jr, Boatman D, Lesser RP, Irizarry R, Gordon B: Electrocorticographic γ activity during word production in spoken and sign language. Neurology 57:2045-2053, 2001.
15. Crone NE, Miglioretti DL, Gordon B, Lesser RP: Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis: II-Event-related synchronization in the γ band. Brain 121:2301-2315, 1998.
16. Dobelle WH, Mladejovsky MG: Phosphenes produced by electrical stimulation of human occipital cortex, and their application to the development of a prosthesis for the blind. J Physiol 243:553-576, 1974.
17. Dobelle WH, Mladejovsky MG, Evans JR, Roberts TS, Girvin JP: "Braille" reading by a blind volunteer by visual cortex stimulation. Nature 259:111-112, 1976.
18. Dobelle WH, Quest DO, Antunes JL, Roberts TS, Girvin JP: Artificial vision for the blind by electrical stimulation of the visual cortex. Neurosurgery 5:521-527, 1979.
19. Dobelle WH, Stensaas SS, Mladejovsky MG, Smith JB: A prosthesis for the deaf based on cortical stimulation. Ann Otol Rhinol Laryngol 82:445-463, 1973.
20. Dobelle WH, Turkel J, Henderson DC, Evans JR: Mapping the projection of the visual field onto visual cortex in man by direct electrical stimulation. Trans Am Soc Artif Intern Organs 24:15-17, 1978.
21. Donchin E, Smith DB: The contingent negative variation and the late positive wave of the average evoked potential. Electroencephalogr Clin Neurophysiol 29:201-203, 1970.
22. Donchin E, Spencer KM, Wijesinghe R: The mental prosthesis: Assessing the speed of a P300-based brain-computer interface. IEEE Trans Rehabil Eng 8:174-179, 2000.
23. Duncan DE: Implanting hope. Technol Rev March: 69-74, 2005.
24. Elbert T, Rockstroh B, Lutzenberger W, Birbaumer N: Biofeedback of slow cortical potentials. I. Electroencephalogr Clin Neurophysiol 48:293-301, 1980.
25. Farwell LA, Donchin E: Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol 70:510-523, 1988.
26. Fetz EE, Finocchio DV: Operant conditioning of specific patterns of neural and muscular activity. Science 174:431-435, 1971.
27. Fisch BJ, Pedley TA, Keller DL: A topographic background symmetry display for comparison with routine EEG. Electroencephalogr Clin Neurophysiol 69:491-494, 1988.
28. Freeman WJ, Holmes MD, Burke BC, Vanhatalo S: Spatial spectra of scalp EEG and EMG from awake humans. Clin Neurophysiol 114:1053-1068, 2003.
29. Gastaut H: Electrocorticographic study of the reactivity of rolandic rhythm. Rev Neurol (Paris) 87:176-182, 1952.
30. Georgopoulos AP, Schwartz AB, Kettner RE: Neuronal population coding of movement direction. Science 233:1416-1419, 1986.
31. Huggins JE, Levine SP, BeMent SL, Kushwaha RK, Schuh LA, Passaro EA, Rohde MM, Ross DA, Elisevich KV, Smith BJ: Detection of event-related potentials for development of a direct brain interface. J Clin Neurophysiol 16:448-455, 1999.
32. Humayun MS, de Juan E Jr, Dagnelie G, Greenberg RJ, Propst RH, Phillips DH: Visual perception elicited by electrical stimulation of retina in blind humans. Arch Ophthalmol 114:40-46, 1996.
33. Humayun M, Propst R, de Juan E Jr, McCormick K, Hickingbotham D: Bipolar surface electrical stimulation of the vertebrate retina. Arch Ophthalmol 112:110-116, 1994.
34. Kennedy PR, Andeasen D, Wright EJ, Mao H, Ehirim P: Towards conversational speech restoration in a locked-in patient recording from Brocas area with the neurotrophic electrode. Presented at the Society for Neuroscience Meeting, Washington, DC, November 14, 2005.
35. Kennedy PR, Bakay RA: Restoration of neural output from a paralyzed patient by a direct brain connection. Neuroreport 9:1707-1711, 1998.
36. Kostov A, Polak M: Parallel man-machine training in development of EEG-based cursor control. IEEE Trans Rehabil Eng 8:203-205, 2000.
37. Kozelka JW, Pedley TA: β and μ rhythms. J Clin Neurophysiol 7:191-207, 1990.
38. Kubler A, Neumann N, Kaiser J, Kotchoubey B, Hinterberger T, Birbaumer NP: Brain-computer communication: Self-regulation of slow cortical potentials for verbal communication. Arch Phys Med Rehabil 82:1533-1539, 2001.
39. Kubler A, Nijboer F, Mellinger J, Vaughan TM, Pawelzik H, Schalk G, McFarland DJ, Birbaumer N, Wolpaw JR: Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology 64:1775-1777, 2005.
40. Kuchta J: Neuropresthetic hearing with auditory brainstem implants. Biomed Tech (Berl) 49:83-87, 2004.
41. Laubach M, Wessberg J, Nicolelis MA: Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature 405:567-571, 2000.
42. Leuthardt EC, Miller KJ, Schalk G, Rao RN, Ojemann JG: Electrocorticography-based brain computer interface: The Seattle Experience. IEEE Neural Syst Rehabil Eng (in press).
43. Leuthardt EC, Schalk G, Wolpaw JR, Ojemann JG, Moran DW: A brain-computer interface using electrocorticographic signals in humans. J Neural Eng 1:63-71, 2004.
44. Levine SP, Huggins JE, BeMent SL, Kushwaha RK, Schuh LA, Passaro EA, Rohde MM, Ross DA: Identification of electrocorticogram patterns as the basis for a direct brain interface. J Clin Neurophysiol 16:439-447, 1999.
45. Levine SP, Huggins JE, BeMent SL, Kushwaha RK, Schuh LA, Rohde MM, Passaro EA, Ross DA, Elisevich KV, Smith BJ: A direct brain interface based on event-related potentials. IEEE Trans Rehabil Eng 8:180-185, 2000.
46. Loeb GE, Walker AE, Uematsu S, Konigsmark BW: Histological reaction to various conductive and dielectric films chronically implanted in the subdural space. J Biomed Mater Res 11:195-210, 1977.
47. Lopes da Silva FH, Pfurtscheller G: Event-Related Desynchronization. Handbook of Electroencephalography and Clinical Neurophysiology. Amsterdam, Elsevier, 1999, pp 245-268.
48. Margalit E, Maia M, Weiland JD, Greenberg RJ, Fujii GY, Torres G, Piyathaisere DV, O'Hearn TM, Liu W, Lazzi G, Dagnelie G, Scribner DA, de Juan E Jr, Humayun MS: Retinal prosthesis for the blind. Surv Ophthalmol 47:335-356, 2002.
49. Margalit E, Weiland JD, Clatterbuck RE, Fujii GY, Maia M, Tameesh M, Torres G, D'Anna SA, Desai S, Piyathaisere DV, Olivi A, de Juan E Jr, Humayun MS: Visual and electrical evoked response recorded from subdural electrodes implanted above the visual cortex in normal dogs under two methods of anesthesia. J Neurosci Methods 123:129-137, 2003.
50. McFarl DJ, Miner LA, Vaughan TM, Wolpaw JR: μ and β rhythm topographies during motor imagery and actual movements. Brain Topogr 12:177-186, 2000.
51. McFarl DJ, Sarnacki WA, Wolpaw JR: EEG-based two-dimensional movement and target selection by a non-invasive brain-computer interface in humans: Emulating full mouse control. Presented at the Society for Neuroscience Meeting, Washington DC, November 12, 2005.
52. Middlebrooks JC, Bierer JA, Snyder RL: Cochlear implants: The view from the brain. Curr Opin Neurobiol 15:488-493, 2005.
53. Moran DW, Schwartz AB: Motor cortical representation of speed and direction during reaching. J Neurophysiol 82:2676-2692, 1999.
54. Moving a paralyzed hand through a brain-computer interface controlled by the affected hemisphere after stroke. Protocol Number 06-N-0012. Available at: http://clinicalstudies.info.nih.gov/detail/A_2006-N-0012.html. Bethesda, MD, National Institute of Neurological Disorders and Stroke (NINDS). Accessed March 10, 2006.
55. Nguyen JP, Letaucher JP, Le Guerinel C, Eizenbaum JF, Nakano N, Carpentier A, Brugieres P, Pollin B, Rostaing S, Keravel Y: Motor cortex stimulation in the treatment of central and neuropathic pain. Arch Med Res 31:263-265, 2000.
56. Niedermeyer E: The normal EEG of the waking adult, in Niedermeyer E, Lopes da Silva F (eds): Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. Baltimore, Williams & Wilkins, 1999, pp 131-152.
57. Otto SR, Brackmann DE, Hitselberger WE, Shannon RV, Kuchta J: Multichannel auditory brainstem implant: Update on performance in 61 patients. J Neurosurg 96:1063-1071, 2002.
58. Pfurtscheller G: Event-related desynchronization (ERD) and event-related synchronization (ERS), in Niedermeyer E, Lopes da Silva F (eds): Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. Baltimore, Williams & Wilkins, 1999, pp 1003-1017.
59. Pfurtscheller G, Berghold A: Patterns of cortical activation during planning of voluntary movement. Electroencephalogr Clin Neurophysiol 72:250-258, 1989.
60. Pfurtscheller G, Cooper R: Frequency dependence of the transmission of the EEG from cortex to scalp. Electroencephalogr Clin Neurophysiol 38:93-96, 1975.
61. Pfurtscheller G, Flotzinger D, Kalcher J: Brain-computer interface: A new communication device for handicapped persons. J Microcomp App 16:293-299, 1993.
62. Pfurtscheller G, Graimann B, Huggins JE, Levine SP, Schuh LA: Spatiotemporal patterns of β desynchronization and γ synchronization in corticographic data during self-paced movement. Clin Neurophysiol 114: 1226-1236, 2003.
63. Pfurtscheller G, Guger C, Muller G, Krausz G, Neuper C: Brain oscillations control hand orthosis in a tetraplegic. Neurosci Lett 292:211-214, 2000.
64. Pfurtscheller G, Neuper C: Motor imagery activates primary sensorimotor area in humans. Neurosci Lett 239:65-68, 1997.
65. Pfurtscheller G, Neuper C, Guger C, Harkam W, Ramoser H, Schlogl A, Obermaier B, Pregenzer M: Current trends in Graz brain-computer interface (BCI) research. IEEE Trans Rehabil Eng 8:216-219, 2000.
66. Pierce JR: An Introduction to Information Theory. New York, Dover Press, 1980, 78-107.
67. Rockstroh B, Elbert T, Canavan A, Lutzenberger W, Birbaumer N: Slow Cortical Potentials and Behavior. Baltimore, Urban & Schwarzenberg, 1989.
68. Rohde MM, BeMent SL, Huggins JE, Levine SP, Kushwaha RK, Schuh LA: Quality estimation of subdurally recorded, event-related potentials based on signal-to-noise ratio. IEEE Trans Biomed Eng 49:31-40, 2002.
69. Schalk G, Leuthardt EC, Moran D, Ojemann J, Wolpaw JR: Two-dimensional cursor control using electrocorticographic signals in humans. Presented at the Society for Neuroscience Meeting, San Diego, October 23, 2004.
70. Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR: BCI2000: A general-purpose brain-computer interface (BCI) system. IEEE Trans Biomed Eng 51:1034-1043, 2004.
71. Schmidt EM, Bak MJ, Hambrecht FT, Kufta CV, O'Rourke DK, Vallabhanath P: Feasibility of a visual prosthesis for the blind based on intracortical microstimulation of the visual cortex. Brain 119:507-522, 1996.
72. Schwartz AB: Direct cortical representation of drawing. Science 265:540-542, 1994.
73. Sellers EW, Donchin E: A P300-based brain-computer interface: Initial tests by ALS patients. Clin Neurophysiol 117:538-548, 2006.
74. Serruya MD, Caplan AH, Saleh M, Morris DS, Donoghue JP: The braingate pilot trial: Building and testing a novel direct neural output for patients with severe motor imparments. Presented at the Society for Neuroscience Meeting, San Diego, October 24, 2004.
75. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP: Instant neural control of a movement signal. Nature 416:141-142, 2002.
76. Shain W, Spataro L, Dilgen J, Haverstick K, Retterer S, Isaacson M, Saltzman M, Turner JN: Controlling cellular reactive responses around neural prosthetic devices using peripheral and local intervention strategies. IEEE Trans Neural Syst Rehabil Eng 11:186-188, 2003.
77. Sinai A, Bowers CW, Crainiceanu CM, Boatman D, Gordon B, Lesser RP, Lenz FA, Crone NE: Electrocorticographic high γ activity versus electrical cortical stimulation mapping of naming. Brain 128:1556-1570, 2005.
78. Srinivasan R, Nunez PL, Silberstein RB: Spatial filtering and neocortical dynamics: Estimates of EEG coherence. IEEE Trans Biomed Eng 45:814-826, 1998.
79. Sutter EE: The brain response interface: Communication through visually-induced electrical brain responses. J Microcomp App 15:31-45, 1992.
80. Sutton S, Braren M, Zubin J, John ER: Evoked-potential correlates of stimulus uncertainty. Science 150:1187-1188, 1965.
81. Szarowski DH, Andersen MD, Retterer S, Spence AJ, Isaacson M, Craighead HG, Turner JN, Shain W: Brain responses to micro-machined silicon devices. Brain Res 983:23-35, 2003.
82. Taylor DM, Tillery SI, Schwartz AB: Direct cortical control of 3D neuroprosthetic devices. Science 296:1829-1832, 2002.
83. Veraart C, Raftopoulos C, Mortimer JT, Delbeke J, Pins D, Michaux G, Vanlierde A, Parrini S, Wanet-Defalque MC: Visual sensations produced by optic nerve stimulation using an implanted self-sizing spiral cuff electrode. Brain Res 813:181-186, 1998.
84. Vetter RJ, Williams JC, Hetke JF, Nunamaker EA, Kipke DR: Chronic neural recording using silicon-substrate microelectrode arrays implanted in cerebral cortex. IEEE Trans Biomed Eng 51:896-904, 2004.
85. Vidal JJ: Real-time detection of brain events in EEG. Special Issue on Biological Signal Processing and Analysis IEEE Proc 65:633-664, 1977.
86. Vossler M, Goodman R, Hirsch L, Young J, Kraemer D: Early safety experience with a fully implanted intracranial responsive neurostimulator for epilepsy. Presented at the Annual Meeting of the American Epilepsy Society (AES), New Orleans, December 3-7, 2004.
87. Weiland JD, Humayun MS, Dagnelie G, de Juan E Jr, Greenberg RJ, Iliff NT: Understanding the origin of visual percepts elicited by electrical stimulation of the human retina. Graefes Arch Clin Exp Ophthalmol 237:1007-1013, 1999.
88. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, Chapin JK, Kim J, Biggs SJ, Srinivasan MA, Nicolelis MA: Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408:361-365, 2000.
89. Wickelgren I: Neuroscience: Tapping the mind. Science 299:496-499, 2003.
90. Wolpaw JR, Birbaumer N, Heetderks WJ, McFarl DJ, Peckham PH, Schalk G, Donchin E, Quatrano LA, Robinson CJ, Vaughan TM: Brain-computer interface technology: A review of the first international meeting. IEEE Trans Rehabil Eng 8:164-173, 2000.
91. Wolpaw JR, Birbaumer N, McFarl DJ, Pfurtscheller G, Vaughan TM: Brain-computer interfaces for communication and control. Clin Neurophysiol 113:767-791, 2002.
92. Wolpaw JR, McFarl DJ: Multichannel EEG-based brain-computer communication. Electroencephalogr Clin Neurophysiol 90:444-449, 1994.
93. Wolpaw JR, McFarl DJ: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc Natl Acad Sci U S A 101:17849-17854, 2004.
94. Wolpaw JR, McFarland DJ, Neat GW, Forneris CA: An EEC-based brain-computer interface for cursor control. Electroencephalogr Clin Neurophysiol 78:252-259, 1991.
95. Wolpaw JR, McFarland DJ, Vaughan TM, Schalk G: The Wadsworth Center brain-computer interface (BCI) research and development program. IEEE Trans Neural Syst Rehabil Eng 11:204-207, 2003.
96. Yuen TG, Agnew WF, Bullara LA: Tissue response to potential neuroprosthetic materials implanted subdurally. Biomaterials 8:138-141, 1987.