The science of neural interface systems

Annual Review of Neuroscience

Volumn 32, Issue , 2009, Pages 249-266

  Hatsopoulos, Nicholas G ^a   Donoghue, John P ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

Brain machine interface; Decoding; Motor cortex; Multielectrode array; Neural prosthesis

Indexed keywords

BEHAVIOR; BODY MOVEMENT; BRAIN COMPUTER INTERFACE; BRAIN FUNCTION; ELECTROSTIMULATION; FEEDBACK SYSTEM; HUMAN; MEDICAL RESEARCH; MICROELECTRODE; MOTOR DYSFUNCTION; NERVE CELL PLASTICITY; NERVE POTENTIAL; NERVE STIMULATION; NEURAL INTERFACE SYSTEM; NEUROBIOLOGY; NONHUMAN; PRIORITY JOURNAL; PROPRIOCEPTION; REVIEW; SENSORY DYSFUNCTION; SIGNAL DETECTION; SPIKE;

ACTION POTENTIALS; ANIMALS; BRAIN; ELECTRODES, IMPLANTED; HUMANS; MOTOR CORTEX; MOVEMENT DISORDERS; NEURONS; PROSTHESES AND IMPLANTS; ROBOTICS; SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 67651008634     PISSN: 0147006X     EISSN: 15454126     Source Type: Book Series    
DOI: 10.1146/annurev.neuro.051508.135241     Document Type: Review

References (112)

1. Andersen RA, Buneo CA. 2002. Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25:189-220
2. Arle JE, Alterman RL. 1999. Surgical options in Parkinson's disease. Med. Clin. North. Am. 83:483-98, vii
3. Ashe J, Georgopoulos AP. 1994. Movement parameters and neural activity in motor cortex and area 5. Cereb. Cortex 6:590-600
4. Barbieri R, Frank LM, Nguyen DP, Quirk MC, Solo V, et al. 2004a. A Bayesian decoding algorithm for analysis of information encoding in neural ensembles. Conf. Proc. IEEE Eng. Med. Biol. Soc. 6:4483-86
5. Barbieri R, Frank LM, Nguyen DP, Quirk MC, Solo V, et al. 2004b. Dynamic analyses of information encoding in neural ensembles. Neural. Comput. 16:277-307
6. Beisteiner R, Windischberger C, Lanzenberger R, Edward V, Cunnington R, et al. 2001. Finger somatotopy in human motor cortex. Neuroimage 13:1016-26
7. Belitski A, Gretton A, Magri C, Murayama Y, Montemurro MA, et al. 2008. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. Neurosci. 28:5696-709
8. Birbaumer N. 2006. Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. Psychophysiology 43:517-32
9. Bladin PF. 2006.W. GreyWalter, pioneer in the electroencephalogram, robotics, cybernetics, artificial intelligence. J. Clin. Neurosci. 13:170-77
10. Brockwell AE, Rojas AL, Kass RE. 2004. Recursive Bayesian decoding of motor cortical signals by particle filtering. J. Neurophysiol. 91:1899-907
11. Bullock TH. 1997. Signals and signs in the nervous system: the dynamic anatomy of electrical activity is probably information-rich. Proc. Natl. Acad. Sci. USA 94:1-6
12. Buneo CA, Andersen RA. 2006. The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia 44:2594-606
13. Buneo CA, Jarvis MR, Batista AP, Andersen RA. 2003. Properties of spike train spectra in two parietal reach areas. Exp. Brain Res. 153:134-39
14. Cabel DW, Cisek P, Scott SH. 2001. Neural activity in primary motor cortex related to mechanical loads applied to the shoulder and elbow during a postural task. J. Neurophysiol. 86:2102-8
15. Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, et al. 2003. Learning to control a brainmachine interface for reaching and grasping by primates. Public Library Sci. Biol. 1:1-16
16. Chapin JK, Moxon KA, Markowitz RS, Nicolelis MA. 1999. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2:664-70
17. Chatterjee A, Aggarwal V, Ramos A, Acharya S, ThakorNV.2007. Abrain-computer interface with vibrotactile biofeedback for haptic information. J. Neuroeng. Rehabil. 4:40:1-12
18. Cheney PD, Fetz EE. 1980. Functional classes of primate corticomotoneuronal cells and their relation to active force. J. Neurophysiol. 44:773-91
19. Crago PE, Houk JC, Hasan Z. 1976. Regulatory actions of human stretch reflex. J. Neurophysiol. 39:925-35
20. Dancause N, Barbay S, Frost SB, Plautz EJ, Chen D, et al. 2005. Extensive cortical rewiring after brain injury. J. Neurosci. 25:10167-79
21. Dhillon GS, Horch KW. 2005. Direct neural sensory feedback and control of a prosthetic arm. IEEE Trans. Neural. Syst. Rehabil. Eng. 13:468-72
22. Donoghue JP, Sanes JN, Hatsopoulos NG, Gaal G. 1998. Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. J. Neurophysiol. 77:159-73
23. Donoghue JP, Suner S, Sanes JN. 1990. Dynamic organization of primary motor cortex output to target muscles in adult rats. II. Rapid reorganization following motor nerve lesions. Exp. Brain Res. 79:492-503
24. Doubler JA, Childress DS. 1984a. An analysis of extended physiological proprioception as a prosthesis-control technique. J. Rehabil. Res. Dev. 21:5-18
25. Doubler JA, Childress DS. 1984b. Design and evaluation of a prosthesis control system based on the concept of extended physiological proprioception. J. Rehabil. Res. Dev. 21:19-31
26. Enzinger C, Ropele S, Fazekas F, Loitfelder M, Gorani F, et al. 2008. Brain motor system function in a patient with complete spinal cord injury following extensive brain-computer interface training. Exp. Brain Res. 190:215-23
27. Evarts EV. 1968. Relation of pyramidal tract activity to force exerted during voluntary movement. J. Neurophysiol. 31:14-27
28. Fagg AH, Hatsopoulos NG, de Lafuente V, Moxon KA, Nemati S, et al. 2007. Biomimetic brain machine interfaces for the control of movement. J. Neurosci. 27:11842-46
29. Fagg AH, Ojakangas G, Miller LE, Hatsopoulos N. 2009. Kinetic trajectory decoding using motor cortical ensembles. IEEE Trans. Neural. Syst. Rehabil. Eng. In press
30. Fetz EE. 1969. Operant conditioning of cortical unit activity. Science 163:955-58
31. Fu Q-G, Flament D, Coltz JD, Ebner TJ. 1995. Temporal encoding of movement kinematics in the discharge of primate primary motor and premotor neurons. J. Neurophysiol. 73:836-54
32. Fu Q-G, Suarez JI, Ebner TJ. 1993. Neuronal specification of direction and distance during reaching movements in the superior precentral premotor area and primary motor cortex of monkeys. J. Neurophysiol. 70:2097-116
33. Georgopoulos AP, Kalaska JF, Caminiti R, Massey JT. 1982. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 2:1527-37
34. Georgopoulos AP, Kettner RE, Schwartz AB. 1988. Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population. J. Neurosci. 8:2928-37
35. Georgopoulos AP, Schwartz AB, Kettner RE. 1986. Neuronal population coding of movement direction. Science 233:1416-19
36. Ghez C, Gordon J, Ghilardi MF. 1995. Impairments of reaching movements in patients without proprioception. II. Effects of visual information on accuracy. J. Neurophysiol. 73:361-72
37. Ghez C, Gordon J, Ghilardi MF, Christakos CN, Cooper SE. 1990. Roles of proprioceptive input in the programming of arm trajectories. Cold Spring Harb. Symp. Quant. Biol. 55:837-47
38. Gifford RH, Shallop JK, Peterson AM. 2008. Speech recognition materials and ceiling effects: considerations for cochlear implant programs. Audiol. Neurootol. 13:193-205
39. Giraux P, Sirigu A, Schneider F, Dubernard JM. 2001. Cortical reorganization in motor cortex after graft of both hands. Nat. Neurosci. 4:691-92
40. Gordon J, Ghilardi MF, Guez C. 1995. Impairment of reaching movements in patients without proprioception. I. Spatial errors. J. Neurophysiol. 73:347-60
41. Hatsopoulos N, Joshi J, O'Leary J. 2004. Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles. J. Neurophysiol. 92:1165-74
42. Hepp-Reymond M-C, Wyss UR, Anner R. 1978. Neuronal coding of static force in the primate motor cortex. J. Physiol. (Paris) 74:287-91
43. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, et al. 2006. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442:164-71
44. Humphrey DR, Schmidt EM, Thompson WD. 1970. Predicting measures of motor performance from multiple cortical spike trains. Science 170:758-62
45. Ingram JN, Kording KP, Howard IS, Wolpert DM. 2008. The statistics of natural hand movements. Exp. Brain Res. 188:223-36
46. Inmann A, Haugland M. 2004. Implementation of natural sensory feedback in a portable control system for a hand grasp neuroprosthesis. Med. Eng. Phys. 26:449-58
47. Inmann A, Haugland M, Haase J, Biering-Sorensen F, Sinkjaer T. 2001. Signals from skin mechanoreceptors used in control of a hand grasp neuroprosthesis. Neuroreport 12:2817-20
48. Kalaska JF, Cohen DAD, Hyde ML, Prud'homme M. 1989. A comparison of movement direction-related versus load direction-related activity in primate motor cortex, using a two-dimensional reaching task. J. Neurosci. 9:2080-102
49. Kemere C, Shenoy KV, Meng TH. 2004. Model-based neural decoding of reaching movements: a maximum likelihood approach. IEEE Trans. Biomed. Eng. 51:925-32
50. Kennedy P, Andreasen D, Ehirim P, King B, Kirby T, et al. 2004. Using human extra-cortical local field potentials to control a switch. J. Neural. Eng. 1:72-77
51. Kennedy PR, Bakay RA. 1998. Restoration of neural output from a paralyzed patient by a direct brain connection. Neuroreport 9:1707-11
52. Kennedy PR, Bakay RA, Moore MM, Adams K, Goldwaithe J. 2000. Direct control of a computer from the human central nervous system. IEEE Trans. Rehabil. Eng. 8:198-202
53. Kennedy PR, Bakay RAE, Sharpe SM. 1992a. Behavioral correlates of action potentials recorded chronically inside the cone electrode. Neuroreport 3:605-8
54. Kennedy PR, Mirra SS, Bakay RAE. 1992b. The cone electrode: ultrastructural studies following long-term recording in rat and monkey cortex. Neurosci. Lett. 142:89-94
55. Kim S, Zoschke K, Klein M, Black D, Buschick K, et al. 2007a. Switchable polymer based thin film coils as a power module for wireless neural interfaces. Sens. Actuators A Phys. 136:467-74
56. Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Friehs GM, Black MJ. 2007b. Multi-state decoding of pointand-click control signals from motor cortical activity in a human with tetraplegia. Presented at Neural Eng. CNE 2007. Int. IEEE/EMBS Conf., 3rd, Kohala Coast, Hawaii
57. Lebedev MA, Carmena JM, O'Doherty JE, Zacksenhouse M, Henriquez CS, et al. 2005. Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J. Neurosci. 25:4681-93
58. Li G, Kuiken TA. 2008. Modeling of prosthetic limb rotation control by sensing rotation of residual arm bone. IEEE Trans. Biomed. Eng. 55:2134-42
59. Luppino G, Rizzolatti G. 2000. The organization of the frontal motor cortex. News. Physiol. Sci. 15:219-24
60. Mason CR, Gomez JE, Ebner TJ. 2001. Hand synergies during reach-to-grasp. J. Neurophysiol. 86:2896-910
61. Mavoori J, Jackson A, Diorio C, Fetz E. 2005. An autonomous implantable computer for neural recording and stimulation in unrestrained primates. J. Neurosci. Methods 148:71-77
62. Moran DW, Schwartz AB. 1999. Motor cortical representation of speed and direction during reaching. J. Neurophysiol. 82:2676-92
63. Morrow MM, Miller LE. 2003. Prediction of muscle activity by populations of sequentially recorded primary motor cortex neurons. J. Neurophysiol. 89:2279-88
64. Murthy VN, Fetz EE. 1996. Synchronization of neurons during local field potential oscillations in sensorimotor cortex of awake monkeys. J. Neurophysiol. 76:3968-82
65. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA. 2004. Cognitive control signals for neural prosthetics. Science 305:258-62
66. Nudo RJ. 2006. Plasticity. Neuro. Rx. 3:420-27
67. Nudo RJ, Masterton RB. 1990a. Descending pathways to the spinal cord, III: sites of origin of the corticospinal tract. J. Comp. Neurol. 296:559-83
68. Nudo RJ, Masterton RB. 1990b. Descending pathways to the spinal cord, IV: some factors related to the amount of cortex devoted to the corticospinal tract. J. Comp. Neurol. 296:584-97
69. Nudo RJ, Sutherland DP, Masterton RB. 1995. Variation and evolution of mammalian corticospinal somata with special reference to primates. J. Comp. Neurol. 358:181-205
70. Paninski L, Pillow J, Lewi J. 2007. Statistical models for neural encoding, decoding, and optimal stimulus design. Prog. Brain Res. 165:493-507
71. Patterson WR, Song YK, Bull CW, Ozden I, Deangellis AP, et al. 2004. A microelectrode/microelectronic hybrid device for brain implantable neuroprosthesis applications. IEEE Trans. Biomed. Eng. 51:1845-53
72. Peckham PH, Kilgore KL, Keith MW, Bryden AM, Bhadra N, Montague FW. 2002. An advanced neuroprosthesis for restoration of hand and upper arm control using an implantable controller. J. Hand Surg. [Am.] 27:265-76
73. Pesaran B, Pezaris JS, Sahani M, Mitra PP, Andersen RA. 2002.Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nat. Neurosci. 5:805-11
74. Phillips CA. 1988. Sensory feedback control of upper- and lower-extremity motor prostheses. Crit. Rev. Biomed. Eng. 16:105-40
75. Pohlmeyer EA, Solla SA, Perreault EJ, Miller LE. 2007. Prediction of upper limb muscle activity from motor cortical discharge during reaching. J. Neural. Eng. 4:369-79
76. Rizk M, Obeid I, Callender SH, Wolf PD. 2007. A single-chip signal processing and telemetry engine for an implantable 96-channel neural data acquisition system. J. Neural. Eng. 4:309-21
77. Romo R, Hernandez A, Zainos A, Salinas E. 1998. Somatosensory discrimination based on cortical microstimulation. Nature 392:387-90
78. Sainburg RL, Ghilardi MF, Poizner H, Ghez C. 1995. Control of limb dynamics in normal subjects and patients without proprioception. J. Neurophysiol. 73:820-35
79. Sainburg RL, Poizner H, Ghez C. 1993. Loss of proprioception produces deficits in interjoint coordination. J. Neurophysiol. 70:2136-47
80. Sanes JN, Mauritz KH, Dalakas MC, Evarts EV. 1985. Motor control in humans with large-fiber sensory neuropathy. Hum. Neurobiol. 4:101-14
81. Sanes JN, Suner S, Donoghue JP. 1990. Dynamic organization of primary motor cortex output to target muscles in adult rats. I. Long-term patterns of reorganization following motor or mixed peripheral nerve lesions. Exp. Brain Res. 79:479-91
82. Sanger TD. 1996. Probability density estimation for the interpretation of neural population codes. J. Neurophysiol. 76:2790-93
83. Sanger TD. 2003. Neural population codes. Curr. Opin. Neurobiol. 13:238-49
84. Santello M. 2002. Kinematic synergies for the control of hand shape. Arch. Ital. Biol. 140:221-28
85. Santhanam G, Linderman MD, Gilja V, Afshar A, Ryu SI, et al. 2007. HermesB: a continuous neural recording system for freely behaving primates. IEEE Trans. Biomed. Eng. 54:2037-50
86. Santhanam G, Ryu SI, Yu BM, Afshar A, Shenoy KV. 2006. A high-performance brain-computer interface. Nature 442:195-98
87. Santucci DM, Kralik JD, Lebedev MA, Nicolelis MA. 2005. Frontal and parietal cortical ensembles predict single-trial muscle activity during reaching movements in primates. Eur. J. Neurosci. 22:1529-40
88. Schieber MH. 1991. Individuated finger movements of rhesus monkeys: a means of quantifying the independence of the digits. J. Neurophysiol. 65:1381-91
89. Sergio LE, Hamel-Paquet C, Kalaska JF. 2005. Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. J. Neurophysiol. 94:2353-78
90. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP. 2002. Instant neural control of a movement signal. Nature 416:141-42
91. Shannon GF. 1976. Acomparison of alternative means of providing sensory feedback on upper limb prostheses. Med. Biol. Eng. 14:289-94
92. Shannon GF. 1979. A myoelectrically-controlled prosthesis with sensory feedback. Med. Biol. Eng. Comput. 17:73-80
93. Shoham S, Halgren E, Maynard EM, Normann RA. 2001. Motor-cortical activity in tetraplegics. Nature 413:793
94. Shoham S, Paninski LM, Fellows MR, Hatsopoulos NG, Donoghue JP, Normann RA. 2005. Statistical encoding model for a primary motor cortical brain-machine interface. IEEE Trans. Biomed. Eng. 52:1312-22
95. Simpson DC. 1973. The control and supply of a multimovement externally powered upper limb prosthesis. Presented at Proc. Int. Symp. Extern. Control Hum. Extrem., 4th, Belgrade
96. Simpson DC. 1974. The choice of control system for the multimovement prosthesis: extended physiological proprioception (EPP). In The Control of Upper-Extremity Prostheses and Orthoses, ed. PHerberts, pp. 146-50. Springfield, IL: Thomas
97. Sinkjaer T, Haugland M, Inmann A, Hansen M, Nielsen KD. 2003. Biopotentials as command and feedback signals in functional electrical stimulation systems. Med. Eng. Phys. 25:29-40
98. Smith AM, Hepp-Reymond MC, Wyss UR. 1975. Relation of activity in precentral cortical neurons to force and rate of force change during isometric contractions of finger muscles. Exp. Brain Res. 23:315-32
99. Song YK, Patterson WR, Bull CW, Beals J, Hwang N, et al. 2005. Development of a chipscale integrated microelectrode/microelectronic device for brain implantable neuroengineering applications. IEEE Trans. Neural. Syst. Rehabil. Eng. 13:220-26
100. Suner S, Fellows MR, Vargas-Irwin C, Nakata GK, Donoghue JP. 2005. Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex. IEEETrans. Neural. Syst. Rehabil. Eng. 13:524-41
101. Taira M, Boline J, Smyrnis N, Georgopoulos AP, Ashe J. 1996. On the relations between single cell activity in the motor cortex and the direction and magnitude of three-dimensional static isometric force. Exp. Brain Res. 109:367-76
102. Taylor DM, Tillery SI, Schwartz AB. 2002. Direct cortical control of 3D neuroprosthetic devices. Science 296:1829-32
103. Tkach D, Reimer J, Hatsopoulos NG. 2007. Congruent activity during action and action observation in motor cortex. J. Neurosci. 27:13241-50
104. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB. 2008. Cortical control of a prosthetic arm for self-feeding. Nature 453:1098-101
105. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, et al. 2000. Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408:361-65
106. Westwick DT, Pohlmeyer EA, Solla SA, Miller LE, Perreault EJ. 2006. Identification of multiple-input systems with highly coupled inputs: application to EMG prediction from multiple intracortical electrodes. Neural. Comput. 18:329-55
107. Wiener MC, Richmond BJ. 2002. Model based decoding of spike trains. Biosystems 67:295-300
108. Wilson BS, Dorman MF. 2008. Cochlear implants: a remarkable past and a brilliant future. Hear. Res. 242:3-21
109. Wolpaw JR, McFarland DJ. 2004. Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. USA 101:17849-54
110. Wu W, Gao Y, Bienenstock E, Donoghue JP, Black MJ. 2006. Bayesian population decoding of motor cortical activity using a Kalman filter. Neural. Comput. 18:80-118
111. Wu W, Hatsopoulos NG. 2008. Real-time decoding of nonstationary neural activity in motor cortex. IEEE Trans. Neural. Syst. Rehabil. Eng. 16:213-22
112. Zacksenhouse M, Lebedev MA, Carmena JM, O'Doherty JE, Henriquez C, Nicolelis MA. 2007. Cortical modulations increase in early sessions with brain-machine interface. PLoS ONE 2:e619