Selecting the signals for a brain-machine interface

Current Opinion in Neurobiology

Volumn 14, Issue 6, 2004, Pages 720-726

  Andersen, Richard A ^a   Musallam, Sam ^a   Pesaran, Bijan ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN REGION; ELECTRIC POTENTIAL; ELECTROENCEPHALOGRAPHY; HUMAN; HUMAN COMPUTER INTERACTION; MACHINE; MOTOR CORTEX; NERVE CELL; PRIORITY JOURNAL; PROSTHESIS; REVIEW; SPIKE WAVE; VISUAL CORTEX;

ACTION POTENTIALS; ANIMALS; BRAIN; HUMANS; NEURONS; PARALYSIS; PROSTHESES AND IMPLANTS; ROBOTICS; SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 9644270644     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2004.10.005     Document Type: Review

References (47)

1. G.E. Loeb Cochlear prosthetics Annu Rev Neurosci 13 1990 357 371
2. M.M. Merzenich Coding of sound in a cochlear prosthesis: some theoretical and practical considerations Ann N Y Acad Sci 405 1983 502 508
3. K.A. Follett The surgical treatment of Parkinson's disease Annu Rev Med 51 2000 135 147
4. M.D. Serruya, N.G. Hatsopoulos, L. Paninski, M.R. Fellows, and J.P. Donoghue Instant neural control of a movement signal Nature 416 2002 141 142
5. J.M. Carmena, M.A. Lebedev, R.E. Crist, J.E. O'Doherty, D.M. Santucci, D. Dimitrov, P.G. Patil, C.S. Henriquez, and M.A. Nicolelis Learning to control a brain-machine interface for reaching and grasping by primates PLoS Biol 1 2003 E42 This study provided the first demonstration of simultaneous decoding of grasp and trajectory. Using a joystick, monkeys implanted with multielectrode arrays were trained to move a small dot toward a target on a computer screen. Once the target was reached, monkeys were expected to squeeze the lever to adjust the size of the dot to match the size of the target. The authors then removed the lever and the monkeys were still able to perform the task using brain control with considerable success.
6. D.M. Taylor, S.I. Tillery, and A.B. Schwartz Direct cortical control of 3D neuroprosthetic devices Science 296 2002 1829 1832
7. P.R. Kennedy, and R.A. Bakay Restoration of neural output from a paralyzed patient by a direct brain connection Neuroreport 9 1998 1707 1711
8. S. Musallam, B.D. Corneil, B. Greger, H. Scherberger, and R.A. Andersen Cognitive control signals for neural prosthetics Science 305 2004 258 262 This study provided the first demonstration of the feasibility of utilizing high-level cognitive signals from the parietal and premotor cortex for driving a neural prosthetic. Using neural activity during the brain control trials, the investigators were able to decode the intended goals of three monkeys. The investigators were also able to decode the expected value of the reward and showed that increasing the reward can improve the decoding of the goals.
9. J.R. Wolpaw, N. Birbaumer, D.J. McFarland, G. Pfurtscheller, and T.M. Vaughan Brain-computer interfaces for communication and control Clin Neurophysiol 113 2002 767 791
10. F.A. Mussa-Ivaldi, and L.E. Miller Brain-machine interfaces: computational demands and clinical needs meet basic neuroscience Trends Neurosci 26 2003 329 334 The authors provide a review of the current status and techniques used to build a brain-machine interface. They also review attempts to induce controlled plastic changes in the brain, and stress the importance of feedback and plasticity for the successful construction of a brain-computer interface.
11. B. Pesaran, J. Pezaris, M. Sahani, P.M. Mitra, and R.A. Andersen Temporal structure in neuronal activity during working memory in macaque parietal cortex Nat Neurosci 5 2002 805 811
12. C. Mehring, J. Rickert, E. Vaadia, S. Cardosa de Oliveira, A. Aertsen, and S. Rotter Inference of hand movements from local field potentials in monkey motor cortex Nat Neurosci 6 2003 1253 1254 The authors provide additional evidence (see Pesaran [11]) for the usefulness of LFPs for neural prosthetic applications. They show that hand movement position and velocity can be decoded from the motor cortex using LFPs with similar accuracy to spikes. However, the best decode result was obtained by combining LFPs with spikes.
13. E.C. Leuthardt, G. Schalk, J.R. Wolpaw, J.G. Ojemann, and D.W. Moran A brain-computer interface using electrocorticographic signals in humans J Neural Eng 1 2004 63
14. U. Mitzdorf Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena Physiol Rev 65 1985 37 100
15. N.K. Logothetis The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal Philos Trans R Soc Lond B Biol Sci 357 2002 1003 1037
16. G. Blatt, R.A. Andersen, and G. Stoner Visual receptive field organization and cortico-cortical connections of area LIP in the macaque J Comp Neurol 299 1990 421 445
17. P.B. Johnson, S. Ferraina, L. Bianchi, and R. Caminiti Cortical networks for visual reaching: physiological and anatomical organization of frontal and parietal lobe arm regions Cereb Cortex 6 1996 102 119
18. J.W. Gnadt, and R.A. Andersen Memory related motor planning activity in posterior parietal cortex of macaque Exp Brain Res 70 1988 216 220
19. L.H. Snyder, A.P. Batista, and R.A. Andersen Coding of intention in the posterior parietal cortex Nature 386 1997 167 170
20. H. Sakata, M. Taira, A. Murata, and S. Mine Neural mechanisms of visual guidance of hand action in the parietal cortex of the monkey Cereb Cortex 5 1995 429 438
21. A.P. Batista, C.A. Buneo, L.H. Snyder, and R.A. Andersen Reach plans in eye-centered coordinates Science 285 1999 257 260
22. J.D. Connolly, R.A. Andersen, and M.A. Goodale FMRI evidence for a 'parietal reach region' in the human brain Exp Brain Res 153 2003 140 145
23. W.P. Medendorp, H.C. Goltz, T. Vilis, and J.D. Crawford Gaze-centered updating of visual space in human parietal cortex J Neurosci 23 2003 6209 6214
24. D.J. Crammond, and J.F. Kalaska Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility J Neurophysiol 71 1994 1281 1284
25. D. Boussaoud, and F. Bremmer Gaze effects in the cerebral cortex: reference frames for space coding and action Exp Brain Res 128 1999 170 180
26. S. Kakei, D.S. Hoffman, and P.L. Strick Sensorimotor transformations in cortical motor areas Neurosci Res 46 2003 1 10
27. N. Hatsopoulos, J. Joshi, and J.G. O'Leary Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles J Neurophysiol 92 2004 1165 1174 This study compared decodes using activity from simultaneous recordings in the primary motor cortex (M1) and PMd. A functional difference was found between the two areas, with M1 predicting continuous movement trajectories more effectively than the PMd, and PMd predicting discrete movement goals more effectively than M1. This distinction supports a hierarchical view of motor control which will be useful for designing a brain-machine interface using activity from multiple cortical areas.
28. K.V. Shenoy, D. Meeker, S.Y. Cao, S.A. Kureshi, B. Pesaran, C.A. Buneo, A.P. Batista, P.P. Mitra, J.W. Burdick, and R.A. Andersen Neural prosthetic control signals from plan activity Neuroreport 14 2003 591 596
29. A.P. Batista, and R.A. Andersen The parietal reach region codes the next planned movement in a sequential reach task J Neurophysiol 85 2001 539 544
30. Y.E. Cohen, A.P. Batista, and R.A. Andersen Comparison of neural activity preceding reaches to auditory and visual stimuli in the parietal reach region Neuroreport 13 2002 891 894
31. D.P. Carey Eye-hand coordination: eye to hand or hand to eye? Curr Biol 10 2000 R416 R419
32. W. Schultz Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology Curr Opin Neurobiol 14 2004 139 147 This review is a survey of the cortical and subcortical brain structures whose neurons represent reward-related information. The author proposes that dopaminergic neurons in subcortical structures detect rewards and pass this information on to cortical structures, such as the prefrontal and possibly parietal cortex, to guide decision making. Ideas about the coding of reward are placed in a wider psychological and economic context.
33. M.L. Platt, and P.W. Glimcher Neural correlates of decision variables in parietal cortex Nature 400 1999 233 238
34. L.P. Sugrue, G.S. Corrado, and W.T. Newsome Matching behavior and the representation of value in the parietal cortex Science 304 2004 1782 1787
35. M.R. Roesch, and C.R. Olson Neuronal activity related to reward value and motivation in primate frontal cortex Science 304 2004 307 310
36. D.H. Szarowski, M.D. Andersen, S. Retterer, A.J. Spence, M. Isaacson, H.G. Craighead, J.N. Turner, and W. Shain Brain responses to micro-machined silicon devices Brain Res 983 2003 23 35
37. R.J. Vetter, J.C. Williams, J.F. Hetke, E.A. Nunamaker, and D.R. Kipke Chronic neural recording using silicon-substrate microelectrode arrays implanted in cerebral cortex IEEE Trans Biomed Eng 51 2004 896 904
38. P.R. Kennedy The cone electrode: a long-term electrode that records from neurites grown onto its recording surface J Neurosci Methods 29 1989 181 193
39. M.A. Nicolelis, D. Dimitrov, J.M. Carmena, R. Crist, G. Lehew, J.D. Kralik, and S.P. Wise Chronic, multisite, multielectrode recordings in macaque monkeys Proc Natl Acad Sci USA 100 2003 11041 11046
40. J.S. Pezaris, M. Sahani, and R.A. Andersen Extracellular recording from multiple neighboring cells: response properties in parietal cortex J.M. Bower Computational Neuroscience: Trends in Research 1998 Plenum Press New York
41. H. Scherberger, C.A. Buneo, M. Jarvis, and R.A. Andersen Local field potential tuning in the macaque posterior parietal cortex during arm-reaching movements Soc Neurosci Abstr 2003 279.16
42. P. Kennedy, D. Andreasen, P. Ehirim, B. King, T. Kirby, H. Mao, and M. Moore Using human extra-cortical local field potentials to control a switch J Neural Eng 1 2004 72 77
43. P.G. Patil, J.M. Carmena, M.A. Nicolelis, and D.A. Turner Ensemble recordings of human subcortical neurons as a source of motor control signals for a brain-machine interface Neurosurgery 55 2004 27 35 discussion 35-38
44. J. Wessberg, C.R. Stambaugh, J.D. Kralik, P.D. Beck, M. Laubach, J.K. Chapin, J. Kim, J. Biggs, M.A. Srinivasan, and M.A.L. Nicolelis Real-time prediction of hand trajectory by ensembles of cortical neurons in primates Nature 408 2000 361 365
45. E.E. Fetz Operant conditioning of cortical unit activity Science 163 1969 955 958
46. S.M. Kosslyn, C.F. Chabris, C.J. Marsolek, and O. Koenig Categorical versus coordinate spatial relations: computational analyses and computer simulations J Exp Psychol Hum Percept Perform 18 1992 562 577
47. P. Fries, J.H. Reynolds, A.E. Rorie, and R. Desimone Modulation of oscillatory neuronal synchronization by selective visual attention Science 291 2001 1560 1563