Incorporating feedback from multiple sensory modalities enhances brain-machine interface control

Journal of Neuroscience

Volumn 30, Issue 50, 2010, Pages 16777-16787

  Suminski, Aaron J ^a   Tkach, Dennis C ^b   Fagg, Andrew H ^c   Hatsopoulos, Nicholas G ^a,b  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c University of Oklahoma   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BRAIN COMPUTER INTERFACE; EXPERIMENTAL MONKEY; FEEDBACK SYSTEM; MALE; MOTOR CORTEX; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; PROPRIOCEPTION; SPIKE WAVE; TASK PERFORMANCE;

ANIMALS; ARM; FEEDBACK, SENSORY; KINESTHESIS; MACACA MULATTA; MALE; MOTOR CORTEX; MOVEMENT; NEURONS; REACTION TIME; ROBOTICS; USER-COMPUTER INTERFACE;

EID: 78650352893     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3967-10.2010     Document Type: Article

References (47)

1. Abbott A (2006) Neuroprosthetics: in search of the sixth sense. Nature 442:125-127.
2. Bjèorck ê (1996) Numerical methods for least squares problems. Philadelphia: SIAM.
3. Bosco G, Poppele RE (2001) Proprioception from a spinocerebellar perspective. Physiol Rev 81:539-568.
4. Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, Dimitrov DF, Patil PG, Henriquez CS, Nicolelis MA (2003) Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol 1:E42.
5. Childress DS (1980) Closed-loop control in prosthetic systems: historical perspective. Ann Biomed Eng 8:293-303. (Pubitemid 11064542)
6. Conrad B, Meyer-Lohmann J, Matsunami K, Brooks VB (1975) Precentral unit activity following torque pulse injections into elbow movements. Brain Res 94:219-236.
7. Evarts EV, Fromm C (1977) Sensory responses in motor cortex neurons during precise motor control. Neurosci Lett 5:267-272.
8. Fagg AH, Ojakangas GW, Miller LE, Hatsopoulos NG (2009) Kinetic trajectory decoding using motor cortical ensembles. IEEE Trans Neural Syst Rehabil Eng 17:487-496.
9. Fetz EE, Finocchio DV, Baker MA, Soso MJ (1980) Sensory and motor responses of precentral cortex cells during comparable passive and active joint movements. J Neurophysiol 43:1070-1089.
10. Fitzsimmons NA, Drake W, Hanson TL, Lebedev MA, Nicolelis MA (2007) Primate reaching cued by multichannel spatiotemporal cortical microstimulation. J Neurosci 27:5593-5602.
11. Ganguly K, Carmena JM (2009) Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol 7:e1000153.
12. Ghez C, Gordon J, Ghilardi MF (1995) Impairments of reaching movements in patients without proprioception. II. Effects of visual information on accuracy. J Neurophysiol 73:361-372.
13. Gordon J, Ghilardi MF, Ghez C (1995) Impairment of reaching movements in patients without proprioception. I. Spatial errors. J Neurophysiol 73:347-360.
14. Hastie T, Tibshirani R, Friedman JH (2001) The elements of statistical learning: data mining, inference, and prediction: with 200 full-color illustrations. New York: Springer.
15. Hatsopoulos NG, Donoghue JP (2009) The science of neural interface systems. Annu Rev Neurosci 32:249-266.
16. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP (2006) Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442:164-171. (Pubitemid 44086558)
17. Huntley GW, Jones EG (1991) Relationship of intrinsic connections to forelimb movement representations in monkey motor cortex: a correlative anatomic and physiological study. J Neurophysiol 66:390-413.
18. Johnson EO, Babis GC, Soultanis KC, Soucacos PN (2008) Functional neuroanatomy of proprioception. J Surg Orthop Adv 17:159-164.
19. Kennedy P, Andreasen D, Ehirim P, King B, Kirby T, Mao H, Moore M (2004) Using human extra-cortical local field potentials to control a switch. J Neural Eng 1:72-77. (Pubitemid 41079660)
20. Kiguchi K, Esaki R, Fukuda T (2005) Development of a wearable exoskeleton for daily forearm motion assist. Adv Robot 19:751-771.
21. Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Black MJ (2008) Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J Neural Eng 5:455-476.
22. Lemon RN, Hanby JA, Porter R (1976) Relationship between the activity of precentral neurones during active and passive movements in conscious monkeys. Proc R Soc Lond B Biol Sci 194:341-373.
23. London BM, Jordan LR, Jackson CR, Miller LE (2008) Electrical stimulation of the proprioceptive cortex (area 3a) used to instruct a behaving monkey. IEEE Trans Neural Syst Rehabil Eng 16:32-36.
24. Maynard EM, Hatsopoulos NG, Ojakangas CL, Acuna BD, Sanes JN, Normann RA, Donoghue JP (1999) Neuronal interactions improve cortical population coding of movement direction. J Neurosci 19:8083-8093.
25. Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82:2676-2692.
26. Moritz CT, Perlmutter SI, Fetz EE (2008) Direct control of paralysed muscles by cortical neurons. Nature 456:639-642.
27. Mulliken GH, Musallam S, Andersen RA (2008) Decoding trajectories from posterior parietal cortex ensembles. J Neurosci 28:12913-12926.
28. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA (2004) Cognitive control signals for neural prosthetics. Science 305:258-262.
29. Nicolelis MA, Dimitrov D, Carmena JM, Crist R, Lehew G, Kralik JD, Wise SP (2003) Chronic, multisite, multielectrode recordings in macaque monkeys. Proc Natl Acad Sci U S A 100:11041-11046. (Pubitemid 37140149)
30. Paninski L, Fellows MR, Hatsopoulos NG, Donoghue JP (2004) Spatiotemporal tuning of motor cortical neurons for hand position and velocity. J Neurophysiol 91:515-532. (Pubitemid 38084391)
31. Pohlmeyer EA, Oby ER, Perreault EJ, Solla SA, Kilgore KL, Kirsch RF, Miller LE (2009) Toward the restoration of hand use to a paralyzed monkey: brain-controlled functional electrical stimulation of forearm muscles. PLoS One 4:e5924.
32. Rocon E, Belda-Lois JM, Ruiz AF, Manto M, Moreno JC, Pons JL (2007) Design and validation of a rehabilitation robotic exoskeleton for tremor assessment and suppression. IEEE Trans Neural Syst Rehabil Eng 15:367-378. (Pubitemid 47460420)
33. Rossetti Y, Desmurget M, Prablanc C (1995) Vectorial coding of movement: vision, proprioception, or both? J Neurophysiol 74:457-463.
34. Sainburg RL, Ghilardi MF, Poizner H, Ghez C (1995) Control of limb dynamics in normal subjects and patients without proprioception. J Neurophysiol 73:820-835.
35. Scott SH (1999) Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching. J Neurosci Methods 89:119-127.
36. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP (2002) Instant neural control of a movement signal. Nature 416:141-142. (Pubitemid 34246464)
37. Sober SJ, Sabes PN (2005) Flexible strategies for sensory integration during motor planning. Nat Neurosci 8:490-497.
38. Suminski AJ, Rao SM, Mosier KM, Scheidt RA (2007) Neural and electromyographic correlates of wrist posture control. J Neurophysiol 97:1527-1545. (Pubitemid 46239526)
39. Suminski AJ, Tkach DC, Hatsopoulos NG (2009) Exploiting multiple sensory modalities in brain-machine interfaces. Neural Netw 22:1224-1234.
40. Taylor DM, Tillery SI, Schwartz AB (2002) Direct cortical control of 3D neuroprosthetic devices. Science 296:1829-1832.
41. Thoroughman KA, Shadmehr R (1999) Electromyographic correlates of learning an internal model of reaching movements. J Neurosci 19:8573-8588.
42. Tkach D, Reimer J, Hatsopoulos NG (2007) Congruent activity during action and action observation in motor cortex. J Neurosci 27:13241-13250.
43. van Beers RJ, Sittig AC, Gon JJ (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81:1355-1364.
44. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB (2008) Cortical control of a prosthetic arm for self-feeding. Nature 453:1098-1101.
45. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, Chapin JK, Kim J, Biggs SJ, Srinivasan MA, Nicolelis MA (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408:361-365.
46. Wolpert DM, Ghahramani Z (2000) Computational principles of movement neuroscience. Nat Neurosci 3 [Suppl]:1212-1217.
47. Yu BM, Cunningham JP, Santhanam G, Ryu SI, Shenoy KV, Sahani M (2009) Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J Neurophysiol 102:614-635.