A recurrent neural network for closed-loop intracortical brain-machine interface decoders

Journal of Neural Engineering

Volumn 9, Issue 2, 2012, Pages

  Sussillo, David ^a,b   Nuyujukian, Paul ^a,b   Fan, Joline M ^a   Kao, Jonathan C ^a   Stavisky, Sergey D ^b   Ryu, Stephen ^a,c   Shenoy, Krishna ^a,b  

^a Stanford University   (United States)

^b STANFORD UNIVERSITY   (United States)

^c PALO ALTO MEDICAL FOUNDATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MACHINE INTERFACE; CLOSED LOOPS; CLOSED-LOOP; ERROR LEARNING; FIRST ORDER; HAND MOVEMENT; INTERNAL WEIGHTS; NON-LINEAR RELATIONSHIPS; STATE-OF-THE-ART METHODS; TEMPORAL DEPENDENCE; TIME-SERIES DATA;

RECURRENT NEURAL NETWORKS;

BRAIN;

ANIMAL EXPERIMENT; ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN COMPUTER INTERFACE; CONTROLLED STUDY; DYNAMICS; ECHOSTATE NETWORK; FILTER; FORCE DECODER; HAND MOVEMENT; MACHINE LEARNING; MALE; NONHUMAN; PRIORITY JOURNAL; RECURRENT NEURAL NETWORK; TASK PERFORMANCE; VELOCITY; ALGORITHM; ANIMAL; ARM; ARTIFICIAL INTELLIGENCE; BIOMECHANICS; BRAIN CORTEX; COMPUTER INTERFACE; COMPUTER PROGRAM; COMPUTER SYSTEM; HAND; MACACA MULATTA; NEUROPROSTHESIS; NORMAL DISTRIBUTION; PHYSIOLOGY; PROSTHESIS; PSYCHOMOTOR PERFORMANCE; STATISTICAL MODEL;

ALGORITHMS; ANIMALS; ARM; ARTIFICIAL INTELLIGENCE; BIOMECHANICS; CEREBRAL CORTEX; COMPUTER SYSTEMS; HAND; LINEAR MODELS; MACACA MULATTA; MALE; NEURAL NETWORKS (COMPUTER); NEURAL PROSTHESES; NORMAL DISTRIBUTION; PROSTHESIS DESIGN; PSYCHOMOTOR PERFORMANCE; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 84859127815     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/9/2/026027     Document Type: Article

References (51)

1. Serruya M D, Hatsopoulos N G, Paninski L, Fellows M R and Donoghue J P 2002 Instant neural control of a movement signal Nature 416 141-2 (Pubitemid 34246464)
2. Taylor D M, Tillery S I H and Schwartz A B 2002 Direct cortical control of 3D neuroprosthetic devices Science 296 1829-32 (Pubitemid 34596262)
3. Carmena J M, Lebedev M A, Crist R E, O'Doherty J E, Santucci D M, Dimitrov D F, Patil P G, Henriquez C S and Nicolelis M A L 2003 Learning to control a brain-machine interface for reaching and grasping by primates PLoS Biol. 1 E42
4. Velliste M, Perel S, Spalding M C, Whitford A S and Schwartz A B 2008 Cortical control of a prosthetic arm for self-feeding Nature 453 1098-101 (Pubitemid 351871735)
5. Mulliken G H, Musallam S and Andersen R A 2008 Decoding trajectories from posterior parietal cortex ensembles J. Neurosci. 28 12913-26
6. Shpigelman L, Lalazar H and Vaadia E 2009 Kernel-ARMA for hand tracking and brain-machine interfacing during 3D motor control Adv. Neural Inform. Process. Syst. 21 1489-96
7. Ganguly K and Carmena J M 2009 Emergence of a stable cortical map for neuroprosthetic control PLoS Biol. 7 e1000153
8. Suminski A J, Tkach D C, Fagg A H and Hatsopoulos N G 2010 Incorporating feedback from multiple sensory modalities enhances brain-machine interface control J. Neurosci. 30 16777-87
9. Hochberg L R, Serruya M D, Friehs G M, Mukand J A, Saleh M, Caplan A H, Branner A, Chen D, Penn R D and Donoghue J P 2006 Neuronal ensemble control of prosthetic devices by a human with tetraplegia Nature 442 164-71 (Pubitemid 44086558)
10. Kim S-P, Simeral J D, Hochberg L R, Donoghue J P, Friehs G M and Black M J 2011 Point-and-click cursor control with an intracortical neural interface system by humans with tetraplegia IEEE Trans. Neural Syst. Rehabil. Eng. 19 193-203
11. Kim S-P, Simeral J D, Hochberg L R, Donoghue J P and Black M J 2008 Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia J. Neural Eng. 5 455-76
12. Graziano M S A 2011 New insights into motor cortex Neuron 71 387-8
13. Kalaska J F 2009 From intention to action: motor cortex and the control of reaching movements Adv. Exp. Med. Biol. 629 139-78
14. Churchland M M and Shenoy K V 2007 Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex J. Neurophysiol. 97 4235-57
15. Scott S H 2004 Optimal feedback control and the neural basis of volitional motor control Nat. Rev. Neurosci. 5 532-46
16. Churchland M M, Cunningham J P, Kaufman M T, Ryu S I and Shenoy K V 2010 Cortical preparatory activity: representation of movement or first cog in a dynamical machine? Neuron 68 387-400
17. Afshar A, Santhanam G, Byron M Y, Ryu S I, Sahani M and Shenoy K V 2011 Single-trial neural correlates of arm movement preparation Neuron 71 555-64
18. Scott S H 2008 Inconvenient truths about neural processing in primary motor cortex J. Physiol. 586 1217-24 (Pubitemid 351321261)
19. Bishop C M 2006 Pattern Recognition and Machine Learning (Berlin: Springer)
20. Taylor G, Hinton G and Roweis S 2007 Modeling human motion using binary latent variables Adv. Neural Inform. Process. Syst. 19 1345-52
21. Chapin J K, Moxon K A, Markowitz R S and Nicolelis M A 1999 Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex Nature Neurosci. 2 664-70 (Pubitemid 30491219)
22. Wessberg J, Stambaugh C R, Kralik J D, Beck P D, Laubach M, Chapin J K, Kim J, Biggs S J, Srinivasan M A and Nicolelis M A 2000 Real-time prediction of hand trajectory by ensembles of cortical neurons in primates Nature 408 361-5
23. Rumelhart D, Hinton G and Williams R 1985 Learning internal representations by error propagation Parallel Distrib. Process. 1 319-62
24. Williams R and Zipser D 1989 A learning algorithm for continually running fully recurrent neural networks Neural Comput. 1 270-80
25. Doya K 1992 Bifurcations in the learning of recurrent neural networks Proc. IEEE Int. Symp. Circuits and Systems: ISCAS '92 6 2777-80
26. Bengio Y, Simard P and Frasconi P 1994 Learning long-term dependencies with gradient descent is difficult IEEE Trans. Neural Netw. 5 157-66
27. Fetz E E 1999 Real-time control of a robotic arm by neuronal ensembles Nature Neurosci. 2 583-4 (Pubitemid 30491202)
28. Fetz E 1992 Are movement parameters recognizably coded in the activity of single neurons? Behav. Brain Sci. 15 679-90
29. Maier M A, Shupe L E and Fetz E E 2003 Recurrent neural networks of integrate-and-fire cells simulating short-term memory and wrist movement tasks derived from continuous dynamic networks J. Physiol. Paris 97 601-12 (Pubitemid 38447005)
30. Maier M A, Shupe L E and Fetz E E 2005 Dynamic neural network models of the premotoneuronal circuitry controlling wrist movements in primates J. Comput. Neurosci. 19 125-46 (Pubitemid 41236296)
31. Jaeger H and Haas H 2004 Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication Science 304 78-80 (Pubitemid 38455427)
32. Sussillo D and Abbott L F 2009 Generating coherent patterns of activity from chaotic neural networks Neuron 63 544-57
33. Sanchez J C, Erdogmus D, Nicolelis M A L, Wessberg J and Principe J C 2005 Interpreting spatial and temporal neural activity through a recurrent neural network brain-machine interface IEEE Trans. Neural Syst. Rehabil. Eng. 13 213-9 (Pubitemid 41017710)
34. Gunduz A, Sanchez J C, Carney P R and Principe J C 2009 Mapping broadband electrocorticographic recordings to two-dimensional hand trajectories in humans motor control features Neural Netw. 22 1257-70
35. Cunningham J P, Nuyujukian P, Gilja V, Chestek C A, Ryu S I and Shenoy K V 2011 A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces J. Neurophys. 105 1932-49
36. Chestek C A 2011 Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex J. Neural Eng. 8 045005
37. Santhanam G, Ryu S I, Byron M Y, Afshar A and Shenoy K V et al 2006 A high-performance brain-computer interface Nature 442 195-8 (Pubitemid 44086565)
38. Ryu S I and Shenoy K V 2009 Human cortical prostheses: lost in translation? Neurosurg. Focus 27 5
39. Churchland M M, Byron M Y, Sahani M and Shenoy K V 2007 Techniques for extracting single-trial activity patterns from large-scale neural recordings Curr. Opin. Neurobiol. 17 609-18
40. Haykin S 2001 Adaptive Filter Theory 4th edn (Englewood Cliffs, NJ: Prentice-Hall)
41. Simeral J D, Kim S P, Black M J, Donoghue J and Hochberg L 2011 Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array J. Neural Eng. 8 025027
42. Nuyujukian P, Fan J M, Kao J C, Ryu S I and Shenoy K V 2011 Towards robust performance and streamlined training of cortically-controlled brain-machine interfaces Program No 142.02: Neuroscience Meeting Planner (Washington, DC: Society for Neuroscience)
43. Gilja V, Nuyujukian P, Chestek C A, Cunningham J P, Fan J M, Yu B M, Ryu S I and Shenoy K V 2010 A high-performance continuous cortically-controlled prosthesis enabled by feedback control design Program No 20.7.2010: Neuroscience Meeting Planner
44. Nuyujukian P, Gilja V, Chestek C A, Cunningham J P, Fan J M, Yu B M, Ryu S I and Shenoy K V 2010 Generalization and robustness of a continuous cortically-controlled prosthesis enabled by feedback control design Program No 20.7.2010: Neuroscience Meeting Planner (San Diego, CA: Society for Neuroscience)
45. Gilja V, Nuyujukian P, Chestek C A, Cunningham J P, Yu B M, Ryu S I and Shenoy K V 2010 High-performance continuous neural cursor control enabled by a feedback control perspective Computational and Systems Neuroscience (COSYNE). Frontiers in Neuroscience: Conference Abstract (Salt Lake City, UT)
46. Martens J and Sutskever I 2011 Learning recurrent neural networks with Hessian-free optimization Proc. 28th Int. Conf. on Machine Learning
47. Nurmikko A V et al 2010 Listening to brain microcircuits for interfacing with external world-progress in wireless implantable microelectronic neuroengineering devices: experimental systems are described for electrical recording in the brain using multiple microelectrodes and short range implantable or wearable broadcasting units Proc. IEEE. Inst. Electr. Electr. Eng. 98 375-88
48. Boahen K 2005 Neuromorphic microchips Sci. Am. 292 56-63 (Pubitemid 40642915)
49. Arthur J V and Kwabena B A 2011 Silicon-neuron design: a dynamical systems approach IEEE Trans. Circuits Syst. 58 1034-43
50. Dethier J, Nuyujukian P, Eliasmith C, Stewart T, Elasaad S and Shenoy K V 2011 A brain-machine interface operating with a real-time spiking neural network control algorithm Advances in Neural Information Processing Systems (NIPS) vol 24 (Cambridge, MA: MIT Press) http://hdl.handle.net/2268/100574
51. Dethier J, Gilja V, Nuyujukian P, Elassaad S, Shenoy K V and Boahen K 2011 Spiking neural network decoder for brain-machine interfaces 5th Int. IEEE EMBS Conf. on Neural Engineering