A symbiotic brain-machine interface through value-based decision making

PLoS ONE

Volumn 6, Issue 3, 2011, Pages

  Mahmoudi, Babak ^a   Sanchez, Justin C ^a  

^a University of Miami College of Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTIC METHOD; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARCHITECTURE; ARTICLE; BRAIN COMPUTER INTERFACE; CONTROLLED STUDY; DECISION MAKING; ELECTROENCEPHALOGRAM; FEEDBACK SYSTEM; LEARNING ALGORITHM; MALE; NEUROPHYSIOLOGY; NONHUMAN; NUCLEUS ACCUMBENS; PERCEPTION ACTION REWARD CYCLE; PRIMARY MOTOR CORTEX; RAT; REWARD; ROBOTICS; SIGNAL PROCESSING; SYMBIOTIC BRAIN MACHINE INTERFACE; TASK PERFORMANCE; ALGORITHM; ANIMAL; COMPUTER INTERFACE; COMPUTER SIMULATION; MAN MACHINE INTERACTION; PHYSIOLOGY; STEREOTACTIC PROCEDURE;

RATTUS;

ALGORITHMS; ANIMALS; BEHAVIOR, ANIMAL; COMPUTER SIMULATION; DECISION MAKING; MAN-MACHINE SYSTEMS; NUCLEUS ACCUMBENS; RATS; STEREOTAXIC TECHNIQUES; USER-COMPUTER INTERFACE;

EID: 79952679719     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0014760     Document Type: Article

References (50)

1. Johnson-Frey SH, (2003) What's So Special about Human Tool Use? Neuron 39: 201-204.
2. Grossberg S, (1982) Studies of Mind and Brain: neural principles of learning, perception, development, cognition and motor control. Boston Dordercht, Holland.
3. Parker ST, Gibson KR, (1977) Object manipulation, tool use and sensorimotor intelligence as feeding adaptations in cebus monkeys and great apes. Journal of Human Evolution 6: 623-641.
4. Fuster JM, (2004) Upper processing stages of the perception-action cycle. Trends in Cognitive Sciences 8: 143-145.
5. Montagne G, Buekers M, Camachon C, de Rugy A, Laurent M, (2003) The learning of goal-directed locomotion: A perception-action perspective. The Quarterly Journal of Experimental Psychology Section A 56: 551-567.
6. Rangel A, Camerer C, Montague PR, (2008) A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 9: 545-556.
7. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, et al. (2006) Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442: 164-171.
8. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB, (2008) Cortical control of a prosthetic arm for self-feeding. Nature 453: 1098-1101.
9. Nicolelis MAL, Lebedev MA, (2009) Principles of neural ensemble physiology underlying the operation of brain-machine interfaces. Nature Reviews Neuroscience 10: 530-540.
10. Lebedev MA, Nicolelis MAL, (2006) Brain-machine interfaces: past, present and future. Trends in Neurosciences 29: 536-546.
11. Sanchez JC, Principe JC, (2007) Brain-Machine Interface Engineering. New York Morgan and Claypool.
12. Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, et al. (2003) Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biology 1: 193-208.
13. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, et al. (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408: 361-365.
14. Taylor DM, Tillery SIH, Schwartz AB, (2002) Direct cortical control of 3D neuroprosthetic devices. Science 296: 1829-1832.
15. Andersen RA, Budrick JW, Musallam S, Pesaran B, Cham JG, (2004) Cognitive neural prosthetics. Trends in Cognitive Science 8: 486.
16. Shenoy KV, Meeker D, Cao SY, Kureshi SA, Pesaran B, et al. (2003) Neural prosthetic control signals from plan activity. Neuroreport 14: 591-596.
17. Sanchez JC, Mahmoudi B, DiGiovanna J, Principe JC, (2009) Exploiting co-adaptation for the design of symbiotic neuroprosthetic assistants. Neural Networks 22: 305-315.
18. Kim HK, Biggs J, Schloerb W, Carmena M, Lebedev MA, et al. (2006) Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces. IEEE Transactions on Biomedical Engineering 53: 1164-1173.
19. Schultz W, (2000) Multiple reward signals in the brain. Nature Reviews Neuroscience 1: 199-207.
20. Nixon PD, McDonald KR, Gough PM, Alexander IH, Passingham RE, (2004) Cortico-basal ganglia pathways are essential for the recall of well-established visuomotor associations. European Journal of Neuroscience 20: 3165.
21. Graybiel AM, Aosaki T, Flaherty AW, Kimura M, (1994) The basal ganglia and adaptive motor control. Science 265: 1826-1831.
22. Samejima K, Doya K, (2007) Multiple representations of belief states and action values in corticobasal ganglia loops. Reward and Decision Making in Corticobasal Ganglia Networks Oxford Blackwell Publishing pp. 213-228.
23. Costa RM, Lin SC, Sotnikova Tatyana D, Cyr M, Gainetdinov Raul R, et al. (2006) Rapid Alterations in Corticostriatal Ensemble Coordination during Acute Dopamine-Dependent Motor Dysfunction. Neuron 52: 359-369.
24. Schultz W, Tremblay L, Hollerman JR, (1998) Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology 37: 421-429.
25. Williams ZM, Eskandar EN, (2006) Selective enhancement of associative learning by microstimulation of the anterior caudate. Nature Neuroscience 9: 562-568.
26. Mogenson GJ, Jones DL, Yim CY, (1980) From motivation to action: Functional interface between the limbic system and the motor system. Progress in Neurobiology 14: 69-97.
27. Doya K, (2007) Reinforcement learning: Computational theory and biological mechanisms. HFSP Journal 1: 30-40.
28. DiGiovanna J, Mahmoudi B, Fortes J, Principe JC, Sanchez JC, (2009) Coadaptive Brain-Machine Interface via Reinforcement Learning. IEEE Transactions on Biomedical Engineering 56: 54-64.
29. Kaelbling LP, Littman ML, Moore AW, (1996) Reinforcement learning: a survey. Journal of Artificial Intelligence Research 4: 237-285.
30. Cohen MX, (2008) Neurocomputational mechanisms of reinforcement-guided learning in humans: A review. Cognitive Affective & Behavioral Neuroscience 8: 113-125.
31. Dayan P, Niv Y, Seymour B, Daw ND, (2006) The misbehavior of value and the discipline of the will. Neural Networks 19: 1153-1160.
32. Sutton RS, Barto AG, (1998) Reinforcement Learning: An Introduction. Cambridge MIT Press.
33. Roitman MF, Wheeler RA, Carelli RM, (2005) Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output. Neuron 45: 587-597.
34. Haykin S, (2001) Neural Networks: A Comprehensive Foundation: Prentice Hall.
35. Principe JC, de Vries B, de Oliveira PG, (1993) The gamma-filter-a new class of adaptive IIR filters with restricted feedback. IEEE Transactions on Signal Processing 41: 649-656.
36. Paxinos G, Watson C, (1998) The Rat Brain in Stereotaxic Coordinates. San Diego Academic Press.
37. Groenewegen HJ, Wright CI, Beijer AVJ, (1996) Chapter 29 The nucleus accumbens: gateway for limbic structures to reach the motor system? Progress in Brain Research Elsevier pp. 485-511.
38. Sanchez JC, Alba N, Nishida T, Batich C, Carney PR, (2006) Structural modifications in chronic microwire electrodes for cortical neuroprosthetics: a case study. IEEE Transactions on Neural Systems and Rehabilitation Engineering 14: 217-221.
39. Lewicki MS, (1998) A review of methods for spike sorting: the detection and classification of neural action potentials. Network: Computation in Neural Systems 9: 53-78.
40. Izhikevich EM, (2003) Simple model of spiking neurons. IEEE Transactions on Neural Networks 14: 1569-1572.
41. Bower GH, (1981) Theories of Learning. Englewood Cliffs Prentice-Hall, Inc.
42. Kleim JA, Barbay S, Nudo RJ, (1998) Functional reorganization of the rat motor cortex following motor skill learning. Journal of Neurophysiology 80: 3321-3325.
43. Donoghue JP, Wise SP, (1982) The motor cortex of the rat: cytoarchitecture and microstimulation mapping. Journal of Computational Neurology 212: 76-88.
44. Carlezon WA Jr, Thomas MJ, (2009) Biological substrates of reward and aversion: A nucleus accumbens activity hypothesis. Neuropharmacology 56: 122-132.
45. Struthers W, DuPriest A, Runyan J, (2005) Habituation reduces novelty-induced FOS expression in the striatum and cingulate cortex. Experimental Brain Research 167: 136-140.
46. Ferretti V, Roullet P, Sargolini F, Rinaldi A, Perri V, et al. Ventral striatal plasticity and spatial memory. Proceedings of the National Academy of Sciences 107: 7945-7950.
47. Costa RM, Cohen D, Nicolelis MAL, (2004) Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice. Current Biology 14: 1124-1134.
48. Buonomano DV, Merzenich MM, (1998) Cortical Plasticity: From Synapses to Maps. Annual Review of Neuroscience 21: 149.
49. Sanchez JC, Principe JC, (2006) Optimal Signal Processing for Brain-Machine Interfaces. In: Akay M, editors. Handbook of Neural Engineering New York Wiley.
50. Mahmoudi B, Principe JC, Sanchez JC, (2009) An Actor-Critic architecture and simulator for goal-directed brain-machine interfaces. 31st International Conference of the IEEE Engineering in Medicine and Biology Society pp. 3365-3368.