Neuromodulation as a robot controller: A brain-inspired strategy for controlling autonomous robots

IEEE Robotics and Automation Magazine

Volumn 16, Issue 3, 2009, Pages 72-80

  Cox, Brian R ^a   Krichmar, Jeffrey L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Autonomous agents; Behavior based systems; Learning and adaptive systems; Neurorobotics

Indexed keywords

ACTION SELECTION; AUTONOMOUS ROBOT; BEHAVIOR-BASED SYSTEMS; BRAIN AREAS; BRAIN-INSPIRED; COGNITIVE FUNCTIONS; FRONTAL CORTEX; GOAL-DIRECTED BEHAVIOR; LEARNING AND ADAPTIVE SYSTEMS; MAMMALIAN BRAIN; NEUROMODULATION; NEUROMODULATORS; NEUROROBOTICS; ROBOT CONTROLLER;

ADAPTIVE SYSTEMS; BRAIN; COGNITIVE SYSTEMS; FUZZY CLUSTERING; MAMMALS; ROBOTS;

AUTONOMOUS AGENTS;

EID: 70349449301     PISSN: 10709932     EISSN: None     Source Type: Journal    
DOI: 10.1109/MRA.2009.933628     Document Type: Article

References (24)

1. J. L. Krichmar, "The neuromodulatory system - A framework for survival and adaptive behavior in a challenging world," Adapt. Behav., vol. 16, no. 6, pp. 385-399, 2008.
2. L. A. Briand, H. Gritton, W. M. Howe, D. A. Young, and M. Sarter, "Modulators in concert for cognition: Modulator interactions in the prefrontal cortex," Prog. Neurobiol., vol. 83, pp. 69-91, Oct. 2007.
3. M. E. Hasselmo and J. McGaughy, "High acetylcholine levels set circuit dynamics for attention and encoding and low acetylcholine levels set dynamics for consolidation," Prog. Brain Res., vol. 145, pp. 207-231, 2004.
4. M. Kobayashi, K. Imamura, T. Sugai, N. Onoda, M. Yamamoto, S. Komai, and Y. Watanabe, "Selective suppression of horizontal propagation in rat visual cortex by norepinephrine," Eur. J. Neurosci., vol. 12, pp. 264-272, Jan. 2000.
5. G. Aston-Jones and J. D. Cohen, "Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance," J. Comp. Neurol., vol. 493, pp. 99-110, Dec. 2005.
6. M. J. Millan, "The neurobiology and control of anxious states," Prog. Neurobiol., vol. 70, pp. 83-244, June 2003.
7. M. G. Baxter and A. A. Chiba, "Cognitive functions of the basal forebrain," Curr. Opin. Neurobiol., vol. 9, pp. 178-183, Apr. 1999.
8. W. Schultz, P. Dayan, and P. R. Montague, "A neural substrate of prediction and reward," Science, vol. 275, pp. 1593-1599, Mar. 1997.
9. A. J. Yu and P. Dayan, "Uncertainty, neuromodulation, and attention," Neuron, vol. 46, pp. 681-692, May 2005.
10. Q. Gu, "Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity," Neuroscience, vol. 111, no. 4, pp. 815-835, 2002.
11. P. Redgrave and K. Gurney, "The short-latency dopamine signal: A role in discovering novel actions?" Nat. Rev. Neurosci., vol. 7, pp. 967-975, Dec. 2006.
12. E. L. Bienenstock, L. N. Cooper, and P. W. Munro, "Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex," J. Neurosci., vol. 2, pp. 32-48, Jan. 1982.
13. K. C. Berridge, "Motivation concepts in behavioral neuroscience," Physiol. Behav., vol. 81, pp. 179-209, Apr. 2004.
14. S. M. McClure, N. D. Daw, and P. R. Montague, "A computational substrate for incentive salience," Trends Neurosci., vol. 26, pp. 423-428, Aug. 2003.
15. K. K. Watson, J. H. Ghodasra, and M. L. Platt, "Serotonin transporter genotype modulates social reward and punishment in rhesus macaques," PLoS One, vol. 4, no. 1, p. e4156, 2009.
16. M. Sarter, W. J. Gehring, and R. Kozak, "More attention must be paid: The neurobiology of attentional effort," Brain Res. Rev., vol. 51, pp. 145-160, Aug. 2006.
17. D. J. Bucci, P. C. Holland, and M. Gallagher, "Removal of cholinergic input to rat posterior parietal cortex disrupts incremental processing of conditioned stimuli," J. Neurosci., vol. 18, pp. 8038-8046, Oct. 1998.
18. A. K. Seth, O. Sporns, and J. L. Krichmar, "Neurorobotic models in neuroscience and neuroinformatics," Neuroinformatics, vol. 3, no. 3, pp. 167-170, 2005.
19. J. L. Krichmar and G. M. Edelman, "Brain-based devices for the study of nervous systems and the development of intelligent machines," Artif. Life, vol. 11, no. 1-2, pp. 63-78, 2005.
20. R. Pfeifer and J. Bongard, How the Body Shapes the Way We Think: A New View of Intelligence. Cambridge, MA: MIT Press, 2007.
21. W. H. Alexander and O. Sporns, "An embodied model of learning, plasticity, and reward," Adapt. Behav., vol. 10, no. 3-4, pp. 143-159, 2002.
22. T. J. Prescott, F. M. M. Gonzalez, K. Gurney, M. D. Humphries, and P. Redgrave, "A robot model of the basal ganglia: Behavior and intrinsic processing," Neural Netw., vol. 19, pp. 31-61, Jan. 2006.
23. K. Doya and E. Uchibe, "The Cyber Rodent project: Exploration of adaptive mechanisms for self-preservation and self-reproduction," Adapt. Behav., vol. 13, pp. 149-160, June 2005.
24. J. Garforth, S. L. McHale, and A. Meehan, "Executive attention, task selection and attention-based learning in a neurally controlled simulated robot," Neurocomputing, vol. 69, no. 16-18, pp. 1923-1945, 2006.