Effect of neuromodulation on performance in game playing: A modeling study

2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program

Volumn , Issue , 2010, Pages 155-160

  Asher, Derrik E ^a   Zaldivar, Andrew ^a   Krichmar, Jeffrey L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Computational neuroscience; Decision making; Dopamine; Game theory; Serotonin

Indexed keywords

ADAPTIVE LEARNING; COMPUTATIONAL MODEL; COMPUTATIONAL NEUROSCIENCE; DOPAMINE; ENVIRONMENTAL CONDITIONS; EXPECTED COSTS; GAME PLAYING; MODELING STUDIES; NEURAL MODELS; NEUROMODULATION; NEUROMODULATORS; SEROTONIN;

BRAIN; COMPUTATION THEORY; DECISION THEORY; GAME THEORY;

DECISION MAKING;

EID: 78149248332     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2010.5578851     Document Type: Conference Paper

References (31)

1. W. Schultz, "Dopamine neurons and their role in reward mechanisms," Curr Opin Neurobiol, vol. 7, pp. 191-7, Apr 1997.
2. K. C. Berridge, "Motivation concepts in behavioral neuroscience," Physiol Behav, vol. 81, pp. 179-209, Apr 2004.
3. P. Redgrave and K. Gurney, "The short-latency dopamine signal: a role in discovering novel actions?," Nat Rev Neurosci, vol. 7, pp. 967-75, Dec 2006.
4. M. J. Millan, "The neurobiology and control of anxious states," Prog Neurobiol, vol. 70, pp. 83-244, Jun 2003.
5. M. J. Crockett, et al., "Serotonin modulates behavioral reactions to unfairness," Science, vol. 320, p. 1739, Jun 27 2008.
6. J. Maynard Smith and G. A. Parker, "The Logic of Animal Conflict," Nature, vol. 246, pp. 15-18, 1973.
7. R. M. Wood, et al., "Effects of tryptophan depletion on the performance of an iterated Prisoner's Dilemma game in healthy adults," Neuropsychopharmacology, vol. 31, pp. 1075-84, May 2006.
8. B. Pleger, et al., "Influence of dopaminergically mediated reward on somatosensory decision-making," PLoS Biol, vol. 7, p. e1000164, Jul 2009.
9. R. Axelrod and W. D. Hamilton, "The evolution of cooperation," Science, vol. 211, pp. 1390-6, Mar 27 1981.
10. J. Maynard Smith, Evolution and the theory of games: Cambridge University Press, 1982.
11. M. Nowak and K. Sigmund, "A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game," Nature, vol. 364, pp. 56-8, Jul 1 1993.
12. M. E. Hasselmo and J. McGaughy, "High acetylcholine levels set circuit dynamics for attention and encoding and low acetylcholine levels set dynamics for consolidation," Prog Brain Res, vol. 145, pp. 207-31, 2004.
13. M. Kobayashi, et al., "Selective suppression of horizontal propagation in rat visual cortex by norepinephrine," Eur J Neurosci, vol. 12, pp. 264-72, Jan 2000.
14. J. L. Krichmar, "The Neuromodulatory System - A Framework for Survival and Adaptive Behavior in a Challenging World," Adaptive Behavior, vol. 16, pp. 385-399, 2008.
15. W. Schultz, et al., "A neural substrate of prediction and reward," Science, vol. 275, pp. 1593-9, Mar 14 1997.
16. J. Amat, et al., "Previous experience with behavioral control over stress blocks the behavioral and dorsal raphe nucleus activating effects of later uncontrollable stress: role of the ventral medial prefrontal cortex," J Neurosci, vol. 26, pp. 13264-72, Dec 20 2006.
17. K. K. Watson, et al., "Serotonin transporter genotype modulates social reward and punishment in rhesus macaques," PLoS ONE, vol. 4, p. e4156, 2009.
18. R. Cools, et al., "Serotoninergic regulation of emotional and behavioural control processes," Trends Cogn Sci, vol. 12, pp. 31-40, Jan 2008.
19. N. Schweighofer, et al., "Low-serotonin levels increase delayed reward discounting in humans," J Neurosci, vol. 28, pp. 4528-32, Apr 23 2008.
20. S. C. Tanaka, et al., "Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum," PLoS ONE, vol. 2, p. e1333, 2007.
21. S. D. Hood, et al., "Acute tryptophan depletion. Part I: rationale and methodology," Aust N Z J Psychiatry, vol. 39, pp. 558-64, Jul 2005.
22. F. Denk, et al., "Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort," Psychopharmacology (Berl), vol. 179, pp. 587-96, May 2005.
23. P. Roussos, et al., "Planning, decision-making and the COMT rs4818 polymorphism in healthy males," Neuropsychologia, vol. 46, pp. 757-63, Jan 31 2008.
24. T. W. Sandholm and R. H. Crites, "Multiagent reinforcement learning in the Iterated Prisoner's Dilemma," Biosystems, vol. 37, pp. 147-66, 1996.
25. V. P. Crawford, "Adaptive Dynamics in Coordination Games," Econometrica, vol. 63, pp. 103-143, 1995.
26. S. Chong and X. Yao, "Behavioral diversity, choices and noise in the iterated prisoner's dilemma," IEEE Transactions on Evolutionary Computation, vol. 9, pp. 540-551, 2005.
27. P. G. Harrald and D. B. Fogel, "Evolving continuous behaviors in the Iterated Prisoner's Dilemma," Biosystems, vol. 37, pp. 135-45, 1996.
28. A. Soltani, et al., "Neural mechanism for stochastic behaviour during a competitive game," Neural Netw, vol. 19, pp. 1075-90, Oct 2006.
29. K. Doya, "Metalearning and neuromodulation," Neural Netw, vol. 15, pp. 495-506, Jun-Jul 2002.
30. N. D. Daw, et al., "Opponent interactions between serotonin and dopamine," Neural Netw., vol. 15, pp. 603-616, 2002.
31. B. R. Cox and J. L. Krichmar, "Neuromodulation as a Robot Controller: A Brain Inspired Design Strategy for Controlling Autonomous Robots," IEEE Robotics & Automation Magazine, vol. 16, pp. 72-80, 2009.