How fast to work: Response vigor, motivation and tonic dopamine

Advances in Neural Information Processing Systems

Volumn , Issue , 2005, Pages 1019-1026

  Niv, Yael ^a,b   Daw, Nathaniel D ^b   Dayan, Peter ^b  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CONDITIONED BEHAVIOR; COSTS AND BENEFITS; PHARMACOLOGICAL MANIPULATION; REINFORCEMENT LEARNING MODELS; RESPONSE RATE; RL FRAMEWORK;

AMINES; ANIMALS; MOTIVATION; REINFORCEMENT LEARNING;

NEUROPHYSIOLOGY;

EID: 33745774340     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Dickinson A. and Balleine B.W. The role of learning in the operation of motivational systems. Steven's Handbook of Experimental Psychology Volume 3, pages 497-533. John Wiley & Sons, New York, 2002.
2. Hull C.L. Principles of behavior: An introduction to behavior theory. Appleton-Century-Crofts, New York, 1943.
3. Bélanger D. and Tétreau B. L'influence d'une motivation inappropriate sur le comportement du rat et sa fr équence cardiaque. Can. J. of Psych., 15:6-14, 1961.
4. Salamone J.D. and Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behavioural Brain Research, 137:3-25, 2002.
5. Ikemoto S. and Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev., 31:6-41, 1999.
6. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophys., 80:1-27, 1998.
7. Domjan M. The principles of learning and behavior. Brooks/Cole, Pacific Grove, California, 3rd edition, 1993.
8. R. S. Sutton and A. G. Barto. Reinforcement learning: An introduction. MIT Press, 1998.
9. Herrnstein R.J. On the law of effect. J. of the Exp. Anal. of Behav., 13(2):243-266, 1970.
10. Dawson G.R. and Dickinson A. Performance on ratio and interval schedules with matched reinforcement rates. Q. J. of Exp. Psych. B, 42:225-239, 1990.
11. Niv Y., Daw N.D., Joel D., and Dayan P. Motivational effects on behavior: Towards a reinforcement learning model of rates of responding. In CoSyNe, Salt Lake City, Utah, 2005.
12. Aberman J.E. and Salamone J.D. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience, 92(2):545-552, 1999.
13. Foster T.M., Blackman K.A., and Temple W. Open versus closed economies: performance of domestic hens under fixed-ratio schedules. J. of the Exp. Anal. of Behav., 67:67-89, 1997.
14. Staddon J.E.R. Adaptive dynamics. MIT Press, Cambridge, Mass., 2001.
15. Mahadevan S. Average reward reinforcement learning: Foundations, algorithms and empirical results. Machine Learning, 22:1-38, 1996.
16. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Networks, 15(4-6):603-616, 2002.
17. Bolles R.C. Theory of Motivation. Harper & Row, 1967.
18. Carr G.D. and White N.M. Effects of systemic and intracranial amphetamine injections on behavior in the open field: a detailed analysis. Pharmacol. Biochem. Behav., 27:113-122, 1987.
19. Jackson D.M., Anden N., and Dahlstrom A. A functional effect of dopamine in the nucleus accumbens and in some other dopamine-rich parts of the rat brain. Psychopharmacologia, 45:139-149, 1975.
20. Dayan P. and Balleine B.W. Reward, motivation and reinforcement learning. Neuron, 36:285-298, 2002.
21. McClure S.M., Daw N.D., and Montague P.R. A computational substrate for incentive salience. Trends in Neurosc., 26(8):423-428, 2003.
22. Daw N.D., Niv Y., and Dayan P. Uncertainty based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8(12):1704-1711, 2005.
23. Dickinson A., Balleine B.,Watt A., Gonzalez F., and Boakes R.A. Motivational control after extended instrumental training. Anim. Learn. and Behav., 23(2):197-206, 1995.
24. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive hebbian learning. J. of Neurosci., 16(5):1936-1947, 1996.
25. Satoh T., Nakai S., Sato T., and Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. J. of Neurosci., 23(30):9913-9923, 2003.
26. Daw N.D., Courville A.C., and Touretzky D.S. Timing and partial observability in the dopamine system. In T.G. Dietterich, S. Becker, and Z. Ghahramani, editors, NIPS, volume 14, Cambridge, MA, 2002. MIT Press.
27. Gallistel C.R. and Gibbon J. Time, rate and conditioning. Psych. Rev., 107:289-344, 2000.