Dopamine signaling and the distal reward problem

NeuroReport

Volumn 18, Issue 17, 2007, Pages 1833-1836

  Nitz, Douglas A ^a   Kargo, William J ^a   Fleischer, Jason ^a  

^a NEUROSCIENCES INSTITUTE   (United States)

Author keywords

Decision making; Distal reward; Dopamine; Knockout; Reward

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BRAIN FUNCTION; DECISION MAKING; DOPAMINERGIC TRANSMISSION; GOAL ATTAINMENT; KNOCKOUT MOUSE; LEARNING; MALE; MOUSE; NONHUMAN; PRIORITY JOURNAL; PROBLEM SOLVING; REINFORCEMENT; REWARD; WILD TYPE;

ANIMALS; ASSOCIATION LEARNING; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DOPAMINE; FOOD DEPRIVATION; MALE; MICE; MICE, KNOCKOUT; PSYCHOMOTOR PERFORMANCE; RECEPTORS, DOPAMINE D1; REWARD; SIGNAL TRANSDUCTION;

EID: 37349058556     PISSN: 09594965     EISSN: None     Source Type: Journal    
DOI: 10.1097/WNR.0b013e3282f16d86     Document Type: Article

References (25)

1. Okubo Y, Suhara T, Suzuki K, Kobayashi K, Inoue O, Terasaki O, et al. Decreased prefrontal dopamine D1 receptors in schizophrenia revealed by PET. Nature 1997; 385:634-636.
2. Misener VL, Luca P, Azeke O, Crosbie J, Waldman I, Tannock R, et al. Linkage of the dopamine receptor D1 gene to attention-deficit/ hyperactivity disorder. Mol Psychiatry 2004; 9:500-509.
3. Bobb AJ, Addington AM, Sidransky E, Gornick MC, Lerch JP, Greenstein DK, et al. Support for association between ADHD and two candidate genes: NET1 and DRD1. Am J Med Genet B Neuropsychiatr Genet 2005; 134:67-72.
4. Redish AD. Addiction as a computational process gone awry. Science 2004; 306:1944-1947.
5. Clark L, Cools R, Robbins TW. The neuropsychology of ventral prefrontal cortex: decision-making and reversal learning. Brain Cogn 2004; 55:41-53.
6. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G, et al. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav Brain Res 2002; 137:149-163.
7. Frank MJ, Seeberger LC, O'reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004; 306:1940-1943.
8. Smith DR, Striplin CD, Geller AM, Mailman RB, Drago J, Lawler CP, Gallagher M. Behavioural assessment of mice lacking D1A dopamine receptors. Neuroscience 1998; 86:135-146.
9. Tran AH, Tamura R, Uwano T, Kobayashi T, Katsuki M, Ono T. Dopamine D1 receptors involved in locomotor activity and accumbens neural responses to prediction of reward associated with place. Proc Natl Acad Sci U S A 2005; 102:2117-2122.
10. Seamans JK, Yang CR. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 2004; 74:1-58.
11. El-Ghundi M, Fletcher PJ, Drago J, Sibley DR, O'Dowd BF, George SR. Spatial learning deficit in dopamine D(1) receptor knockout mice. Eur J Pharmacol 1999; 383:95-106.
12. Hull CL. Principles of behavior: an introduction to behavior theory. New York: Appleton-Century-Crofts; 1951.
13. Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y, et al. Dynamic analysis of learning in behavioral experiments. J Neurosci 2004; 24:447-461.
14. Stefani MR, Moghaddam B. Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum. J Neurosci 2006; 26:8810-8818.
15. Sawaguchi T, Goldman-Rakic PS. D1 dopamine receptors in prefrontal cortex: involvement in working memory. Science 1991; 251:947-950.
16. Kiyatkin EA, Rebec GV. Striatal neuronal activity and responsiveness to dopamine and glutamate after selective blockade of D1 and D2 dopamine receptors in freely moving rats. J Neurosci 1999; 19:3954-3609.
17. Baeg EH, Kim YB, Huh K, Mook-Jung I, Kim HT, Jung MW. Dynamics of population code for working memory in the prefrontal cortex. Neuron 2003; 40:177-188.
18. Pan WX, Schmidt R, Wickens JR, Hyland BI. Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 2005; 25:6235-6242.
19. Sutton RS. Learning to predict by the method of temporal differences. Mach Learn 1988; 3:9-44.
20. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005; 47:129-141.
21. Beninger RJ, Miller R. Dopamine D1-like receptors and reward-related incentive learning. Neurosci Biobehav Rev 1998; 22:335-345.
22. Schmitzer-Torbert N, Redish AD. Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. J Neurophysiol 2004; 91:2259-2272.
23. Pratt WE, Mizumori SJ. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behav Brain Res 2001; 123:165-183.
24. Dayan P, Abbott LF. Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge: MIT Press; 2001.
25. Izhikevich EM. Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 2007; 17:2443-2452.