Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm

Journal of Neuroscience

Volumn 23, Issue 32, 2003, Pages 10402-10410

  Tobler, Philippe N ^a,b   Dickinson, Anthony ^c   Schultz, Wolfram ^a,b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF FRIBOURG   (Switzerland)

^c UK   (United Kingdom)

Author keywords

Attention; Dopamine; Inhibition; Learning theory; Prediction error; Reward

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ATTENTION; CELL ACTIVITY; CODING; CONDITIONING; CONTROLLED STUDY; DISCRIMINATION LEARNING; DISCRIMINATIVE STIMULUS; DOPAMINERGIC NERVE CELL; INHIBITION KINETICS; LEARNING; MACACA; MALE; NERVE POTENTIAL; NONHUMAN; PREDICTION; PRIORITY JOURNAL; REWARD; VISUAL STIMULATION;

EID: 0345255891     PISSN: 02706474     EISSN: None     Source Type: Journal    
DOI: 10.1523/jneurosci.23-32-10402.2003     Document Type: Article

References (40)

1. Briand KA, Hening W, Poizner H, Sereno AB (2001) Automatic orienting of visuospatial attention in Parkinson's disease. Neuropsychologia 39:1240-1249.
2. Brown RG, Marsden CD (1988) Internal versus external cues and the control of attention in Parkinson's disease. Brain 111:323-345.
3. Carli M, Evenden JL, Robbins TW (1985) Depletion of unilateral striatal dopamine impairs initiation of contralateral actions and not sensory attention. Nature 313:679-682.
4. Egeth HE, Yantis S (1997) Visual attention: control, representation, and time course. Annu Rev Psychol 48:269-297.
5. Eisenberger R (1972) Explanation of rewards that do not reduce tissue needs. Psychol Bull 77:319-339.
6. Fibiger HC, Phillips AG (1986) Reward, motivation, cognition: psychobiology of mesotelencephalic dopamine systems. In: Handbook of physiology - the nervous system IV (Bloom FE, ed), pp 647-675. Baltimore: Williams & Wilkins
7. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
8. Goldberg ME, Bruce CJ (1985) Cerebral cortical activity associated with the orientation of visual attention in the rhesus monkey. Vision Res 25:471-481.
9. Granon S, Passetti F, Thomas KL, Dalley JW, Everitt BJ, Robbins TW (2000) Enhanced and impaired attentional performance after infusion of D1 dopaminergic receptor agents into rat prefrontal cortex. J Neurosci 20:1208-1215.
10. Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-309.
11. Horvitz JC (2000) Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96:651-656.
12. Horvitz JC, Stewart T, Jacobs BL (1997) Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res 759:251-258.
13. Humphrey NK (1972) "Interest" and "pleasure" two determinants of a monkey's visual preferences. Perception 1:395-416.
14. Johnston WA, Dark VJ (1986) Selective attention. Annu Rev Psychol 37:43-75.
15. Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Net 15:549-559.
16. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163.
17. Mirenowicz J, Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449-451.
18. Mishkin M, Delacour J (1975) An analysis of short-term visual memory in the monkey. J Exp Psychol Anim Behav Process 1:326-334.
19. Moran J, Desimone R (1985) Selective attention gates visual processing in the extrastriate cortex. Science 229:782-784.
20. Pavlov IP (1927) Conditional reflexes. London: Oxford UP.
21. Pearce JM, Redhead ES (1995) Supernormal conditioning. J Exp Psychol Anim Behav Process 21:155-165.
22. Redgrave P, Prescott TJ, Gurney K (1999) Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22:146-151.
23. Rescorla RA (1969) Pavlovian conditioned inhibition. Psychol Bull 72:77-94.
24. Rescorla RA (1973) Second-order conditioning: implications for theories of learning. In: Contemporary approaches to conditioning and learning (McGuigan FJ, Lumsden DB, eds), pp 127-150. Washington, DC: Winston.
25. Rescorla RA (1976) Second-order conditioning of Pavlovian conditioned inhibition. Learn Motiv 7:161-172.
26. Rescorla RA (1982) Simultaneous second-order conditioning produces S-S learning in conditioned suppression. J Exp Psychol Anim Behav Process 8:23-32.
27. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II: current research and theory (Black AH, Prokasy WF, eds), pp. 64-99. New York: Appleton Century Crofts.
28. Robbins TW, Everitt BJ (1996) Neurobehavioural mechanisms of reward and motivation. Curr Opin Neurobiol 6:228-236.
29. Robinson TE, Berridge KC (1993) The neural basis for drug craving: an incentive-sensitization theory of addiction. Brain Res Rev 18:247-291.
30. Schultz W (1992) Activity of dopamine neurons in the behaving primate. Semin Neurosci 4:129-138.
31. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
32. Schultz W, Romo R (1987) Responses of nigrostriatal dopamine neurons to high intensity somatosensory stimulation in the anesthetized monkey. J Neurophysiol 57:201-217.
33. Treue S, Maunsell JH (1996) Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 382:539-541.
34. Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-48.
35. Wagner AR, Rescorla RA (1972) Inhibition in Pavlovian conditioning: application of a theory. In: Inhibition and learning (Halliday MS, Boakes RA, eds), pp 301-336. London: Academic.
36. Ward NM, Brown VJ (1996) Covert orienting of attention in the rat and the role of striatal dopamine. J Neurosci 16:3082-3088.
37. Washburn DA, Hopkins WD, Rumbaugh DM (1991) Perceived control in rhesus monkeys (Macaca mulatta): enhanced video-task performance. J Exp Psychol Anim Behav Process 17:123-129.
38. Wise RA, Hoffman CD (1992) Localization of drug reward mechanisms by intracranial injections. Synapse 10:247-263.
39. Yamaguchi S, Kobayashi S (1998) Contributions of the dopaminergic system to voluntary and automatic orienting of visuospatial attention. J Neurosci 18:1869-1878.
40. Zimmer-Hart CI, Rescorla RA (1974) Extinction of Pavlovian conditioned inhibition. J Comp Physiol Psychol 86:837-845.