A computational model of the functional role of the ventral-striatal D2 receptor in the expression of previously acquired behaviors

Neural Computation

Volumn 17, Issue 2, 2005, Pages 361-395

  Smith, Andrew James ^a   Becker, Suzanna ^a   Kapur, Shitij ^b  

^a MCMASTER UNIVERSITY   (Canada)

^b CENTRE FOR ADDICTION AND MENTAL HEALTH   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE 2 RECEPTOR;

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; AVOIDANCE BEHAVIOR; BEHAVIOR; BIOLOGY; CORPUS STRIATUM; METHODOLOGY; PHYSIOLOGY; RAT;

ANIMALS; AVOIDANCE LEARNING; BEHAVIOR; COMPUTATIONAL BIOLOGY; CORPUS STRIATUM; NEURAL NETWORKS (COMPUTER); RATS; RECEPTORS, DOPAMINE D2;

EID: 13244284646     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766053011546     Document Type: Article

References (137)

1. Ader, R., & Clink, D. W. (1957). Effects of chlorpromazine on the acquisition extinction of an avoidance response in the rat. J. Pharmacol. Exp. Ther., 131, 144-148.
2. Aguilar, M. A., Mari-Sanmillan, M. I., Morant-Deusa, J. J., & Minarro, J. (2000). Different inhibition of conditioned avoidance response by clozapine and Da D1 and D2 antagonists in male mice. Behav. Neurosci., 114(2), 389-400.
3. Anisman, H., Irwin, J., Zacharko, R. M., & Tombaugh, T. N. (1982). Effects of dopamine receptor blockade on avoidance performance: Assessment of effects on cue-shock and response-outcome associations. Behavioral and Neural Biology, 36, 280-290.
4. Arana, F. S., Parkinson, J. A., Hinton, E., Holland, A. J., Owen, A. M., & Roberts, A. C. (2003). Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. Journal of Neuroscience, 23(29), 9632-9638.
5. Arnt, J. (1982). Pharmacological specificity of conditioned avoidance response Inhibition in rats: Inhibition by neuroleptics and correlation to dopamine receptor blockade. Acta Pharmacol. Toxicol. (Copenh.), 51(4), 321-329.
6. Balleine, B. W., Garner, C., Gonzalez, F., & Dickinson, A. (1995). Motivational control of heterogeneous instrumental chains. Journal of Experimental Psychology: Animal Behaviour Processes, 21, 203-217.
7. Bechara, A., Damasio, H., Tranel, D., & Anderson, S. W. (1998). Dissociation of working memory from decision making within the human prefrontal cortex. Journal of neuroscience, 18(1), 428-437.
8. Beck, A. T., & Rector, N. A. (2003). A cognitive model of hallucinations. Cognitive Therapy and Research, 27(1), 19-52.
9. Bell, D. S. (1973). The experimental reproduction of amphetamine psychosis. Archives of General Psychiatry, 29, 35-40.
10. Beninger, R. J. (1989). Dissociating the effects of altered dopaminergic function on performance and learning. Brain Research Bulletin, 23, 365-371.
11. Beninger, R. J., & Hahn, B. L. (1983). Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning. Science, 220, 1304-1306.
12. Beninger, R. J., Mason, S. T., Phillips, A. G., & Fibiger, H. C. (1980a). The use of conditioned suppression to evaluate the nature of neuroleptic-induced avoidance deficits. J. Pharmacol. Exp. Ther., 213(3), 623-627.
13. Beninger, R. J., Mason, S. T., Phillips, A. G., & Fibiger, H. C. (1980b). The use of extinction to investigate the nature of neuroleptic-induced avoidance deficits. Psychopharmacology (Berl.), 69(1), 11-18.
14. Berridge, K. C., & Robinson, T. E. (1998). What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Research Reviews, 28, 309-369.
15. Berridge, K., & Robinson, T. E. (2003). Parsing reward. Trends in Neurosciences, 26(9), 507-513.
16. Berridge, K. C., & Schulkin, J. (1989). Palatability shift of a salt-associated incentive during sodium depletion. Quarterly Journal of Experimental Psychology, 41B(2), 121-138.
17. Black, A. H. (1963). The effects of CS-US interval on avoidance conditioning in the rat. Canadian Journal of Psychology, 17(2), 174-182.
18. Blackburn, J. R., & Phillips, A. G. (1989). Blockade of acquisition of one-way conditioned avoidance responding by haloperidol and metoclopramide but not by thioridazine or clozapine: Implications for screening new antipsychotic drugs. Psychopharmacology, 98, 453-459.
19. Cador, M., Robbins, T. W., & Everitt, B. J. (1989). Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum. Neuroscience, 30(1), 77-86.
20. Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002). Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal coretx. Neuroscience and Biobehavioral Reviews, 26(3), 321-352.
21. Cardinal, R. N., Pennicott, D. R., Sugathapala, C. L., Robbins, T. W., & Everitt, B. J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science, 292(5526), 2499-2501.
22. Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology, 152, 362-375.
23. Catania, A. C. (in press). Attention-deficit/hyperactivity disorder (ADHD): Delay-of-reinforcement gradients and other behavioral mechanisms. Behavioral and Brain Sciences.
24. Connell, P. H. (1958). Amphetamine psychosis. London: Chapman and Hall.
25. Cook, L., & Catania, A. C. (1964). Effects of drugs on avoidance and escape behavior. Federation Proceedings, 23, 818-835.
26. Cook, L., & Weidley, E. (1957). Behavioral effects of some psychopharmacological agents. Ann. N.Y. Acad. Sci., 66, 740-752.
27. Courvoisier, S. (1956a). Pharmacodynamic basis for the use of chlorpromazine in psychiatry. Quarterly Review of Psychiatry and Neurology, 17(1), 25-37.
28. Courvoisier, S. (1956b). Pharmacodynamic basis for the use of chlorpromazine in psychiatry. Journal of Clin. Exp. Psychophathol. Quart. Rev. Psychiat. Neurol., 17, 25-37.
29. Cousins, M. S., Atherton, A., Turner, L., & Salamone, J. D. (1996). Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behavioural Brain Research, 74, 189-197.
30. Davidson, A. B., & Weidley, E. (1976). Differential effects of neuroleptic and other psychotropic agents on acquisition of avoidance in rats. Life Sci., 18(11), 1279-1284.
31. Davis, W. M., Capehart, J., & Llewellin, W. L. (1961). Mediated acquisition of a fear-motivated response and inhibitiory effects of chlorpromazine. Psychopharmacologia, 2, 268-276.
32. Daw, N. D., Courville, A. C., & Touretzky, D. S. (2004). Timing and partial observability in the dopamine system. In S. Still, W. Bialek, & L. Botlou (Eds.), advances in neural information processing systems, 16. Cambridge, MA: MIT Press.
33. Dayan, P. (2002). Motivated reinforcement learning. In T. G. Dietterich, S. Becker, & Z. Ghahramani, (Eds.) Advances in neural information processing systems, 14. Cambridge, MA: MIT Press.
34. Dayan, P., & Balleine, B. W. (2002). Reward, motivation and reinforcement learning. Neuron, 36, 285-298.
35. de Wit, H., Enggasser, J. L., & Richards, J. B. (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology, 27(5), 813-825.
36. Dews, P. B., & Morse, W. H. (1961). Behavioral pharmacology. Annual Review of Pharmacology, 1, 145-174.
37. Dias, R., Robbins, T. W., & Roberts, A. C. (1996). Disssociation in prefrontal cortex of affective and attentional shifts. Nature, 380(6569), 69-72.
38. DiChiara, G. (1999). Drug addiction as dopamine-dependent associative learning disorder. European Journal of Pharmacology, 375, 13-30.
39. Dickinson, A. (1980). Contemporary animal learning theory. Cambridge: Cambridge University Press.
40. Dickinson, A. (1987). Instrumental performance following saccharin prefeeding. Behavioural Processes, 14, 147-154.
41. Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983). The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Quarterly Journal of Experimental Psychology, 35B, 35-51.
42. Dickinson, A., Smith, J., & Mirenowicz, J. (2000). Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behavioral Neuroscience, 40, 468-483.
43. Ettenberg, A. (1989). Dopamine, neuroleptics and reinforced behavior. Neuroscience and Biobehavioral Reviews, 13, 105-111.
44. Ettenberg, A., Koob, G. F., & Bloom, F. E. (1981). Response artifact in the measurement of neuroleptic-induced anhedonia. Science, 213, 357-359.
45. Evenden, J. L., & Robbins, T. W. (1983). Dissociable effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology, 79, 180-186.
46. Everitt, B. J., Morris, K. A., O'Brien, A., & Robbins, T. W. (1991). The basolateral amygdala-ventral striatal system and conditioned place preference: Further evidence of limbic-striatal interactions underlying reward-related processes. Neuroscience, 42, 1-18.
47. Everitt, B. J., & Robbins, M. C. T. W. (1989). Interactions between the amygdala and ventral striatum in the stimulus-reward associations: Studies using a second-order schedule of sexual reinforcement. Neuroscience, 30(1), 63-75.
48. Fibiger, H. C., Carter, D. A., & Phillips, A. G. (1976). Decreased intracranial self-stimulation after neuroleptics of 6-hydroxydopamine: Evidence for mediation by motor deficits rather than by reduced reward. Psychopharmacology, 47, 21-27.
49. Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902.
50. Fowler, S. C., LaCerra, M. M., & Ettenberg, A. (1986). Effects of haloperidol on the biophysical characteristics of operant responding: Implications for motor and reinforcement processes. Pharmacology, Biochemistry and Behaviour, 25, 791-796.
51. Frances, A., (Ed.). (2000). Diagnostic and statistical manual of mental disorders. Washington, DC: American Psychiatric Association.
52. Giordano, L. A., Bickel, W. K., Loewenstein, G., Jacobs, E. A., Marsch, L., & Badger, G. J. (2002). Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology, 163, 174-182.
53. Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2002). Appetitive and aversive ol-factory learning in humans studied using event-related functional magnetic resonance imaging. Journal of Neuroscience, 22, 10829-10837.
54. Grace, A. A. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia. Neuroscience, 41(1), 1-24.
55. Grace, A. A. (2000). Gating of information flow within the limbic system and the pathophysiology of schizophrenia. Brain Research Reviews, 31, 330-341.
56. Grilly, D. M., Johnson, S. K., Minardo, R., Jacoby, D., & LaRiccia, J. (1984). How do tranquilizing agents selectively inhibit conditioned avoidance responding? Psychopharmacology, 84, 262-267.
57. Hollerman, J., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience, 1, 304-309.
58. Horvitz, J. C. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience, 96(4), 651-656.
59. Horvitz, J. C. (2002). Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behavioural Brain Research, 137, 65-74.
60. Houk, J. C., Adams, J. L., & Barto, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 249-270). Cambridge, MA: MIT press.
61. Hunt, H. F. (1956). Some effects of drugs on classical (type S) conditioning. Ann. N.Y. Acad. Sci., 65, 258-267.
62. Ikemoto, S., & Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking. Brain Research Reviews, 31(1), 6-41.
63. Irwin, S. (1958). Factors influencing acquisition of avoidance behaviour and sensitivity to drugs. Fed. Proc., 17, 380.
64. Iversen, S. D., & Mishkin, M. (1970). Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Experimental Brain Research, 11, 376-386.
65. Janssen, P. A. J., Niemegeers, C. J. E., & Schellekens, K. H. L. (1965). Is it possible to predict the clinical effects of neuroleptic drugs (major tranquilizers) from animal data? Arzneimittelforschung, 15, 104-117.
66. Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron, 40, 1251-1257.
67. Joseph, M. H., Datla, K., & Young, A. M. J. (2003). The interpretation of the measurement of nucleus accumbens dopamine by vivo dialysis: The kick, the craving or the cognition. Neuroscience and Biobehavioral Reviews, 27, 527-541.
68. Kaelbling, L., Littman, M., & Moore, A. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence, 4, 237-285.
69. Kamin, L. J. (1954). Traumatic avoidance learning: The effects of CS-US interval with a trace-conditioning procedure. Journal of Comparative and Physiological Psychology, 47, 65-72.
70. Kandel, E. R., Schwartz, J. H., & Jessell, T. M. (1991). Principles of neural science. New York: Elsevier Science.
71. Kauer, J. A. (2003). Addictive drugs and stress trigger a common change at VTA synapses. Neuron, 37, 549-550.
72. Key, B. J. (1961). The effects of drugs on discrimination and sensory generalisation of auditory stimuli in cats. Psychopharmacologia, 2, 352-363.
73. Kilts, C. D. (2001). The changing roles and targets for animal models of schizophrenia. Biological Psychiatry, 50(11), 845-855.
74. Low, L. A., Eliasson, M., & Kornetsky, C. (1966). Effects of chlorpromazine on avoidance acquisition as a function of CS-US interval length. Psychopharmacologia, 10, 148-154.
75. Low, L. A., & Low, H. L. (1962). Effects of CS-US interval upon avoidance responding. Journal of Comparative and Physiological Psychology, 55(6), 1059-1061.
76. Maffii, G. (1959). The secondary conditioned response of rats and effects of some psychopharmacological agents. Journal of Pharmacy and Pharmacology, 11, 129-139.
77. Maher, B., & Ross, J. S. (1984). Delusions. In H. E. Adams, & P. Sutker (Eds.), Comprehensive handbook of psychopathology (pp. 383-409). New York: Plenum Press.
78. Masterman, D. L., & Cummings, J. L. (1997). Frontal-subcortical circuits: The anatomical basis of executive, social and motivated behaviors. Journal of Psychopharmacology, 11(2), 107-114.
79. McClure, S. M., Daw, N., & Montague, P. R. (2003). A computational substrate for incentive salience. Trends in Neuroscience, 26(8), 423-428.
80. Miller, R. E., Murphy, J. V., & Mirsky, A. (1957). The effect of chlorpromazine on fear-motivated behavior in rats. Journal of Pharmacol and Exper. Therap., 120, 379-387.
81. Montague, P. R., & Berns, G. S. (2002). Neural economics and the biological substrates of valuation. Neuron, 36, 265-284.
82. Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995). Bee foraging in uncertain environments using predictive hebbian learning. Nature, 377, 725-728.
83. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16(5), 1936-1947.
84. Moore, H., West, A. R., & Grace, A. A. (1999). The regulation of forebrain dopamine transmission: Relevance to the pathophysiology and psychopathology of schizophrenia. Biological Psychiatry, 46, 40-55.
85. Morpurgo, C. (1965). Drug-induced modifications of discriminated avoidance behavior in rats. Psychopharmacologia, 8, 90-99.
86. Nader, K., & LeDoux, J. (1999). The dopaminergic modulation of fear: Quinpirole impairs the recall of emotional memories in rats. Behavioral Neuroscience, 113(1), 152-165.
87. Nishijo, H., Ono, T., & Nishino, H. (1988). Single neuron responses in amygdala of alert monkey during complex senosry stimulation with affective significance. Journal of Neuroscience, 8, 3570-3583.
88. O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 28, 329-337.
89. O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002). Neural responses during anticipation of primary taste reward. Neuron, 33, 815-826.
90. Ogren, S. O., & Archer, T. (1994). Effects of typical and atypical antipsychotic drugs on two-way active avoidance: Relationship to DA receptor blocking profile. Psychopharmacology (Berl.), 114(3), 383-391.
91. Pennartz, C. M. A., Groenewegen, H. J., & Silva, F. H. L. D. (1994). The nucleus accumbens as a complex of functionally distinct Neuronal ensembles: An integration of behavioural, electrophysiological and anatomical data. Progress in Neurobiology, 42, 719-761.
92. Phares, V. (2003). Understanding abnormal child psychology. New York: Wiley.
93. Phillips, P. E. M., Stuber, G. D., Helen, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature, 422, 614-618.
94. Ponsluns, D. (1962). An analysis of chlorpromazine-induced suppression of the avoidance response. Psychopharmacologia, 3, 361-373.
95. Redgrave, P., Prescott, T. J., & Gurney, K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in Neurosciences, 22(4), 146-151.
96. Richards, J. B., Sabol, K. E., & de Wit, H. (1999). Effects of methamphetamine on the adjusting amount of procedure, a model of impulsive behavior in rats. Psychopharmacology, 146, 432-439.
97. Rizley, R. C., & Rescorla, R. A. (1972). Associations in second-order conditioning and sensory preconditioning. Journal of Comparative and Physiological Psychology, 81(1), 1-11.
98. Robbins, T. W., Cador, M., Taylor, J. R., & Everitt, B. J. (1989). Limbic-striatal interactions in reward-related processes. Neuroscience and Biobehavioural Reviews, 13, 155-162.
99. Rolls, E. T., Rolls, B. J., Kelly, P. H., Shaw, S. G., Wood, R. J., & Dale, R. (1974). The relative attenuation of self-stimulation, eating and drinking produced by dopamine-receptor blockade. Psychopharmacology, 38, 219-230.
100. Salamone, J. D., Cousins, M. S., & Bucher, S. (1994). Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behavioural Brain Research, 65, 221-229.
101. Salamone, J. D., Cousins, M. S., & Snyder, B. J. (1997). Behavioural functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis. Neuroscience and Biobehavioural Reviews, 21(3), 341-359.
102. Salamone, J. D., Kurth, P. A., McCullough, L. D., Sokolowski, J. D., & Cousins, M. S. (1993). The role of brain dopamine in response initiations: Effects of haloperidol and regionally-specific dopamine depletions on the local rate of instrumental responding. Brain Research, 628, 218-226.
103. Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., & Mahan, K. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food-choice procedure. Psychopharmacology, 104, 515-521.
104. Salamone, J. D., Wisniecki, A., Carlson, B. B., & Correa, M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience, 105(4), 863-870.
105. Schmajuk, N. A. (1988). The hippocampus and the classically conditioned nictitating membrane response: A real-time attentional-associative model. Psychobiology, 16(1), 20-35.
106. Schmajuk, N. A., Cox, L., & Gray, J. A. (2001). Nucleus accumbens, entorhinal cortex and latent inhibition: A neural network model. Behavioural Brain Research, 118, 123-141.
107. Schneider, J. S., Sun, Z. Q., & Roeltgen, D. P. (1994). Effects of dopamine agonists on delayed response performance in chronic low-dose MPTP-treated monkeys. Pharmacology, Biochemistry and Behaviour, 48(1), 235-240.
108. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
109. Schultz, W., Tremblay, L., & Hollerman, J. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10, 272-283.
110. Seeman, P., & Madras, B. K. (1998). Anti-hyperactivity medication: Methylphenidate and amphetamine. Molecular Psychiatry, 3(5), 386-396.
111. Smith, A., Li, M., Becker, S., & Kapur, S. (2004). A model of antipsychotic action in conditioned avoidance: A computational approach. Neuropsychopharmacology, 29(6), 1040-1049.
112. Solanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., Hechtman, L., Hinshaw, S., & Turkel, E. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215-228.
113. Stark, H., Bischof, A., & Scheich, H. (1999). Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle box. Neuroscience Letters, 264, 77-80.
114. Suri, R. E. (2001). Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Experimental Brain Research, 140, 234-240.
115. Suri, R. E. (2002). TD models of reward predictive responses in dopamine neurons. Neural Networks: Special Issue on Computational Models of Neuromodulation, 15(4-6), 523-533.
116. Suri, R. E., Bargas, J., & Arbib, M. A. (2001). Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience, 103(1), 65-85.
117. Suri, R., & Schultz, W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental Brain Research, 121, 350-354.
118. Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3, 9-44.
119. Sutton, R. S.; & Barto, A. G. (1981). An adaptive network that constructs and uses an internal model of its world. Cognition and Brain Theory, 4(3), 217-246.
120. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
121. Talk, A. C., Gandhi, C. C., & Matzel, L. D. (2002). Hippocampal function during behaviourally silent association learning: Dissociation of memory storage and expression. Hippocampus, 12, 648-656.
122. Taylor, J. R., & Robbins, T. W. (1984). Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens. Psychopharmacology, 84, 405-412.
123. Tremblay, L., & Schultz, W. (2000a). Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. Journal of Neurophysiology, 83, 1877-1885.
124. Tremblay, L., & Schultz, W. (2000b). Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. Journal of Neurophysiology, 83, 1864-1876.
125. van der Heyden, J. A. M., & Bradford, L. D. (1988). A rapidly acquired one-way conditioned avoidance procedure in rats as a primary screening test for antipsychotics: Influence of shock intensity on avoidance performance. Behavioural Brain Research, 31, 61-67.
126. Wade, T. R., de Wit, H., & Richards, J. B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology, 150, 90-101.
127. Wadenberg, M. G., Soliman, A., Vanderspek, S. C., & Kapur, S. (2001). Dopamine D2 receptor occupancy is a common mechanism underlying animal models of antipsychotics and their clinical effects. Neuropsychopharmacology, 25(25), 633-641.
128. Wadenberg, M. L., & Hicks, P. B. (1999). The conditioned avoidance response test reevaluated: Is it a sensitive test for the detection of potentially atypical antipsychotics? Neurosci. Biobehav. Rev., 23(6), 851-862.
129. Wadenberg, M.-L. G., Kapur, S., Soliman, A., Jones, C., & Vaccarino, F. (2000). Dopamine D2 receptor occupancy predicts catalepsy and the supression of conditioned avoidance response behaviour in rats. Psychopharmacology, 150, 422-429.
130. Waelti, P., Dickinson, A., & Schultz, W. (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature, 412, 43-48.
131. Wilkinson, L. S., Humby, T., Killcross, A. S., Torres, E. M., Everitt, B. J., & Robbins, T. W. (1998). Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. European Journal of Neuroscience, 10, 1019-1026.
132. Wilson, M., & Daly, M. (2004). Do pretty women inspire men to discount the future? Biology letters, 271(S4), 177-179.
133. Wise, R. A. (1982). Neuroleptics and operant behavior: The anhedonia hypothesis. Behavioural and Brain Sciences, 5, 39-87.
134. Wise, R. A. (2002). Brain reward circuitry: Insights from unsensed incentives. Neuron, 36, 229-240.
135. Wise, R. A., & Schwartz, H. V. (1981). Pimozide attenuates acquisition of lever-pressing for food in rats. Pharmacology, Biochemistry and Behavior, 15, 655-656.
136. Wise, R. A., Spindler, J., DeWit, H., & Gerber, G. J. (1978). Neuroleptic-induced "anhedonia" in rats: Pimozide blocks reward quality of food. Science, 201, 262-264.
137. Young, A. M. J., Ahier, R. G., Upton, R. L., Joseph, M. H., & Gray, J. A. (1998). Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience, 83(4), 1175-1183.