The influence of amphetamine on sensory and conditioned reinforcement: Evidence for the re-selection hypothesis of dopamine function

Frontiers in Integrative Neuroscience

Volumn 1, Issue NOV, 2007, Pages

  Winterbauer, Neil E ^a   Balleine, Bernard W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Conditioned reinforcement; Dopamine; Instrumental conditioning; Sensory reinforcement

Indexed keywords

EID: 84898684362     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.07.009.2007     Document Type: Article

References (34)

1. Azrin, N. H., and Hake, D. F. (1969). Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli. J. Exp. Anal. Behav. 12, 167-173.
2. Balleine, B. W. (2001). Incentive processes in instrumental conditioning. In Handbook of Contemporary Learning Theories, EDN R. M. S. Klein, ed. (Hillsdale, NJ, LEA), pp. 307-366.
3. Balleine, B. W. (2005). Neural bases of food seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 86, 717-730.
4. Berlyne, D. E. C. (1960). Conflict arousal and curiosity (New York, McGraw-Hill).
5. Bitterman, M. E., Reed, P. C., and Kubala, A. L. (1953). The strength of sensory preconditioning. J. Exp. Psychol.: Anim. Behav. Process. 46, 178-182.
6. Bray, S., and O'Doherty, J. (2007). Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J. Neurophysiol. 97, 3036-3045.
7. Colwill, R. M., and Rescorla, R. A. (1988). Associations between the discriminative stimulus and the reinforcer in instrumental learning. J. Exp. Psychol.: Anim. Behav. Process. 14, 155-164.
8. Corbit, L. H., Muir, J. L., and Balleine, B. W. (2001). The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci. 21, 3251-3260.
9. Edgington, E. S. (1995). Randomized tests, 3rd edn. (New York, Marcel-Dekker).
10. Heikkila, R. E., Orlansky, H., Mytilineou, C., and Cohen, G. (1975). Amphetamine: evaluation of d-and l-isomers as releasing agents and uptake inhibitors for 3Hdopamine and 3H-norepinephrine in slices of rat neostriatum and cerebral cortex. J. Pharmacol. Exp. Ther. 194, 47-56.
11. Holman, J. G., and Mackintosh, N. J. (1981). The control of appetitive instrumental responding does not depend on classical conditioning to the discriminative stimulus. Q. J. Exp. Psychol. 33B, 21-31.
12. Holroyd, C. B., and Coles, M. G. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709.
13. Joel, D., Niv, Y., and Ruppin, E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural. Netw. 15, 535-547.
14. Killcross, A. S., Everitt, B. J., and Robbins, T. W. (1997). Symmetrical effects of amphetamine and alpha-flupenthixol on conditioned punishment and conditioned reinforcement: contrasts with midazolam. Psychopharmacology (Berl.) 129, 141-152.
15. Kish, G. B. (1966). Studies of sensory reinforcement. In Operant Behavior Areas of Research and Application, EDN W. K. Honig, ed. (New York, Appleton-Century-Crofts), pp. 109-159.
16. Konorski, J. (1948). Conditioned reflexes and neuron organization (Cambridge, Cambridge University Press).
17. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67, 145-163.
18. McClure, S. M., Daw, N. D., and Montague, P. R. (2003). A computational substrate for incentive salience. Trends Neurosci. 26, 423-428.
19. Mirenowicz, J., and Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72, 1024-1027.
20. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
21. Neely, J. H., and Wagner, A. R. (1974). Attenuation of blocking with shifts in reward: involvement of schedule-generated context cues. J. Exp. Psychol. 102, 751-763.
22. Olausson, P., Jentsch, J. D., and Taylor, J. R. (2004). Nicotine enhances responding with conditioned reinforcement. 171, 173-178.
23. Ostlund, S. B., Winterbauer, N. E., and Balleine, B. W. (2008). Theory of reward systems. In Learning and Memory A Comprehensive Reference-Volume 2 Learning Theory and Behavior, J. Byrne, ed. (Oxford, Elsevier).
24. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975.
25. Robbins, T. W. (1975). The potentiation of conditioned reinforcement by psychomotor stimulant drugs: a test of Hill's hypothesis. Psychopharmacologia 45, 103-114.
26. Robbins, T. W. (1976). Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs. Nature 264, 57-59.
27. Robbins, T. W., and Koob, G. F. (1978). Pipradrol enhances reinforcing properties of stimuli paired with brain stimulation. 8, 219-222.
28. Robbins, T. W., Watson, B. A., Gaskin, M., and Ennis, C. (1983). Contrasting interactions of pipradrol, d-amphetamine, cocaine, cocaine analogues, apomorphine and other drugs with conditioned reinforcement. Psychopharmacology (Berl.) 80, 113-119.
29. Robbins, T. W., Cador, M., Taylor, J. R., and Everitt, B. J. (1989). Limbic-striatal interactions in reward-related processes. Neurosci. Biobehav. Rev. 13, 155-162.
30. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
31. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
32. Seiden, L. S., Sabol, K. E., and Ricaurte, G. A. (1993). Amphetamine: effects on catecholamine systems and behavior. Annu. Rev. Pharmacol. Toxicol. 33, 639-677.
33. Steinfels, G. F., Heym, J., Strecker, R. E., and Jacobs, B. L. (1983). Response of dopaminergic neurons in cat to auditory stimuli presented across the sleep-waking cycle. Brain Res. 277, 150-154.
34. Sutton, R. S., and Barto, A. G. (1998). Reinforcement learning (Cambridge, Massachusetts, MIT Press).