Neurobehavioural mechanisms of reward and motivation

Current Opinion in Neurobiology

Volumn 6, Issue 2, 1996, Pages 228-236

  Robbins, Trevor W ^a   Everitt, Barry J ^a  

^a UK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE; GLUTAMIC ACID;

ANIMAL EXPERIMENT; BRAIN ELECTROPHYSIOLOGY; CORPUS STRIATUM; HUMAN; LEARNING; LIMBIC CORTEX; MOTIVATION; NEUROBIOLOGY; NEUROCHEMISTRY; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; RAT; REINFORCEMENT; REVIEW; REWARD;

EID: 0029995617     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0959-4388(96)80077-8     Document Type: Article

References (61)

1. Holland PC, Rescorla RA: The effect of two ways of devaluing the unconditioned stimulus after first and second order appetitive conditioning. J Exp Psychol [Anim Behav] 1975, 1:355-363.
2. Dickinson A, Balleine B: Motivational control of goal-directed action. Anim Learning Behav 1994, 22:1 -18. A very useful review of some of the progress made in understanding the psychological processes underlying goal-directed behaviour over the past decade or so.
3. Dickinson A: Instrumental conditioning. In Animal Learning and Cognition. Edited by Mackintosh NJ. San Diego: Academic Press; 1994:45-79.
4. White NM: Reward or reinforcement: what's the difference? Neurosci Biobehav Rev 1989, 13:181-186.
5. Koob GF: Dopamine, addiction and reward. Semin Neurosci 1992, 4:139-148.
6. Wise R: Neuroleptics and operant behavior: the anhedonia hypothesis. Behav Brain Sci 1992, 5:39-87.
7. Mogenson GJ, Jones DL, Yim CY: From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 1980, 14:69-97.
8. Robbins TW, Cador M, Taylor JR, Everitt BJ: Limbic-striatal Interactions in reward-related processes. Neurosci Biobehav Rev 1989, 13:155-162.
9. Heimer L, Zahm DS, Alheid GF: Basal ganglia. In The Rat Nervous System, edn 2. Edited by Paxinos G. Sydney: Academic Press; 1995:579-614. An excellent overview of the advances made - many by these authors themselves - in understanding the organization and connections of the dorsal and ventral striatum, including the demarcation of the 'core' and 'shell' territories of the nucleus accumbens.
10. Salamone J: The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav Brain Res 1994, 61:117-133.
11. Goeders NE, Guerin GF: Non-contingent electric footshock facilitates the acquisition of intravenous cocaine self-administration in rats. Psychopharmacology 1994, 114:63-70. A sophisticated demonstration of the effects of 'stress' to sensitize acquisition of drug-taking behaviour using the classic triadic design well known to those familiar with the 'learned helplessness' literature.
12. Phillips GD, Howes SR, Whitelaw RB, Wilkinson L, Robbins TW, Everitt BJ: Isolation-rearing enhances the locomotor response both to a novel environment and to cocaine, but impairs the intravenous self-administration of cocaine. Psychopharmacology 1994, 115:407-418. This paper illustrates how enhanced locomotor effects produced by psychomotor stimulants in socially deprived rats (previously shown to be associated with increased extracellular striatal dopamine) do not necessarily lead to enhanced reinforcing effects. The speculation is that adaptations in the limbic afferent structures serve to regulate dopamine release (and hence reinforcing efficacy of the self-administered drug) in the isolated rats.
13. Mayer LA, Parker LA: Rewarding and aversive properties of IP and SC cocaine: assessment by place and taste conditioning. Psychopharmacology 1993, 112:189-194.
14. Papp M, Klimek V, Willner P: Parallel changes in dopamine D2 receptor binding in limbic forebrain associated with chronic mild stress-induced anhedonia and its reversal by imipramine. Psychopharmacology 1994, 115:441-446.
15. Caine SB, Koob GF: Effects of dopamine D-1 and D-2 antagonists on cocaine self-administration under different schedules of reinforcement in the rat J Pharmacol Exp Ther 1994, 270:209-218. An elegant parametric study of the effects of dopamine receptor antagonists on responding maintained by cocaine and food in different portions of a multiple fixed ratio schedule of responding. Low doses of selective D1 receptor antagonists more potently reduced responding for cocaine than food, whereas the reverse was the case for D2 receptor antagonists. This double dissociation presumably indicates that cocaine and food have distinct reinforcing properties, separately mediated by different dopamine receptors, and rules out obvious motor effects of the dopamine blockers. A related study [16] implicates mesolimbic dopamine in the effects of cocaine, but not food, in maintaining operant behavior.
16. Caine SB, Koob GF: Effects of mesolimbic dopamine depletion on responding maintained by sucrose and food. J Exp Anal Behav1994, 61:213-221.
17. Hodge CW, Samson HH, Tolliver GA, Haraguchi M: Effects of intra-accumbens injections of dopamine agonists and antagonists on sucrose and sucrose-ethanol reinforced responding. Pharmacol Biochem Behav 1994, 48:141-150.
18. Ranaldi R, Beninger RJ: The effects of systemic and intracerebral injections of D1 and D2 agonists on brain stimulation reward. Brain Res 1994, 651:283-292.
19. Mitchell JB, Gratton A: Involvement of mesolimbic dopamine neurons In sexual behaviors: implications for the neurobiology of motivation. Rev Neurosci 1994, 5:317-329.
20. Hansen S: Maternal behavior of female rats with 6-OHDA lesions in the ventral striatum: characterization of the pup retrieval deficit Physiol Behav 1994, 55:615-620. The author demonstrates that deficits in maternal behaviour, such as in pup retrieval, following dopamine depletion from the ventral striatum can be ameliorated by separation of the lesioned mothers from their pups - a manipulation that increases maternal motivation
21. Everitt BJ: Sexual motivation: a neural and behavioral analysis of the mechanisms underlying appetitive copulatory responses of male rats. Neurosci Biobehav Rev 1990, 14:217-232.
22. •]).
23. Cousins MS, Salamone JD: Nucleus accumbens dopamine depletions in rats affect relative response allocation In a novel cost/benefit procedure. Pharmacol Biochem Behav 1994, 49:85-91.
24. Balleine B, Killcross S: Effects of ibotenic acid lesions of the nucleus accumbens on Instrumental action. Behav Brain Res 1994, 65:181-193. An ambitious attempt to define the functions of the nucleus accumbens in operant behaviour by testing the sensitivity of lesioned rats to changes in the value of the reward controlling both the lever press response and the entry to the food magazine. The results do not support a role for the nucleus accumbens in mediating instrumental action, although the general rate of lever pressing is reduced in lesioned rats and they exhibit signs of reduced motivational excitement via Pavlovian mechanisms. This approach represents an important interaction between animal learning theory and behavioural neuroscience that deserves further attention.
25. Ranaldi R, Beninger RJ: Dopamine D1 and D2 antagonists attenuate amphetamine-induced enhancement of responding for conditioned reward in rats. Psychopharmacology 1993, 113:110-118.
26. Wolterink G, Phillips G, Cador M, Donselaar-Wolterink I, Robbins TW, Everitt BJ: Relative roles of ventral striatal D1 and D2 dopamine receptors in responding with conditioned reinforcement Psychopharmacology 1993, 110:355-364.
27. ••]).
28. Phillips GD, Howes SR, Whitelaw RB, Everitt BJ, Robbins TW: Analysis of the effects of intra-accumbens SKF38393 and LY-171555 upon the behavioural satiety sequence. Psychopharmacology 1995, 117:82-90.
29. Di Chiara G, North RA: Neurobiology of opiate abuse. Trends Pharmacol Sci 1992, 13:185-193.
30. Pennartz CMA, Groenwegen HJ, Lopes da Silva F: The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Prog Neurobiol 1994, 42:719-761. An important synthesis of electrophysiological, anatomical and behavioural evidence that tries to make sense of the anatomical convergences and neurochemical compartmentalization of the ventral striatum. The concept of neuronal ensembles may allow us to explore the integration of information from different limbic sources in a learning context. The impression one has is that the behavioural data are only just beginning to address this concept.
31. Maldonado-Irizarry CS, Swanson CJ, Kelley AE: Glutamate receptors in the nucleus accumbens shell control feeding behavior in the lateral hypothalamus. J Neurosci 1995, 15:6779-6788. An important breakthrough study showing that blocking non-NMDA receptors in the shell compartment with DNQX elicits eating that is blocked by infusion of the GABAergic agonist muscimol into the lateral hypothalamus and therefore confirming a functional link between the shell and its anatomically defined outputs. An interesting question to ponder is the nature of neural and psychological controls over feeding exerted at the level of the nucleus accumbens.
32. Mark GP, Smith SE, Rada PV, Hoebel BG: An appetitively conditioned taste elicits a preferential increase in mesolimbic dopamine release. Pharmacol Biochem Behav 1994, 48:651-660. Describes experiments showing increases in extracellular dopamine in the nucleus accumbens, but not the dorsal striatum, in rats exposed to a mildly bitter conditioned taste stimulus paired with a nutritive gastric load, but not to a mildly sour taste paired with a non-nutritive gastric load. The authors suggest a role for conditioned dopamine release in ingestive responses acquired on the basis of the post-ingestive consequences of food.
33. •] by employing in vivo microdialysis rather than voltammetric methods, and apparently arriving at roughly similar conclusions.
34. Kiyatkin EA, Gratton A: Electrochemical monitoring of extracellular dopamine in nucleus accumbens of rats lever-pressing for food. Brain Res 1994, 652:225-234. The controversies over the chronoamperometric technique should not detract from this complex and largely convincing analysis of the temporal dynamics of instrumental (operant) behaviour and neurotransmitter function within the ventral striatum. The key finding is that the presumed dopamine signal peaks at the moment the animals press the lever, and is followed by an abrupt decrease as the animals retrieve and consume the food pellet.
35. •]). Similar work is also being performed by Sarter, Bruno and associates (see H Himmelheber et al., Soc Neurosci Abstr 1995, 25:763.6) and, while they endorse the concept of dopaminergic modulation of cortical acetylcholine, there are likely to be some disagreements about the exact behavioural context in which the cholinergic changes are seen.
36. Muir JL, Everitt BJ, Robbins TW: AMPA-induced excitotoxic lesions of the forebrain cholinergic systems: a significant role for the cortical cholinergic system in attentional function. J Neurosci 1994, 14:2313-2326.
37. Day J, Fibiger HC: Dopaminergic regulation of cortical acetylcholine release: effects of dopamine receptor agonists. Neuroscience 1993, 54:643-648.
38. Sarter M: Neuronal mechanisms of the attentional dysfunction in senile dementia and schizophrenia: two sides of the same coin? Psychopharmacology 1994, 114:539-550.
39. Fibiger HC: Mesolimbic dopamine: an analysis of Its role in motivated behavior. Semin Neurosci 1993, 5:321-327.
40. ••] emphasizing correlations with instrumental and anticipatory behaviour during presentation of conditioned stimuli. The possibility of fast transients in dopamine release that remain undetected by the microdialysis technique complicates the issue, but in our view, the controversy may be a product of interpretative emphasis and procedural factors rather than representing a serious theoretical discrepancy.
41. Fumero B, Fernandez Vera JR, Gonzalez Mora JL, Mas M: Changes in monoamine turnover In forebrain areas associated with masculine sexual behavior: a microdialysis study. Brain Res 1994, 662:233-239. These microdialysis experiments confirm the increase in extracellular dopamine in the nucleus accumbens of male rats exposed to oestrous, but not ovariectomized, female rats. In addition, the results show increased levels of the metabolites of dopamine and 5-HT (DOPAC and 5-HIAA, respectively) not only in the nucleus accumbens, but also in the medial preoptic area (strongly linked to the control of copulation in males) and the mediobasal hypothalamus. The relationship between neurochemical changes and sexual behaviour leads the authors to suggest the changes in DOPAC are related to appetitive sexual responses and those in 5-HIAA to copulation and ejaculation.
42. Fabre-Nys C, Blache D, Hinton MR, Goode JA, Kendrick KM: Microdialysis measurement of neurochemical changes in the mediobasal hypothalamus of ovariectomized ewes during oestrus. Brain Res 1994, 649:282-296.
43. Carelli RM, Deadwyler SA: A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats. J Neurosci 1994, 14:7735-7746. Comparisons such as this are valuable because they are so rare. They may have relevance for constructing a dimensional or attribute analysis of different reinforcers and their neural substrates, although the difficulty of equating the value and state dependence of the different reinforcers provides major difficulties.
44. Kosubud AE, Harris GC, Chaplin JK: Behavioral associations of neuronal activity in the ventral tegmental area of the rat J Neurosci 1994, 14:7117-7129.
45. Schultz W, Romo R, Ljungberg T, Mirenowicz J, Hollerman JR, Dickinson A: Reward-related signals carried by dopamine neurons. In Models of Information Processing in the Basal Ganglia. Edited by Houk JR, Davis JL, Beiser D. Cambridge, Massachusetts: MIT Press; 1995:233-248. This is an excellent review of several years' work on the functions of midbrain dopamine neurons in transmitting 'reward'-related signals. The most intriguing aspects are the transitional role of these neurons in coding initially the unconditioned stimulus and then the conditioned stimulus, and their application to a simple connectionist model of learning in the striatum. Several other chapters from this exceptionally interesting book are relevant to this topic.
46. Burns LH, Kelley AE, Everitt BJ, Robbins TW: Intra-amygdala infusion of the N-methyl-D-aspartate receptor antagonist AP-5 impairs acquisition but not performance of discriminated approach to a CS. Behav Neural Biol 1994, 61:242-250. This article demonstrates behaviourally selective deficits produced by low doses of NMDA receptor antagonists on conditioned approach to food, rather than learning in aversive contexts, which has been emphasized to date. This implication of the amygdala in appetitive as well as aversive motivation has important implications for how this structure governs reflexive, endocrine, autonomic and behavioural aspects of response output (see Figure 1).
47. Seamans JK, Phillips AG: Selective memory Impairments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats. Behav Neurosci 1994, 108:456-468. This article introduces a simple but effective technique for studying the role of aspects of the nucleus accumbens in spatial memory in rats. The use of a 'win-shift' optimal foraging paradigm leads to hypotheses about interactions in processing with the hippocampus and prefrontal cortex, possibly relevant to Pennartz et al.'s [30••] concept of ensembles.
48. •].
49. Maldonado-Irizarry CS, Kelley AE: Excitatory amino acid receptors within nucleus accumbens subregions differentially mediate spatial learning in the rat Behav Pharmacol 1995, 6:527-539. The authors find that 'core' regions of the nucleus accumbens are more sensitive to excitatory amino acid receptor manipulations than 'shell' regions; however, they find that there is no distinction with respect to receptor subtype. One of the first studies to have shown behavioural dissociations between core and shell regions that hence begin to map function onto anatomical differences.
50. Rloeger GE, Spruijt BM, Cools AR: Spatial localization in the Morris water maze in rats: acquisition is affected by Intra-accumbens Injections of the dopaminergic antagonist haloperidol. Behav Neurosci 1994, 108:927-934.
51. ••].
52. Burns LH, Everitt BJ, Kelley A, Robbins TW: Glutamate-dopamine interactions in the ventral striatum: role in locomotor activity and responding with conditioned reinforcement Psychopharmacology 1994, 115:516-528. Comparisons are made of the effects of pharmacological manipulation of glutamatergic transmission in the ventral striatum via infusions of NMDA and non-NMDA agonists and antagonists on locomotor activity, and the control of behaviour by appetitive conditioned reinforcement as affected by intra-accumbens amphetamine. The results support the hypothesis that the effects of conditioned associations are mediated by glutamate-dopamine interactions in the ventral striatum and are dissociable from locomotor activation.
53. •], shows how the apparently paradoxical pattern of effects of intra-accumbens infusions of the NMDA receptor antagonist AP-5 (blocking amphetamine-induced activity and yet by itself producing spontaneous hyperactivity) might possibly be understood in terms of an anatomical differentiation of these effects.
54. •].
55. Johnson PI, Stellar JR: N-methyl-D-aspartic acid-induced lesions of the nucleus accumbens and/or ventral pallidum fail to attenuate lateral hypothalamic self-stimulation reward. Brain Res 1994, 646:73-84. An elegant demonstration that 'rewarding' lateral hypothalamic stimulation may well be downstream to the ventral striatal and ventral pallidal modulatory systems. This finding serves to remind us that the nucleus accumbens is certainly not a 'reward centre' in the old sense and that brain-stimulation reward is a powerful method for precisely defining the microcircuitry relevant to motivational systems.
56. Olmstead MC, Franklin KBJ: Lesions of the pedunculopontine tegmental nucleus block drug-induced reinforcement but not amphetamine-induced locomotion. Brain Res 1994, 638:29-35. Another demonstration of dissociation between mechanisms controlling the hyperactivity produced by amphetamine from appetitive effects of this drug (and of morphine) using the conditioned place preference procedure. The study is especially interesting because of the brain stem level at which this dissociation is demonstrated, and because it shows that the Mogenson view that locomotion in the rat represents a prototypical response system for defining limbic-striatal interactions was an over-simplification. The exact localization and extent of the 'mesencephalic locomotor region' is thus still a matter to be resolved.
57. Bechara A, Harrington F, Nader K, Van der Kooy D: Neurobiology of motivation: double dissociation of two motivational mechanisms mediating opiate reward in drug-naive versus drug-dependent animals. Behav Neurosci 1992, 106:798-807.
58. Inglis WL, Dunbar JS, Winn P: Outflow from the nucleus accumbens to the pedunculopontine tegmental nucleus: a dissociation between locomotor activity and the acquisition of responding for conditioned reinforcement stimulated by D-amphetamine. Neuroscience 1994, 62:51-64. This paper is particularly noteworthy for the bizarre behavioural dispositions of the rats with lesions of the pedunculopontine region that respond indiscriminately at high rates on a lever with no programmed consequence following treatment with amphetamine and fail to show approach responses to the food magazine. The results show that amphetamine still has potent stimulatory effects in the lesioned rats but that the normal selective nature of the stimulation via control by conditioned appetitive stimuli is lost.
59. McDonald RJ, White NM: A triple dissociation of memory systems: hippocampus, amygdala and dorsal striatum. Behav Neurosci 1993, 107:3-22.
60. Thierry AM, Tassin JP, Blanc G, Glowinski J: Selective activation of the mesocortical dopamine system by stress. Nature 1976, 263:242-244.
61. Beck CH, Fibiger HC: Conditioned fear-induced changes in behavior and in the expression of the immediate early gene c-fos: with and without diazepam pretreatment J Neurosci 1995, 15:709-720. A nice demonstration using 'cellular imaging' to identify the potent changes produced in many limbic and non-limbic structures during an aversive experience in the rat. The important point for this article is that some of these structures (including the nucleus accumbens shell region) are components of a hypothetical 'reward' system, underlining the need now to define if and how the reward and aversive systems both overlap and interact at the neural level.