Limbic corticostriatal systems and delayed reinforcement

Annals of the New York Academy of Sciences

Volumn 1021, Issue , 2004, Pages 33-50

  Cardinal, Rudolf N ^a   Winstanley, Catharine A ^a   Robbins, Trevor W ^a   Everitt, Barry J ^a  

^a UK   (United Kingdom)

Author keywords

Anterior cingulate cortex; Attention deficit hyperactivity disorder; Basolateral amygdala; Delayed reinforcement; Dopamine; Drug addiction; Impulsive choice; Impulsivity; Medial prefrontal cortex; Nucleus accumbens core; Orbitofrontal cortex; Serotonin

Indexed keywords

DOPAMINE; SEROTONIN;

ATTENTION DEFICIT DISORDER; BRAIN CORTEX; CINGULATE GYRUS; CONFERENCE PAPER; CORPUS STRIATUM; DEPTH PERCEPTION; HUMAN; LEARNING; LIMBIC SYSTEM; NEUROPSYCHIATRY; NONHUMAN; NUCLEUS ACCUMBENS; REINFORCEMENT; SIGNAL TRANSDUCTION;

ANIMALIA;

EID: 3042788322     PISSN: 00778923     EISSN: None     Source Type: Book Series    
DOI: 10.1196/annals.1308.004     Document Type: Conference Paper

References (139)

1. AINSLIE, G. 1975. Specious reward: a behavioural theory of impulsiveness and impulse control. Psychol. Bull. 82: 463-496.
2. ARISTOTLE. 1925. Nicomachean Ethics. [Originally written 350 B.C.] W.D. Ross, trans. Clarendon Press. Oxford.
3. EVENDEN, J.L. 1999. Varieties of impulsivity. Psychopharmacology 146: 348-361.
4. POULOS, C.X., A.D. LE & J.L. PARKER. 1995. Impulsivity predicts individual susceptibility to high levels of alcohol self-administration. Behav. Pharmacol. 6: 810-814.
5. BICKEL, W.K., A.L. ODUM & G.J. MADDEN. 1999. Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology 146: 447-454.
6. EVENDEN, J.L. 1999. Impulsivity: a discussion of clinical and experimental findings. J. Psychopharmacol. 13: 180-192.
7. HEYMAN, G.M. 1996. Resolving the contradictions of addiction. Behav. Brain Sci. 19: 561-610.
8. MITCHELL, S.H. 1999. Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology 146: 455-464.
9. SAGVOLDEN, T. et al. 1998. Altered reinforcement mechanisms in attention-deficit/hyperactivity disorder. Behav. Brain Res. 94: 61-71.
10. SAGVOLDEN, T. & J.A. SERGEANT. 1998. Attention deficit/hyperactivity disorder - from brain dysfunctions to behaviour. Behav. Brain Res. 94: 1-10.
11. THORNDIKE, E.L. 1911. Animal Intelligence: Experimental Studies. Macmillan. New York.
12. HULL, C.L. 1932. The goal gradient hypothesis and maze learning. Psychol. Rev. 39: 25-43.
13. LATTAL, K.A. & S. GLEESON. 1990. Response acquisition with delayed reinforcement. J. Exp. Psychol. Anim. Behav. Processes 16: 27-39.
14. DICKINSON, A., A. WATT & W.J.H. GRIFFITHS. 1992. Free-operant acquisition with delayed reinforcement. Q. J. Exp. Psychol. Sect. B Comp. Physiol. Psychol. 45: 241-258.
15. GRICE, G.R. 1948. The relation of secondary reinforcement to delayed reward in visual discrimination learning. J. Exp. Psychol. 38: 1-16.
16. KILLEEN, P.R. & J.G. FETTERMAN. 1988. A behavioral theory of timing. Psychol. Rev. 95: 274-295.
17. SPENCE, K.W. 1956. Behavior Theory and Conditioning. Prentice-Hall. Englewood Cliffs, NJ.
18. MOWRER, O.H. 1960. Learning Theory and Behavior. Wiley. New York.
19. REVUSKY, S. & J. GARCIA. 1970. Learned associations over long delays. In The Psychology of Learning and Motivation, Vol. 4. G.H. Bower, Ed.: 1-84. Academic Press. New York.
20. MACKINTOSH, N.J. 1974. The Psychology of Animal Learning. Academic Press. London.
21. DICKINSON, A. 1994. Instrumental conditioning. In Animal Learning and Cognition. N. J. Mackintosh, Ed.: 45-79. Academic Press. San Diego.
22. DICKINSON, A. & B. BALLEINE. 1994. Motivational control of goal-directed action. Anim. Learn. Behav. 22: 1-18.
23. CARDINAL, R. N. et al. 2002. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26: 321-352.
24. DICKINSON, A. 1980. Contemporary animal learning theory. Cambridge University Press. Cambridge.
25. MAZUR, J.E. 1987. An adjusting procedure for studying delayed reinforcement. In Quantitative Analyses of Behavior. V. The Effect of Delay and of Intervening Events on Reinforcement Value. M.L. Commons et al., Eds.: 55-73. Lawrence Erlbaum. Hillsdale, NJ.
26. MAZUR, J.E., J.R. STELLAR & M. WARACZYNSKI. 1987. Self-control choice with electrical stimulation of the brain as a reinforcer. Behav. Processes 15: 143-153.
27. RICHARDS, J.B. et al. 1997. Determination of discount functions in rats with an adjusting-amount procedure. J. Exp. Anal. Behav. 67: 353-366.
28. GRACE, R.C. 1996. Choice between fixed and variable delays to reinforcement in the adjusting-delay procedure and concurrent chains. J. Exp. Psychol. Anim. Behav. Processes 22: 362-383.
29. BRADSHAW, C.M. & E. SZABADI. 1992. Choice between delayed reinforcers in a discrete-trials schedule: the effect of deprivation level. Q. J. Exp. Psychol. B 44B: 1-16.
30. KACELNIK, A. 1997. Normative and descriptive models of decision making: time discounting and risk sensitivity. In Characterizing Human Psychological Adaptations (Ciba Foundation Symposium 208): 51-70. Wiley. Chiehester, UK.
31. CARDINAL, R.N., T.W. ROBBINS & B. J. EVERITT. 2003. Choosing delayed rewards: perspectives from learning theory, neurochemistry, and neuroanatomy. In Choice, Behavioral Economics and Addiction. N. Heather & R. Vuchinich, Eds.: 183-213, 217-218. Elsevier. Oxford.
32. SOUBRIÉ, P. 1986. Reconciling the role of central serotonin neurons in human and animal behavior. Behav. Brain Sci. 9: 319-335.
33. ÅSBERG, M., L. TRÄSKMAN & P. THORÉN. 1976. 5-HIAA in the cerebrospinal fluid: a biochemical suicide predictor. Arch. Gen. Psych. 33: 1193-1197.
34. LINNOILA, M. et al. 1983. Low cerebrospinal fluid 5-hydroxyindoleacetic acid concentration differentiates impulsive from nonimpulsive violent behavior. Life Sci. 33: 2609-2614.
35. BROWN, G.L. & M. LINNOILA. 1990. CSF serotonin metabolite (5HIAA) studies in depression, impulsivity and violence. J. Clin. Psych. 51(Suppl. 4): 31-41.
36. LINNOILA, M. et al. 1993. Impulse control disorders. International Clin. Psychopharmacol. 8(Suppl. 1): 53-56.
37. MEHLMAN, P.T. et al. 1994. Low CSF 5-HIAA concentrations and severe aggression and impaired impulse control in nonhuman primates. Am. J. Psychiatry 151: 1485-1491.
38. EVENDEN, J.L. 1998. Serotonergic and steroidal influences on impulsive behaviour in rats. Comprehensive Summaries of Uppsala Dissertations from the Faculty of Medicine. 764.
39. WOGAR, M.A., C.M. BRADSHAW & E. SZABADI. 1993. Effect of lesions of the ascending 5-hydroxytryptaminergic pathways on choice between delayed reinforcers. Psychopharmacology 111: 239-243.
40. RICHARDS, J.B. & L.S. SEIDEN. 1995. Serotonin depletion increases impulsive behavior in rats. Soc. Neurosci. Abstr. 21: 1693.
41. BIZOT, J. et al. 1999. Serotonin and tolerance to delay of reward in rats. Psychopharmacology 146: 400-412.
42. MOBINI, S. et al. 2000. Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 152: 390-397.
43. HO, M.Y. et al. 1999. Theory and method in the quantitative analysis of "impulsive choice" behaviour: implications for psychopharmacology. Psychopharmacology 146: 362-372.
44. MOBINI, S. et al. 2000. Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology 149: 313-318.
45. POULOS, C.X., J.L. PARKER & A.D. LE. 1996. Dexfenfluramine and 8-OH-DPAT modulate impulsivity in a delay-of-reward paradigm: implications for a correspondence with alcohol consumption. Behav. Pharmacol. 7: 395-399.
46. EVENDEN, J.L. & C.N. RYAN. 1999. The pharmacology of impulsive behaviour in rats VI: the effects of ethanol and selective serotonergic drugs on response choice with varying delays of reinforcement. Psychopharmacology 146: 413-421.
47. DALLEY, J.W. et al. 2002. Deficits in impulse control associated with tonically-elevated serotonergic function in rat prefrontal cortex. Neuropsychopharmacology 26: 716-728.
48. WINSTANLEY, C.A. et al. 2003. Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology 170: 320-321.
49. EVENDEN, J.L. & C.N. RYAN. 1996. The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128: 161-170.
50. BIGGIO, G. et al. 1974. Rapid depletion of serum tryptophan, brain tryptophan, serotonin and 5-hydroxyindoleacetic acid by a trytophan-free diet. Life Sci. 14: 1321-1329.
51. CLEMENS, J.A., D.R. BENNETT & R.W. FULLER. 1980. The effect of a tryptophan-free diet on prolactin and corticosterone release by serotonergic stimuli. Horm. Metab. Res. 12: 35-38.
52. DELGADO, P.L. et al. 1989. Neuroendocrine and behavioral effects of dietary tryptophan restriction in healthy subjects. Life Sci. 45: 2323-2332.
53. WILLIAMS, W.A. et al. 1999. Effects of acute tryptophan depletion on plasma and cerebrospinal fluid tryptophan and 5-hydroxyindoleacetic acid in normal volunteers. J. Neurochem. 72: 1641-1647.
54. CARPENTER, L.L. et al. 1998. Tryptophan depletion during continuous CSF sampling in healthy human subjects. Neuropsychopharmacology 19: 26-35.
55. WALDERHAUG, E. et al. 2002. Lowering of serotonin by rapid tryptophan depletion increases impulsiveness in normal individuals. Psychopharmacology 164: 385-391.
56. CREAN, J., J.B. RICHARDS & H. DE WIT. 2002. Effect of tryptophan depletion on impulsive behavior in men with or without a family history of alcoholism. Behav. Brain Res. 136: 349-357.
57. BRADLEY, C. 1937. The behavior of children receiving Benzedrine. Am. J. Psychiatry 94: 577-585.
58. FELDMAN, R.S., J.S. MEYER & L.F. QUENZER. 1997. Principles of neuropsychopharmacology. Sinauer. Sunderland, MA.
59. JOHANSEN, E.B. et al. 2002. Attention-deficit/hyperactivity disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction processes. Behav. Brain Res. 130: 37-45.
60. ZHUANG, X. et al. 2001. Hyperactivity and impaired response habituation in hyperdopaminergic mice. Proc. Natl. Acad. Sci. USA 98: 1982-1987.
61. SWANSON, J. et al. 1998. Cognitive neuroscience of attention deficit hyperactivity disorder and hyperkinetic disorder. Curr. Opin. Neurobiol. 8: 263-271.
62. SEEMAN, P. & B. MADRAS. 2002. Methylphenidate elevates resting dopamine which lowers the impulse-triggered release of dopamine: a hypothesis. Behav. Brain Res. 130: 79-83.
63. SOLANTO, M.V. 2002. Dopamine dysfunction in AD/HD: integrating clinical and basic neuroscience research. Behav. Brain Res. 130: 65-71.
64. WULTZ, B. et al. 1990. The spontaneously hypertensive rat as an animal model of attention-deficit hyperactivity disorder: effects of methylphenidate on exploratory behavior. Behav. Neural Biol. 53: 88-102.
65. SAGVOLDEN, T. et al. 1992. The spontaneously hypertensive rat (SHR) as an animal model of childhood hyperactivity (ADHD): changed reactivity to reinforcers and to psychomotor stimulants. Behav. Neural Biol. 58: 103-112.
66. SAGVOLDEN, T., M.B. PETTERSEN & M.C. LARSEN. 1993. Spontaneously hypertensive rats (SHR) as a putative animal model of childhood hyperkinesis: SHR behavior compared to four other rat strains. Physiol. Behav. 54: 1047-1055.
67. SAGVOLDEN, T. 2000. Behavioral validation of the spontaneously hypertensive rat (SHR) as an animal model of attention-deficit/hyperactivity disorder (AD/HD). Neurosci. Biobehav. Rev. 24: 31-39.
68. EVENDEN, J.L. & B. MEYERSON. 1999. The behavior of spontaneously hypertensive and Wistar Kyoto rats under a paced fixed consecutive number schedule of reinforcement. Pharmacol. Biochem. Behav. 63: 71-82.
69. DE VILLIERS, A.S. et al. 1995. Alpha 2-adrenoceptor mediated inhibition of [3H]dopamine release from nucleus accumbens slices and monoamine levels in a rat model for attention-deficit hyperactivity disorder. Neurochem. Res. 20: 427-433.
70. RUSSELL, V. et al. 1998. Differences between electrically-, ritalin- and D-amphetamine- stimulated release of [H-3]dopamine from brain slices suggest impaired vesicular storage of dopamine in an animal model of attention-deficit hyperactivity disorder. Behav. Brain Res. 94: 163-171.
71. RUSSELL, V.A. 2000. The nucleus accumbens motor-limbic interface of the spontaneously hypertensive rat as studied in vitro by the superfusion slice technique. Neurosci. Biobehav. Rev. 24: 133-136.
72. RUSSELL, V. et al. 1995. Altered dopaminergic function in the prefrontal cortex, nucleus accumbens and caudate-putamen of an animal model of attention-deficit hyperactivity disorder - the spontaneously hypertensive rat. Brain Res. 676: 343-351.
73. PAPA, M. et al. 1996. Reduced CaMKII-positive neurons in the accumbens shell of an animal model of attention-deficit hyperactivity disorder. Neuroreport 7: 3017-3020.
74. PAPA, M., J.A. SERGEANT & A.G. SADILE. 1998. Reduced transduction mechanisms in the anterior accumbal interface of an animal model of attention-deficit hyperactivity disorder. Behav. Brain Res. 94: 187-195.
75. CAREY, M.P. et al. 1998. Differential distribution, affinity and plasticity of dopamine D-1 and D-2 receptors in the target sites of the mesolimbic system in an animal model of ADHD. Behav. Brain Res. 94: 173-185.
76. KUNTSI, J., J. OOSTERLAAN & J. STEVENSON. 2001. Psychological mechanisms in hyperactivity. I. Response inhibition deficit, working memory impairment, delay aversion, or something else? J. Child Psychol. Psychiatry 42: 199-210.
77. SONUGA-BARKE, E.J. 2002. Psychological heterogeneity in AD/HD - a dual pathway model of behaviour and cognition. Behav. Brain Res. 130: 29-36.
78. SOLANTO, M.V. 1998. Neuropsychopharmacological mechanisms of stimulant drug action in attention-deficit hyperactivity disorder: a review and integration. Behav. Brain Res. 94: 127-152.
79. RICHARDS, J.B., K.E. SABOL & H. DE WIT. 1999. Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats. Psychopharmacology 146: 432-439.
80. WADE, T.R., H. DE WIT & J.B. RICHARDS. 2000. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology 150: 90-101.
81. DE WIT, H., J.L. ENGGASSER & J.B. RICHARDS. 2002. Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology 27: 813-825.
82. RICHARDS, J.B. et al. 1997. Comparison of two models of impulsive behavior in rats: effects of amphetamine and haloperidol. Soc. Neurosci. Abstr. 23: 2406.
83. CHARRIER, D. & M.H. THIEBOT. 1996. Effects of psychotropic drugs on rat responding in an operant paradigm involving choice between delayed reinforcers. Pharmacol. Biochem. Behav. 54: 149-157.
84. LOGUE, A.W. et al. 1992. Cocaine decreases self-control in rats: a preliminary report. Psychopharmacology 109: 245-247.
85. LATTAL, K.A. 1987. Considerations in the experimental analysis of reinforcement delay. In Quantitative Analyses of Behavior. V. The Effect of Delay and of Intervening Events on Reinforcement Value. M.L. Commons et al. Eds.:107-123. Lawrence Erlbaum. Hillsdale, NJ.
86. MAZUR, J.E. 1997. Choice, delay, probability, and conditioned reinforcement. Anim. Learn. Behav. 25: 131-147.
87. WILLIAMS, B.A. & R. DUNN. 1991. Preference for conditioned reinforcement. J. Exp. Anal. Behav. 55: 37-46.
88. CARDINAL, R. N., T.W. ROBBINS & B.J. EVERITT. 2000. The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology 152: 362-375.
89. HILL, R.T. 1970. Facilitation of conditioned reinforcement as a mechanism of psychomotor stimulation. In International Symposium on Amphetamines and Related Compounds. E. Costa & S. Garattini, Eds.: 781-795. Raven Press. New York.
90. ROBBINS, T.W. 1976. Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs. Nature 264: 57-59.
91. ROBBINS, T.W. 1978. The acquisition of responding with conditioned reinforcement: effects of pipradrol, methylphenidate, d-amphetamine, and nomifensine. Psychopharmacology 58: 79-87.
92. ROBBINS, T.W. et al. 1983. Contrasting interactions of pipradrol, d-amphetamine, cocaine, cocaine analogues, apomorphine and other drugs with conditioned reinforcement. Psychopharmacology 80: 113-119.
93. RACHLIN, H., A. RAINERI & D. CROSS. 1991. Subjective probability and delay. J. Exp. Anal. Behav. 55: 233-244.
94. MYERSON, J. & L. GREEN. 1995. Discounting of delayed rewards: models of individual choice. J. Exp. Anal. Behav. 64: 263-276.
95. PARKINSON, J.A., R.N. CARDINAL & B.J. EVERITT. 2000. Limbic cortical-ventral striatal systems underlying appetitive conditioning. Prog. Brain Res. 126: 263-285.
96. ROBBINS, T.W. & B.J. EVERITT. 1996. Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 6: 228-236.
97. SALAMONE, J.D., M.S. COUSINS & B.J. SNYDER. 1997. Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev. 21: 341-359.
98. EVERITT, B.J. et al. 1999. Associative processes in addiction and reward: the role of amygdala-ventral striatal subsystems. Ann. N.Y. Acad. Sci. 877: 412-438.
99. BUSSEY, T.J. et al. 1997. Triple dissociation of anterior cingulate, posterior cingulate, and medial frontal cortices on visual discrimination tasks using a touchscreen testing procedure for the rat. Behav. Neurosci. 111: 920-936.
100. BUSSEY, T.J., B.J. EVERITT & T.W. ROBBINS. 1997. Dissociable effects of cingulate and medial frontal cortex lesions on stimulus-reward learning using a novel Pavlovian autoshaping procedure for the rat: implications for the neurobiology of emotion. Behav. Neurosci. 111: 908-919.
101. PARKINSON, J.A. et al. 2000. Disconnection of the anterior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: Further evidence for limbic cortical-ventral striatopallidal systems. Behav, Neurosci. 114: 42-63.
102. BALLEINE, B.W. & A. DICKINSON. 1998. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
103. BECHARA, A. et al. 1999. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 19: 5473-5481.
104. TZSCHENTKE, T.M. 2000. The medial prefrontal cortex as a part of the brain reward system. Amino Acids 19: 211-219.
105. RICHARDSON, N.R. & A. GRATTON. 1998. Changes in medial prefrontal cortical dopamine levels associated with response-contingent food reward: an electrochemical study in rat. J. Neurosci. 18: 9130-9138.
106. HALLIDAY, G., A. HARDING & G. PAXINOS. 1995. Serotonin and tachykinin systems. In The Rat Nervous System. G. Paxinos, Ed.: 929-974. Academic Press. London.
107. FALLON, J.H. & S.E. LOUGHLIN. 1995. Substantia nigra. In The Rat Nervous System. G. Paxinos, Ed.: 215-237. Academic Press. London.
108. ERNST, M. et al. 1998. DOPA decarboxylase activity in attention deficit hyperactivity disorder adults. A [fluorine-18]fluorodopa positron emission tomographic study. J. Neurosci. 18: 5901-5907.
109. BUSH, G. et al. 1999. Anterior cingulate cortex dysfunction in attention-deficit/hyperactivity disorder revealed by fMRI and the Counting Stroop. Biol. Psychiatry 45: 1542-1552.
110. RUBIA, K. et al. 1999. Hypofrontality in attention deficit hyperactivity disorder during higher-order motor control: a study with functional MRI. Am. J. Psychiatry 156: 891-896.
111. SADILE, A.G. 2000. Multiple evidence of a segmental defect in the anterior forebrain of an animal model of hyperactivity and attention deficit. Neurosci. Biobehav. Rev. 24: 161-169.
112. PAPA, M., S. SELLITTI & A.G. SADILE. 2000. Remodeling of neural networks in the anterior forebrain of an animal model of hyperactivity and attention deficits as monitored by molecular imaging probes. Neurosci. Biobehav. Rev. 24: 149-156.
113. CARDINAL, R.N. et al. 2001. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292: 2499-2501.
114. BALLEINE, B. & S. KILLCROSS. 1994. Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action. Behav. Brain Res. 65: 181-93.
115. BROWN, V.J. & E.M. BOWMAN. 1995. Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions of the nucleus accumbens. Eur. J. Neurosci. 7: 2479-2485.
116. READING, P.J. & S.B. DUNNETT. 1991. The effects of excitotoxic lesions of the nucleus accumbens on a matching to position task. Behav. Brain Res. 46: 17-29.
117. SALAMONE, J. D. 1994. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61: 117-133.
118. PARKINSON, J.A., T.W. ROBBINS & B.J. EVERITT. 1999. Selective excitotoxic lesions of the nucleus accumbens core and shell differentially affect aversive Pavlovian conditioning to discrete and contextual cues. Psychobiology 27: 256-266.
119. MUIR, J.L., B.J. EVERITT & T.W. ROBBINS. 1996. The cerebral cortex of the rat and visual attentional function: dissociable effects of mediofrontal, cingulate, anterior dorsolateral, and parietal cortex lesions on a five-choice serial reaction time task. Cereb. Cortex 6: 470-481.
120. WALTON, M.E., D.M. BANNERMAN & M.F. RUSHWORTH. 2002. The role of rat medial frontal cortex in effort-based decision making. J. Neurosci. 22: 10996-11003.
121. WALTON, M.E. et al. 2003. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J. Neurosci. 23: 6475-6479.
122. DIETRICH, A. & J.D. ALLEN. 1998. Functional dissociation of the prefrontal cortex and the hippocampus in timing behavior. Behav. Neurosci. 112: 1043-1047.
123. CATANIA, A.C. 1970. Reinforcement schedules and psychophysical judgment: A study of some temporal properties of behavior. In The Theory of Reinforcement Schedules. W.N. Schoenfeld, Ed.: 1-42. Appleton Century Crofts. New York.
124. ROBERTS, S. 1981. Isolation of an internal clock. J. Exp. Psychol. Anim. Behav. Processes 7: 242-268.
125. MOBINI, S. et al. 2002. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 160: 290-298.
126. KHERAMIN, S. et al. 2002. Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology 165: 9-17.
127. PARKINSON, J.A. et al. 1999. Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive Pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by d-amphetamine. J. Neurosci. 19: 2401-2411.
128. CHRISTAKOU, A., T.W. ROBBINS &. B.J. EVERITT. 2004. Prefrontal cortico-ventral striatal interactions involved in affective modulation of attentional performance: implications for corticostriated circuit function. J. Neurosci. 24: 773-780.
129. COLE, B.J. & T.W. ROBBINS. 1989. Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi on performance of a 5-choice serial reaction time task in rats: implications for theories of selective attention and arousal. Behav. Brain Res. 33: 165-179.
130. AMERICAN PSYCHIATRIC ASSOCIATION. 2000. Diagnostic and Statistical Manual of Mental Disorders, 4th ed., text revision (DSM-IV-TR). Washington, DC.
131. KOOB, G.F., P.P. SANNA & F.E. BLOOM. 1998. Neuroscience of addiction. Neuron 21: 467-476.
132. USA. 2001. Leading Causes Charts (National Center for Injury Prevention and Control, Centers for Disease Control and Prevention, 〈www.cdc.gov/ ncipc/osp/charts.htm〉).
133. KELLEY, A.E., T SCHOCKET & C.F. LANDRY. 2004. Risk taking and novelty seeking in adolescence: Introduction to Part I. Ann. N. Y. Acad. Sci. 1021: 27-32.
134. DAHL, R.E. 2004. Adolescent brain development: a period of vulnerabilities and opportunities. Keynote address. Ann. N. Y. Acad. Sci. 1021: 1-22.
135. WINSTANLEY, C.A. et al. 2004. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J. Neurosci. In press.
136. SCHRAMM, N.L.. R.E. EGLI & D.G. WINDER. 2002. LTP in the mouse nucleus accumbens is develpmentally regulated. Synapse 45: 213-219.
137. PHILPOT, R.M., S. MCQUOWN & C.L. KIRSTEIN. 2001. Stereotaxic localization of the developing nucleus accumbens septi. Brain Res. Dev. Brain Res. 130: 149-150.
138. ANDERSEN, S.L. & M.H. TEICHER. 2000. Sex differences in dopamine receptors and their relevance to ADHD. Neurosci. Behav. Rev. 24: 137-141.
139. ADRIANI, W. & G. LAVIOLA. 2003. Elevated levels of impulsivity and reduced place conditioning with d-amphetamine: two behavioral features of adolescence in mice. Behav. Neurosci. 117: 695-703.