Research review: Dopamine transfer deficit: A neurobiological theory of altered reinforcement mechanisms in ADHD

Journal of Child Psychology and Psychiatry and Allied Disciplines

Volumn 49, Issue 7, 2008, Pages 691-704

  Tripp, Gail ^a,b   Wickens, Jeff R ^a,b  

^a OKINAWA INSTITUTE OF SCIENCE AND TECHNOLOGY GRADUATE UNIVERSITY   (Japan)

^b UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Attention deficit hyperactivity disorder; Dopamine; Neurobiology; Reinforcement mechanisms

Indexed keywords

DOPAMINE; METHYLPHENIDATE;

ANTICIPATION; ATTENTION DEFICIT DISORDER; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; DOPAMINERGIC NERVE CELL; DOPAMINERGIC TRANSMISSION; GENETIC VARIABILITY; HUMAN; NEUROBIOLOGY; NONHUMAN; PSYCHOLOGICAL THEORY; REINFORCEMENT; REVIEW;

ANIMALS; ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY; CHILD; CORPUS STRIATUM; CUES; DOPAMINE; EXTINCTION, PSYCHOLOGICAL; HUMANS; MOTIVATION; NERVE NET; NEURONAL PLASTICITY; NEURONS; NUCLEUS ACCUMBENS; RECEPTORS, DOPAMINE D1; REINFORCEMENT (PSYCHOLOGY); SIGNAL TRANSDUCTION; SUBSTANTIA NIGRA; VENTRAL TEGMENTAL AREA;

EID: 47349119960     PISSN: 00219630     EISSN: 14697610     Source Type: Journal    
DOI: 10.1111/j.1469-7610.2007.01851.x     Document Type: Review

References (106)

1. Aase, H. Sagvolden, T. (2006). Infrequent, but not frequent, reinforcers produce more variable responding and deficient sustained attention in young children with attention-deficit/hyperactivity disorder (ADHD). Journal of Child Psychology and Psychiatry, 47, 457 471.
2. Ahn, S. Phillips, A.G. (2002). Modulation by central and basolateral amygdalar nuclei of dopaminergic correlates of feeding to satiety in the rat nucleus accumbens and medial prefrontal cortex. Journal of Neuroscience, 22, 10958 10965.
3. Ahn, S. Phillips, A.G. (2007). Dopamine efflux in the nucleus accumbens during within-session extinction, outcome-dependent, and habit-based instrumental responding for food reward. Psychopharmacology (Berlin), 191, 641 651.
4. American Psychiatric Association. (1994). DSM-IV: Diagnostic and statistical manual of mental disorders (4th edn). Washington DC.
5. Antrop, I., Stock, P., Verte, S., Wiersema, J.R., Baeyens, D. Roeyers, H. (2006). ADHD and delay aversion: The influence of non-temporal stimulation on choice for delayed rewards. Journal of Child Psychology and Psychiatry, 47, 1152 1158.
6. Arbuthnott, G.W. Wickens, J. (2007). Space, time and dopamine. Trends in Neuroscience, 30, 62 69.
7. Beninger, R.J., Cheng, M., Hahn, B.L., Hoffman, D.C., Mazurski, E.J., Morency, M.A., et al. (1987). Effects of extinction, pimozide, SCH 23390, and metoclopramide on food-rewarded operant responding of rats. Psychopharmacology (Berlin), 92, 343 349.
8. Beninger, R.J. Freedman, N.L. (1982). The use of two operants to examine the nature of pimozide-induced decreases in responding for brain stimulation. Physiological Psychology, 10, 409 412.
9. Beninger, R.J. Miller, R. (1998). Dopamine D1-like receptors and reward-related incentive learning. Neuroscience and Biobehavioral Reviews, 22, 335 345.
10. Biederman, J., Faraone, S.V., Keenan, K., Benjamin, J., Krifcher, B., Moore, C., et al. (1992). Further evidence for family-genetic risk factors in attention deficit hyperactivity disorder. Patterns of comorbidity in probands and relatives psychiatrically and pediatrically referred samples. Archives of General Psychiatry, 49, 728 738.
11. Black, J., Belluzzi, J.D. Stein, L. (1985). Reinforcement delay of one second severely impairs acquisition of brain self-stimulation. Brain Research, 359, 113 119.
12. Bobb, A.J., Castellanos, F.X., Addington, A.M. Rapoport, J.L. (2006). Molecular genetic studies of ADHD: 1991 to 2004. American Journal of Medical Genetics B Neuropsychiatric Genetics, 132, 109 125.
13. Cador, M., Robbins, T.W. Everitt, B.J. (1989). Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum. Neuroscience, 30, 77 86.
14. Cardinal, R.N., Pennicott, D.R., Sugathapala, C.L., Robbins, T.W. Everitt, B.J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science, 292, 2499 2501.
15. Cardinal, R.N., Robbins, T.W. Everitt, B.J. (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berlin), 152, 362 375.
16. Cardinal, R.N., Winstanley, C.A., Robbins, T.W. Everitt, B.J. (2004). Limbic corticostriatal systems and delayed reinforcement. Annals of the New York Academy of Sciences, 1021, 33 50.
17. Castellanos, F.X. Tannock, R. (2002). Neuroscience of attention-deficit/hyperactivity disorder: The search for endophenotypes. Nature Reviews in Neuroscience, 3, 617 628.
18. Catania, A.C. (2005). Attention-deficit/hyperactivity disorder (ADHD): Delay-of-reinforcement gradients and other behavioral mechanisms. Precommentary on Sagvolden et al., 2005. Behavioral and Brain Sciences, 28, 419 425.
19. Cheer, J.F., Aragona, B.J., Heien, M.L., Seipel, A.T., Carelli, R.M. Wightman, R.M. (2007). Coordinated accumbal dopamine release and neural activity drive goal-directed behavior. Neuron, 54, 237 244.
20. Corbett, D. Wise, R.A. (1980). Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: A moveable electrode mapping study. Brain Research, 185, 1 15.
21. Critchfield, T.S. Lattal, K.A. (1993). Acquisition of a spatially defined operant with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 59, 373 387.
22. Cunningham, S.J. Knights, R.M. (1978). The performance of hyperactive and normal boys under differing reward and punishment schedules. Journal of Pediatric Psychology, 3, 195 201.
23. Delgado, M.R. (2007). Reward-related responses in the human striatum. Annals of the New York Academy of Science, 1104, 70 88.
24. Delgado, M.R., Miller, M.M., Inati, S. Phelps, E.A. (2005). An fMRI study of reward-related probability learning. Neuroimage, 24, 862 873.
25. Dickinson, A., Watt, A. Griffiths, W. (1992). Free-operant acquisition with delayed reinforcement. Quarterly Journal of Experimental Psychology Section B Comparative Physiology and Psychology, 45, 241 258.
26. Dixon, A.L., Prior, M., Morris, P.M., Shah, Y.B., Joseph, M.H. Young, A.M. (2005). Dopamine antagonist modulation of amphetamine response as detected using pharmacological MRI. Neuropharmacology, 48, 236 245.
27. Dougherty, D.D., Bonab, A.A., Spencer, T.J., Rauch, S.L., Madras, B.K. Fischman, A.J. (1999). Dopamine transporter density in patients with attention deficit hyperactivity disorder. Lancet, 354, 2132 2133.
28. Faraone, S.V., Perlis, R.H., Doyle, A.E., Smoller, J.W., Goralnick, J.J., Holmgren, M.A., et al. (2005). Molecular genetics of attention-deficit/ hyperactivity disorder. Biological Psychiatry, 57, 1313 1323.
29. Feldon, J., Katz, Y. Weiner, I. (1988). The effects of haloperidol on the partial reinforcement extinction effect (PREE): Implications for neuroleptic drug action on reinforcement and nonreinforcement. Psychopharmacology (Berlin), 95, 528 533.
30. Ferster, C.B. (1953). Sustained behaviour under delayed reinforcement. Journal of Experimental Psychology, 45, 218 224.
31. Fiorillo, D.F., Coury, A. Phillips, A.G. (1997). Dynamic changes in nucleus accumbens dopamine efflux during the Coolidge effect in male rats. Journal of Neuroscience, 17, 4849 4855.
32. Firestone, P. Douglas, V. (1975). The effects of reward and punishment on reaction times and autonomic activity in hyperactive and normal children. Journal of Abnormal Child Psychology, 3, 201 216.
33. Freibergs, V. Douglas, V.I. (1969). Concept learning in hyperactive and normal children. Journal of Abnormal Psychology, 74, 388 395.
34. Galvan, A., Hare, T.A., Davidson, M., Spicer, J., Glover, G. Casey, B.J. (2005). The role of ventral frontostriatal circuitry in reward-based learning in humans. Journal of Neuroscience, 25, 8650 8656.
35. Garris, P.A., Kilpatrick, M., Bunin, M.A., Michael, D., Walker, Q.D. Wightman, R.M. (1999). Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature, 398, 67 69.
36. Garrud, P., Goodall, G. Mackintosh, N. (1981). Overshadowing of a stimulus-reinforcer association by an instrumental response. Journal of Experimental Psychology; Animal Behavior, 33, 123 135.
37. Gill, M., Daly, G., Heron, S., Hawi, Z. Fitzgerald, M. (1997). Confirmation of association between attention deficit hyperactivity disorder and a dopamine transporter polymorphism. Molecular Psychiatry, 2, 311 313.
38. Grice, G.R. (1948). The relation of secondary reinforcement to delayed reward in visual discrimination learning. Journal of Experimental Psychology, 38, 1 16.
39. Haenlein, M. Caul, W.F. (1987). Attention deficit disorder with hyperactivity: A specific hypothesis of reward dysfunction. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 356 362.
40. Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., et al. (2004). A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance imaging study of a stochastic decision task. Journal of Neuroscience, 24, 1660 1665.
41. Hassani, O.K., Cromwell, H.C. Schultz, W. (2001). Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. Journal of Neurophysiology, 85, 2477 2489.
42. Hill, R. (1970). Facilitation of conditioned reinforcement as a mechanism of psychomotor stimulation. In E. Costa S. Garattini (Eds Amphetamines and related compounds (pp. 781 795). New York : Raven Press.
43. Hoerger, M.L. Mace, F.C. (2006). A computerized test of self-control predicts classroom behavior. Journal of Applied Behaviour Analysis, 39, 147 159.
44. Hyland, B.I., Reynolds, J.N., Hay, J., Perk, C.G. Miller, R. (2002). Firing modes of midbrain dopamine cells in the freely moving rat. Neuroscience, 114, 475 492.
45. Hynd, G.W., Hern, K.L., Novey, E.S., Eliopulos, D., Marshall, R., Gonzalez, J.J., et al. (1993). Attention deficit-hyperactivity disorder and asymmetry of the caudate nucleus. Journal of Child Neurology, 8, 339 347.
46. Kandel, E.R. Tauc, L. (1965). Mechanisms of heterosynaptic facilitation in the giant cell of the abdominal ganglion of Aplysia delipans. Journal of Physiology (London), 181, 28 47.
47. Killeen, P.R. Sitomer, M.T. (2003). MPR. Behavioural Processes, 62, 49 64.
48. Knutson, B. Cooper, J.C. (2005). Functional magnetic resonance imaging of reward prediction. Current Opinion in Neurology, 18, 411 417.
49. Knutson, B. Gibbs, S.E. (2007). Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berlin), 191, 813 822.
50. Lattal, K.A. Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 16, 27 39.
51. Ljungberg, T., Apicella, P. Schultz, W. (1991). Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Research, 567, 337 341.
52. Lou, H.C., Henriksen, L., Bruhn, P., Borner, H. Nielsen, J.B. (1989). Striatal dysfunction in attention deficit and hyperkinetic disorder. Archives of Neurology, 46, 48 52.
53. Luman, M., Oosterlaan, J. Sergeant, J.A. (2005). The impact of reinforcement contingencies on AD/HD: A review and theoretical appraisal. Clinical Psychology Reviews, 25, 183 213.
54. Miller, R., Wickens, J.R. Beninger, R. (1990). Dopamine D-1 and D-2 receptors in relation to reward and performance: A case for the D-1 receptor as a primary site of therapeutic action of neuroleptic drugs. Progress in Neurobiology, 34, 143 183.
55. Mirenowicz, J. Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology, 72, 1024 1027.
56. Mirenowicz, J. Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature, 379, 449 451.
57. Morris, G., Nevet, A., Arkadir, D., Vaadia, E. Bergman, H. (2006). Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience, 9, 1057 1063.
58. Myers, N.A. (1960). Extinction following partial and continuous primary and secondary reinforcement. Journal of Experimental Psychology, 60, 172 179.
59. Nakazato, T. (2005). Striatal dopamine release in the rat during a cued lever-press task for food reward and the development of changes over time measured using high-speed voltammetry. Experimental Brain Research, 166, 137 146.
60. Neef, N.A., Marckel, J., Ferreri, S.J., Bicard, D.F., Endo, S., Aman, M.G., et al. (2005). Behavioral assessment of impulsivity: A comparison of children with and without attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 38, 23 37.
61. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K. Dolan, R.J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452 454.
62. Pan, W.X., Schmidt, R., Wickens, J.R. Hyland, B.I. (2005a). A unified theory of extinction: Suggested by midbrain dopamine cell activity and temporal difference model. Society for Neuroscience Abstracts, 69.18.
63. Pan, W.X., Schmidt, R., Wickens, J.R. Hyland, B.I. (2005b). Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network. Journal of Neuroscience, 25, 6235 6242.
64. Parkinson, J.A., Dalley, J.W., Cardinal, R.N., Bamford, A., Fehnert, B., Lachenal, G., et al. (2002). Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: Implications for mesoaccumbens dopamine function. Behavioral Brain Research, 137, 149 163.
65. Parry, P.A. Douglas, V.I. (1983). Effects of reinforcement on concept identification in hyperactive children. Journal of Abnormal Child Psychology, 11, 327 340.
66. Phillips, P.E., Stuber, G.D., Heien, M.L., Wightman, R.M. Carelli, R.M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature, 422, 614 618.
67. Renner, E.K. (1964). Delay of reinforcement: A historical review. Psychological Bulletin, 61, 341 361.
68. Reynolds, J.N.J., Hyland, B.I. Wickens, J.R. (2001). A cellular mechanism of reward-related learning. Nature, 413, 67 70.
69. Robbins, T.W. (1975). The potentiation of conditioned reinforcement by psychomotor stimulant drugs. A test of Hill's hypothesis. Psychopharmacologia (Berlin), 45, 103 114.
70. Robbins, T.W. (1978). The acquisition of responding with conditioned reinforcement: Effects of pipradol, methylphenidate, d-amphetamine, and nomifensine. Psychopharmacology, 58, 79 87.
71. Sagvolden, T., Aase, H., Zeiner, P. Berger, D. (1998). Altered reinforcement mechanisms in attention-deficit/hyperactivity disorder. Behavioral Brain Research, 94, 61 71.
72. Sagvolden, T., Johansen, E.B., Aase, H. Russell, V.A. (2005). A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. Behavioral Brain Science, 28, 397 419.
73. Scheres, A., Dijkstra, M., Ainslie, E., Balkan, J., Reynolds, B., Sonuga-Barke, E., et al. (2006). Temporal and probabilistic discounting of rewards in children and adolescents: Effects of age and ADHD symptoms. Neuropsychologia, 44, 2092 2103.
74. Scheres, A., Milham, M.P., Knutson, B. Castellanos, F.X. (2007). Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/ hyperactivity disorder. Biological Psychiatry, 61, 720 724.
75. Schoenbaum, G., Setlow, B., Saddoris, M.P. Gallagher, M. (2003). Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron, 39, 855 867.
76. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1 27.
77. Schultz, W. (2000). Multiple reward signals in the brain. Nature Reviews Neuroscience, 1, 199 207.
78. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241 263.
79. Schultz, W. (2004). Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Current Opinion in Neurobiology, 14, 139 147.
80. Sergeant, J. (2000). The cognitive-energetic model: An empirical approach to attention-deficit hyperactivity disorder. Neuroscience and Biobehavioral Reviews, 24, 7 12.
81. Sonuga-Barke, E.J. (2002). Psychological heterogeneity in AD/HD - a dual pathway model of behaviour and cognition. Behavioural Brain Research, 130, 29 36.
82. Sonuga-Barke, E.J. (2003). The dual pathway model of AD/HD: An elaboration of neuro-developmental characteristics. Neuroscience and Biobehavioral Reviews, 27, 593 604.
83. Sonuga-Barke, E.J., Taylor, E., Sembi, S. Smith, J. (1992). Hyperactivity and delay aversion - I. The effect of delay on choice. Journal of Child Psychology and Psychiatry, 33, 387 398.
84. Stein, L., Xue, B.G. Belluzzi, J.D. (1994). In vitro reinforcement of hippocampal bursting: A search for Skinner's atoms of behavior. Journal of the Experimental Analysis of Behavior, 61, 155 168.
85. Swanson, J.M., Flodman, P., Kennedy, J., Spence, M.A., Moyzis, R., Schuck, S., et al. (2000). Dopamine genes and ADHD. Neuroscience and Biobehavioral Reviews, 24, 21 25.
86. Swanson, J.M., Sunohara, G.A., Kennedy, J.L., Regino, R., Fineberg, E., Wigal, T., et al. (1998). Association of the dopamine receptor D4 (DRD4) gene with a refined phenotype of attention deficit hyperactivity disorder (ADHD): A family-based approach. Molecular Psychiatry, 3, 38 41.
87. Tarpy, R. Sawabini, F.L. (1974). Reinforcement delay: A selective review of the last decade. Psychological Bulletin, 81, 984 997.
88. Tripp, G. Alsop, B. (1999a). Age-related changes in sensitivity to relative reward frequency. New Zealand Journal of Psychology, 28, 24 30.
89. Tripp, G. Alsop, B. (1999b). Sensitivity to reward frequency in boys with attention-deficit hyperactivity disorder. Journal of Clinical Child Psychology, 28, 366 375.
90. Tripp, G. Alsop, B. (2001). Sensitivity to reward delay in children with attention deficit hyperactivity disorder (ADHD). Journal of Child Psychology and Psychiatry, 42, 691 698.
91. Ungless, M.A., Magill, P.J. Bolam, J.P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science, 303, 2040 2042.
92. Wade, T.R., de Wit, H. Richards, J.B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berlin), 150, 90 101.
93. Wender, P.H. (1971). Minimal brain dysfunction syndrome in children. New York : Wiley.
94. Wender, P.H. (1972). The minimal brain dysfunction syndrome in children. Journal of Nervous and Mental Disorders, 155, 55 71.
95. Wender, P. H. (1974). Some speculations concerning a possible biochemical basis of minimal brain dysfunction. Life Science, 14, 1605 1621.
96. Wickens, J.R. (1990). Striatal dopamine in motor activation and reward-mediated learning. Steps towards a unifying model. Journal of Neural Transmission, 80, 9 31.
97. Wickens, J.R. (1993). A theory of the striatum. Oxford : Pergamon Press.
98. Wickens, J.R. (2000). Dopamine regulation of synaptic plasticity in the neostriatum: A cellular model of reinforcement. In R. Miller J. R. Wickens (Eds Brain dynamics and the striatal complex (pp. 65 76 Harwood Academic.
99. Wickens, J.R., Begg, A.J. Arbuthnott, G.W. (1996). Dopamine reverses the depression of rat cortico-striatal synapses which normally follows high frequency stimulation of cortex in vitro. Neuroscience, 70, 1 5.
100. Wickens, J.R., Horvitz, J.C., Costa, R.M. Killcross, S. (2007). Dopaminergic mechanisms in actions and habits. Journal of Neuroscience, 27, 8181 8183.
101. Wickens, J.R., Hyland, B.I. Tripp, E.G. (2006). Frontostriatal mechanisms in reinforcement: Implications for ADHD. In E. Bezard (Ed Recent breakthroughs in basal ganglia research (pp. 65 80). New York : Nova Science Publishers, Inc.
102. Wickens, J.R., Reynolds, J.N. Hyland, B.I. (2003). Neural mechanisms of reward-related motor learning. Current Opinion in Neurobiology, 13, 685 690.
103. Williams, J. Dayan, P. (2005). Dopamine, learning, and impulsivity: A biological account of attention-deficit/hyperactivity disorder. Journal of Child and Adolescent Psychopharmacology, 15, 160 179.
104. Winstanley, C.A., Theobald, D.E., Cardinal, R.N. Robbins, T.W. (2004). Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. Journal of Neuroscience, 24, 4718 4722.
105. Wise, R.A. (2006). Role of brain dopamine in food reward and reinforcement. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 361, 1149 1158.
106. Wise, R.A. Rompre, P.P. (1989). Brain dopamine and reward. Annual Review of Psychology, 40, 191 225.