Identifying the neurobiology of altered reinforcement sensitivity in ADHD: A review and research agenda

Neuroscience and Biobehavioral Reviews

Volumn 34, Issue 5, 2010, Pages 744-754

  Luman, Marjolein ^a   Tripp, Gail ^b   Scheres, Anouk ^c,d  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b OKINAWA INSTITUTE OF SCIENCE AND TECHNOLOGY GRADUATE UNIVERSITY   (Japan)

^c University of Arizona   (United States)

^d RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

ADHD; Dopamine; Etiology; Motivation; Neurobiology; Neuroimaging; Predictions; Reinforcement; Reward

Indexed keywords

DOPAMINE;

ACADEMIC ACHIEVEMENT; ATTENTION DEFICIT DISORDER; AVERSION; COGNITIVE DEFECT; DOPAMINERGIC TRANSMISSION; HUMAN; LEARNING; MEMORY DISORDER; MOTIVATION; NEUROBIOLOGY; NEUROCHEMISTRY; NEUROPATHOLOGY; NONHUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REVIEW; REWARD; SIGNAL TRANSDUCTION; WORKING MEMORY;

ANIMALS; ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY; BRAIN; DOPAMINE; HUMANS; MODELS, NEUROLOGICAL; REINFORCEMENT (PSYCHOLOGY);

EID: 77649339532     PISSN: 01497634     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2009.11.021     Document Type: Review

References (92)

1. Aase H., and Sagvolden T. Infrequent, but not frequent, reinforcers produce more variable responding and deficient sustained attention in young children with attention-deficit/hyperactivity disorder (ADHD). J. Child Psychol. Psychiatry 47 (2006) 457-471
2. Alsop B. Problems with spontaneously hypertensive rats (SHR) as a model of attention-deficit/hyperactivity disorder (AD/HD). J. Neurosci. Methods 162 (2007) 42-48
3. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. (2000), Author, Washington, DC
4. Barkley R.A. Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychol. Bull. 121 (1997) 65-94
5. Barkley R.A., Edwards G., Laneri M., Fletcher K., and Metevia L.J. Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). J. Abnorm. Child Psychol. 29 (2001) 541-556
6. Blum K., Braverman E.R., Holder J.M., Lubar J.F., Monastra V.J., Miller D., Lubar J.O., Chen T.J., and Comings D.E. Reward deficiency syndrome: a biogenetic model for the diagnosis and treatment of impulsive, addictive, and compulsive behaviors. J. Psychoactive Drugs 32 Suppl. i-iv (2000) 1-112
7. Bush G., Valera E.M., and Seidman L.J. Functional neuroimaging of attention-deficit/hyperactivity disorder: a review and suggested future directions. Biol. Psychiatry 57 (2005) 1273-1284
8. Bymaster F.P., Katner J.S., Nelson D.L., Hemrick-Luecke S.K., Threlkeld P.G., Heiligenstein J.H., Morin S.M., Gehlert D.R., and Perry K.W. Atomoxetine increases extracellular levels of norepinephrine and dopamine in prefrontal cortex of rat: a potential mechanism for efficacy in attention deficit/hyperactivity disorder. Neuropsychopharmacology 27 (2002) 699-711
9. Casey B.J., Nigg J.T., and Durston S. New potential leads in the biology and treatment of attention deficit-hyperactivity disorder. Curr. Opin. Neurol. 20 (2007) 119-124
10. Castellanos F.X., and Tannock R. Neuroscience of attention-deficit/hyperactivity disorder: the search for endophenotypes. Nat. Rev. Neurosci. 3 (2002) 617-628
11. Cools R., Roberts A.C., and Robbins T.W. Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn. Sci. 12 (2007) 31-40
12. D'Ardenne K., McClure S.M., Nystrom L.E., and Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319 (2008) 1264-1267
13. Dougherty D.D., Bonab A.A., Spencer T.J., Rauch S.L., Madras B.K., and Fischman A.J. Dopamine transporter density in patients with attention deficit hyperactivity disorder. Lancet 354 (1999) 2132-2133
14. Douglas V.I. Can Skinnerian theory explain attention deficit disorder. A reply to Barkley. In: Bloomingdale L.M., and Sergeant J.A. (Eds). Attention Deficit Disorder: Current Concepts and Emerging Trends in Attentional and Behavioral Disorders of Childhood (1989), Pergamon, Elmsford, NY 235-254
15. Douglas V.I., and Parry P.A. Effects of reward and non-reward on frustration and attention in attention deficit disorder. J. Abnorm. Child Psychiatry 22 (1994) 281-302
16. Drechsler R., Rizzo P., and Steinhausen H.C. Decision-making on an explicit risk-taking task in preadolescents with attention-deficit/hyperactivity disorder. J. Neural Transm. 115 (2008) 201-209
17. Forbes E.E., Shaw D.S., and Dahl R.E. Alterations in reward-related decision making in boys with recent and future depression. Biol. Psychiatry 61 (2007) 633-639
18. Frank M.J. Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-medicated Parkinsonism. J. Cogn. Neurosci. 17 (2005) 51-72
19. Frank M.J., Santamaria A., O'Reilly R.C., and Willcutt E. Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 32 (2007) 1583-1599
20. Frank M.J., Scheres A., and Sherman S.J. Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philos. Trans. R. Soc. B 362 (2007) 1641-1654
21. Geurts H.M., van Meel C.S., and Luman M. What's in a game: The effect of social motivation on interference control in boys with ADHD and autism spectrum disorders. J. Child Psychol. Psychiatry 49 (2008) 848-857
22. Gizer I.R., Ficks C., and Waldman I.D. Candidate gene studies of ADHD: a meta-analytic review. Hum. Genet. 126 (2009) 51-90
23. Gomez R. Underlying processes in the poor response inhibition of children with attention-deficit/hyperactivity disorder. J. Atten. Disord. 6 (2003) 111-122
24. Gray J.A. The Neuropsychology of Anxiety: An Inquiry into the Functions of the Septo-hippocampal System (1982), Oxford University Press, Oxford
25. Gray J.A. Perspectives on anxiety and impulsivity: a commentary. J. Res. Pers. 21 (1987) 493-509
26. Grund T., Lehmann K., Bock N., Rothenberger A., and Teuchert-Noodt G. Influence of methylphenidate on brain development-an update of recent animal experiments. Behav. Brain Funct. 2 (2006) 2
27. Haenlein M., and Caul W.F. Attention deficit disorder with hyperactivity: a specific hypothesis of reward dysfunction. J. Am. Acad. Child Psychiatry 26 (1987) 356-362
28. Hand D.J., Fox A.T., and Reilly M.P. Response acquisition with delayed reinforcement in a rodent model of attention-deficit/hyperactivity disorder (ADHD). Behav. Brain Res. 175 (2006) 337-342
29. Holroyd C.B., Baker T.E., Kerns K.A., and Müller U. Electrophysiological evidence of atypical motivation and reward processing in children with attention-deficit hyperactivity disorder. Neuropsychologia 46 (2008) 2234-2242
30. Huang-Pollock C.L., Mikami A.Y., Pfiffner L., and McBurnett K. ADHD subtype differences in motivational responsivity but not inhibitory control: evidence from a reward-based variation of the stop signal paradigm. J. Clin. Child Adolesc. Psychol. 36 (2007) 127-136
31. Itami S., and Uno H. Orbitofrontal cortex dysfunction in attention-deficit hyperactivity disorder revealed by reversal and extinction tasks. Neuroreport 13 (2002) 2453-2457
32. Johansen E.B., Aase H., Meyer A., and Sagvolden T. Attention-deficit/hyperactivity disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction processes. Behav. Brain Res. 130 (2002) 37-45
33. Johansen E.B., Killeen P.R., Russell V.A., Tripp G., Wickens J.R., Tannock R., Williams J., and Sagvolden T. Origins of altered reinforcement effects in ADHD. Behav. Brain Funct. 5 (2009) 7
34. Johansen E.B., Sagvolden T., and Kvande G. Effects of delayed reinforcers on the behavior of an animal model of attention-deficit/hyperactivity disorder (ADHD). Behav. Brain Res. 162 (2005) 47-61
35. Kerr J.N., and Wickens J.R. Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J. Neurophysiol. 85 (2001) 117-124
36. Knutson B., Fong G.W., Adams C.S., and Hommer D. Dissociation of reward anticipation versus outcome with event-related FMRI. Neuroreport 12 (2001) 3683-3687
37. Knutson B., Fong G.W., Bennett S.M., Adams C.S., and Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related FMRI. Neuroimage 18 (2003) 263-272
38. Knutson B., and Gibbs S.E.B. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology 191 (2007) 813-822
39. Kohls G., Herpertz-Dahlmann B., and Konrad K. Hyperresponsiveness to social rewards in children and adolescents with attention-deficit/hyperactivity disorder (ADHD). Behav. Brain Funct. 5 (2009) 20
40. Krause K.H., Dresel S.H., Krause J., Kung H.F., and Tatsch K. Increased striatal dopamine transporter in adult patients with attention deficit hyperactivity disorder: effects of methylphenidate as measured by single photon emission computed tomography. Neurosci. Lett. 285 (2000) 107-110
41. Luman M., Oosterlaan J., Hyde C., van Meel C.S., and Sergeant J.A. Heart rate and reinforcement sensitivity in ADHD. J. Child. Psychol. Psychiatry 48 (2007) 890-898
42. Luman M., Oosterlaan J., and Sergeant J.A. The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal. Clin. Psychol. Rev. 25 (2005) 183-213
43. Luman M., van Meel C.S., Oosterlaan J., Sergeant J.A., and Geurts H.M. Is it reward frequency or magnitude that drives reinforcement learning in ADHD. Psychiatry Res. 168 (2009) 222-229
44. Murray G.K., Corlett P.R., Clark L., Pessiglione M., Blackwell A.D., Honey G., Jones P.B., Bullmore E.T., Robbins T.W., and Fletcher P.C. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol. Psychiatry 13 (2008) 239-276
45. Newman J.P., and Wallace J.F. Diverse pathways to deficient self-regulation-implications for disinhibitory psychopathology in children. Clin. Psychol. Rev. 13 (1993) 699-720
46. Nigg J.T., and Casey B.J. An integrative theory of attention-deficit/hyperactivity disorder based on the cognitive and affective neurosciences. Dev. Psychopathol. 17 (2005) 785-806
47. Paloyelis Y., Mehta M.A., Kuntsi J., and Asherson P. Functional MRI in ADHD: a systematic literature review. Expert Rev. Neurother. 7 (2007) 1337-1356
48. Patterson C.M., and Newman J.P. Reflectivity and learning from aversive events: toward a psychological mechanism for the syndromes of disinhibition. Psychol. Rev. 100 (1993) 716-736
49. Pelham W.E., Milich R., and Walker J.L. Effects of continuous and partial reinforcement and methylphenidate on learning in children with attention deficit disorder. J. Abnorm. Psychol. 95 (1986) 319-325
50. Pennington B.F., and Ozonoff S. Executive functions and developmental psychopathology. J. Child. Psychol. Psychiatry 37 (1996) 51-78
51. Plichta M.M., Vasic N., Wolf R.C., Lesch K.P., Brummer D., Jacob C., Fallgatter A.J., and Grön G. Neural hyporesponsiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/hyperactivity disorder. Biol. Psychiatry 65 (2009) 7-14
52. Quay H.C. Attention deficit disorder and the behavioral inhibition system: the relevance of the neuropsychological theory of Jeffrey A, Gray. In: Bloomingdale L.M., and Sergeant J.A. (Eds). Attention Deficit Disorder: Criteria, Cognition, Intervention (1988), Pergamon Press, Oxford 117-125
53. Raine A. The Psychopathology of Crime: Criminal Behavior as a Clinical Disorder (1993), Academic press, San Diego
54. Rapport M.D., Tucker S.B., DuPaul G.J., Merlo M., and Stoner G. Hyperactivity and frustration: the influence of control over and size of reward in delay gratification. J. Abnorm. Child. Psychiatry 14 (1986) 191-204
55. Reynolds J.N., Hyland B.I., and Wickens J.R. A cellular mechanism of reward-related learning. Nature 413 (2001) 67-70
56. Rubia K., Smith A.B., Halari R., Matsukura F., Mohammad M., Taylor E., and Brammer M.J. Disorder-specific dissociation of orbitofrontal dysfunction in boys with pure conduct disorder during reward and ventrolateral prefrontal dysfunction in boys with pure ADHD during sustained attention. Am. J. Psychiatry 166 (2009) 83-94
57. Russell V.A. Neurobiology of animal models of attention-deficit hyperactivity disorder. J. Neurosci. Methods 161 (2007) 185-198
58. Sagvolden T., Johansen E.B., Aase H., and Russell V.A. A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. Behav. Brain Sci. 28 (2005) 397-419
59. Sagvolden T., Metzger M.A., and Sagvolden G. Frequent reward eliminates differences in activity between hyperkinetic rats and controls. Behav. Neural Biol. 59 (1993) 225-229
60. Scheres A., Dijkstra M., Ainslie E., Balkan J., Reynolds B., Sonuga-Barke E., and Castellanos F.X. Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms. Neuropsychologia 44 (2006) 2092-2103
61. Scheres A., Lee A., and Sumiya M. Temporal reward discounting and ADHD: task and symptom specific effects. J. Neural Transm. 115 (2008) 221-226
62. Scheres A., Milham M.P., Knutson B., and Castellanos F.X. Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol. Psychiatry 61 (2007) 720-724
63. Scheres, A., Tontsch, C., Thoeny, A.L., Kaczkurkin, A., in press. Temporal reward discounting in attention-deficit/hyperactivity disorder: the contribution of symptom domains, reward magnitude, and session length. Biol. Psychiatry
64. Schultz W. Multiple reward signals in the brain. Nat. Rev. Neurosci. 1 (2000) 199-207
65. Schultz W. Getting formal with dopamine and reward. Neuron 10 (2002) 241-263
66. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
67. Schiffer W.K., Volkow N.D., Fowler J.S., Alexoff D.L., Logan J., and Dewey S.L. Therapeutic doses of amphetamine or methylphenidate differentially increase synaptic and extracellular dopamine. Synapse 59 (2006) 243-251
68. Seeman P., and Madras B. Methylphenidate elevates resting dopamine which lowers the impulse-triggered release of dopamine: a hypothesis. Behav. Brain Res. 130 (2002) 79-83
69. Seidman L.J., Valera E.M., and Makris N. Structural brain imaging of attention-deficit/hyperactivity disorder. Biol. Psychiatry 57 (2005) 1263-1272
70. Sergeant J.A., Oosterlaan J., and van der Meere J.J. Information processing in attention-deficit/hyperactivity disorder. In: Quay H.C., and Hogan A.E. (Eds). Handbook of Disruptive Behavior Disorders (1999), Plenum Press, New York 75-104
71. Shaw P., Eckstrand K., Sharp W., Blumenthal J., Lerch J.P., Greenstein D., Clasen L., Evans A., Giedd J., and Rapoport J.L. Attention-deficit/hyperactivity disorder is characterized by a delay in cortical maturation. Proc. Natl. Acad. Sci. U.S.A. 104 (2007) 19649-19654
72. Solanto M.V., Wender E.H., and Bartell S.S. Effects of methylphenidate and behavioral contingencies on sustained attention in attention-deficit hyperactivity disorder: a test of the reward dysfunction hypothesis. J. Child Adolesc. Psychopharmacol. 7 (1997) 123-136
73. Sonuga-Barke E.J. Psychological heterogeneity in AD/HD-a dual pathway model of behaviour and cognition. Behav. Brain Res. 10 (2002) 29-36
74. Sonuga-Barke E.J. The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics. Neurosci. Biobehav. Rev. 27 (2003) 593-604
75. Sonuga-Barke E.J., Sergeant J.A., Nigg J., and Willcutt E. Executive dysfunction and delay aversion in attention deficit hyperactivity disorder: nosologic and diagnostic implications. Child Adolesc. Psychiatr. Clin. 17 (2008) 367-384 ix
76. Sonuga-Barke E.J.S., Taylor E., Sembi E., and Smith J. Hyperactivity and delay aversion. I. The effect of delay on choice. J. Child Psychol. Psychiatry 33 (1992) 387-398
77. Spencer T.J., Biederman J., Madras B.K., Faraone S.V., Dougherty D.D., Bonab A.A., and Fischman A.J. In vivo neuroreceptor imaging in attention-deficit/hyperactivity disorder: a focus on the dopamine transporter. Biol. Psychiatry 57 (2005) 1293-1300
78. Ströhle A., Stoy M., Wrase J., Schwarzer S., Schlagenhauf F., Huss M., Hein J., Nedderhut A., Neumann B., Gregor A., Juckel G., Knutson B., Lehmkuhl U., Bauer M., and Heinz A. Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage 39 (2008) 966-972
79. Sutherland K.R., Alsop B., McNaughton N., Hyland B.I., Tripp G., and Wickens J.R. Sensitivity to delay of reinforcement in two animal models of attention deficit hyperactivity disorder (ADHD). Behav. Brain Res. 205 (2009) 372-376
80. Tripp G., and Alsop B. Sensitivity to reward frequency in boys with attention deficit hyperactivity disorder. J. Clin. Child Psychol. 28 (1999) 366-375
81. Tripp G., and Wickens J. Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. J. Child Psychol. Psychiatry 49 (2008) 691-704
82. Tripp G., and Wickens J. Neurobiology of ADHD. Neuropharmacology 57 (2009) 579-589
83. Ungless M.A., Magill P.J., and Bolam J.P. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303 (2004) 2040-2042
84. van Meel C.S., Heslenfeld D.J., Oosterlaan J., and Sergeant J.A. Adaptive control deficits in attention-deficit/hyperactivity disorder (ADHD): the role of error processing. Psychiatry Res. 151 (2007) 211-220
85. van Meel C.S., Oosterlaan J., Heslenfeld D.J., and Sergeant J.A. Telling good from bad news: ADHD differentially affects processing of positive and negative feedback during guessing. Neuropsychologia 43 (2005) 1946-1954
86. Volkow N.D., Wang G.J., Fowler J.S., Logan J., Gerasimov M., Maynard L., Ding Y., Gatley S.J., Gifford A., and Franceschi D. Therapeutic doses of oral methylphenidate significantly increase extracellular dopamine in the human brain. J. Neurosci. 21 (2001) RC121
87. Volkow N.D., Wang G.J., Fowler J.S., Telang F., Maynard L., Logan J., Gatley S.J., Pappas N., Wong C., Vaska P., Zhu W., and Swanson J.M. Evidence that methylphenidate enhances the saliency of a mathematical task by increasing dopamine in the human brain. Am. J. Psychiatry 161 (2004) 1173-1180
88. Volkow N.D., Wang G.J., Kollins S.H., Wigal T.L., Newcorn J.H., Telang F., Fowler J.S., Zhu W., Logan J., Ma Y., Pradhan K., Wong C., and Swanson J.M. Evaluating dopamine reward pathway in ADHD: clinical implications. J. Am. Med. Assoc. 302 (2009) 1084-1091
89. Wilkison P.C., Kirscher J.C., McMahon W.M., and Sloane H.N. Effects of methylphenidate on reward strength in boys with attention-deficit/hyperactivity disorder. J. Am. Acad. Child Psychiatry 34 (1995) 897-901
90. Williams J. Working toward a neurobiological account of ADHD: commentary on Gail Tripp and Jeff Wickens. Dopamine transfer deficit. J. Child Psychol. Psychiatry 49 (2008) 705-711
91. Williams J., and Dayan P.J. Dopamine, learning, and impulsivity: a biological account of attention-deficit/hyperactivity disorder. J. Child Adolesc. Psychopharmacol. 15 (2005) 160-179
92. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5 (2004) 483-494