Reinforcement, Dopamine and Rodent Models in Drug Development for ADHD

Neurotherapeutics

Volumn 9, Issue 3, 2012, Pages 622-634

  Tripp, Gail ^a   Wickens, Jeff ^a  

^a OKINAWA INSTITUTE OF SCIENCE AND TECHNOLOGY GRADUATE UNIVERSITY   (Japan)

Author keywords

ADHD; Dopamine; Reinforcement; Rodent models

Indexed keywords

AMPHETAMINE; ATOMOXETINE; DESIPRAMINE; DEXAMPHETAMINE; DOPAMINE; DOPAMINE TRANSPORTER; METHYLPHENIDATE; NORADRENALIN UPTAKE INHIBITOR; PSYCHOSTIMULANT AGENT;

ANIMAL BEHAVIOR; ATTENTION DEFICIT DISORDER; DOPAMINERGIC NERVE CELL; DRUG MECHANISM; EXCITATION; HUMAN; NEUROBIOLOGY; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; RESPONSE TIME; REVIEW; SIGNAL TRANSDUCTION; TRANSGENIC ANIMAL;

ANIMALS; ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY; DISEASE MODELS, ANIMAL; DOPAMINE; DOPAMINE AGENTS; DRUG DESIGN; HUMANS; REINFORCEMENT (PSYCHOLOGY); RODENTIA;

EID: 84866447260     PISSN: 19337213     EISSN: 18787479     Source Type: Journal    
DOI: 10.1007/s13311-012-0132-y     Document Type: Review

References (181)

1. Bari A, Robbins TW. Animal models of ADHD. Curr Top Behav Neurosci 2011; 7: 149-185.
2. Fernando AB, Robbins TW. Animal models of neuropsychiatric disorders. Annu Rev Clin Psychol 2011; 7: 39-61.
3. Kostrzewa RM, Kostrzewa JP, Kostrzewa RA, Nowak P, Brus R. Pharmacological models of ADHD. J Neural Transm 2008; 115: 287-298.
4. Wickens JR, Hyland BI, Tripp G. Animal models to guide clinical drug development in ADHD: Lost in translation? Br J Pharmacol 2011; 164: 1107-1128.
5. Winstanley CA. The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders. Br J Pharmacol 2011; 164: 1301-1321.
6. Russell VA. Overview of animal models of attention deficit hyperactivity disorder (ADHD). Curr Protoc Neurosci 2011; 9: 35.
7. Fan X, Bruno KJ, Hess EJ. Rodent models of ADHD. Curr Top Behav Neurosci 2011; 9: 273-300.
8. Sontag TA, Tucha O, Walitza S, Lange KW. Animal models of attention deficit/hyperactivity disorder (ADHD): a critical review. Atten Defic Hyperact Disord 2010; 2: 1-20.
9. Luman M, Tripp G, Scheres A. Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda. Neurosci Biobehav Rev 2010; 34: 744-754.
10. Sonuga-Barke EJ, Sergeant JA, Nigg J, Willcutt E. Executive dysfunction and delay aversion in attention deficit hyperactivity disorder: nosologic and diagnostic implications. Child Adolesc Psychiatr Clin N Am 2008; 17: 367-384.
11. Genro JP, Kieling C, Rohde LA, Hutz MH. Attention-deficit/hyperactivity disorder and the dopaminergic hypotheses. Expert Rev Neurother 2010; 10: 587-601.
12. Kieling C, Goncalves RR, Tannock R, Castellanos FX. Neurobiology of attention deficit hyperactivity disorder. Child Adolesc Psychiatr Clin N Am 2008; 17: 285-307.
13. Solanto MV. Clinical psychopharmacology of AD/HD: implications for animal models. Neurosci Biobehav Rev 2000; 24: 27-30.
14. Arnsten AF. Stimulants: Therapeutic actions in ADHD. Neuropsychopharmacology 2006; 31: 2376-2383.
15. Glaser PEA, Gerhardt GA, The neuropsychopharmacology of stimulants: dopamine and ADHD. In: Current Directions in ADHD and its Treatment. Norvilitis JM, ed.; 2012. InTech.
16. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th edit. Washington, DC: American Psychiatric Press, 1994.
17. Luman M, Oosterlaan J, and Sergeant JA. The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal. Clin Psychol Rev 2005; 25: 183-213.
18. Haenlein M and Caul WF. Attention deficit disorder with hyperactivity: A specific hypothesis of reward dysfunction. J Am Acad Child Adolesc Psychiatry 1987; 26: 356-362.
19. Wender PH. Minimal brain dysfunction syndrome in children. New York: Wiley, 1971.
20. Wender PH. The minimal brain dysfunction syndrome in children. J Nerv Ment Dis 1972; 155: 55-71.
21. Wender PH. Some speculations concerning a possible biochemical basis of minimal brain dysfunction. Life Science 1974; 14: 1605-1621.
22. Freibergs V, Douglas VI. Concept learning in hyperactive and normal children. J Abnorm Psychol 1969; 74: 388-395.
23. Parry PA, Douglas VI. Effects of reinforcement on concept identification in hyperactive children. J Abnorm Child Psychol 1983; 11: 327-340.
24. Douglas VI, Parry PA. Effects of reward and non-reward on frustration and attention in attention deficit disorder. J Abnorm Child Psychol 1994; 22: 281-302.
25. Firestone P, Douglas V. The effects of reward and punishment on reaction times and autonomic activity in hyperactive and normal children. J Abnorm Child Psychol 1975; 3: 201-216.
26. Douglas VI. Can Skinnerian theory explain attention deficit disorder? A reply to Barkley. In: Attention Deficit Disorder; Current Concepts and Emerging Trends in Attentional and Behavioural Disorders of Childhood. Bloomingdale LM, Swanson J, ed. Pergamon Press: Oxford, 1989: 235-254.
27. Tripp G, Wickens JR. Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. J Child Psychol Psychiatry 2008; 49: 691-704.
28. Barkley RA. Impaired delayed responding: a unified theory of attention-deficit hyperactivity disorder. In: Disruptive Behavior Disorders in Children. Routh DH, ed. Plenun: New York, 1994: 11-57.
29. Sagvolden T, Aase H, Zeiner P, Berger D. Altered reinforcement mechanisms in attention-deficit/hyperactivity disorder. Behav Brain Res 1998; 94: 61-71.
30. Sonuga-Barke EJ. Psychological heterogeneity in AD/HD - a dual pathway model of behaviour and cognition. Behav Brain Res 2002; 130: 29-36.
31. Sonuga-Barke EJ. The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics. Neurosci Biobehav Rev 2003; 27: 593-604.
32. Carlson CL, Tamm L. Responsiveness of children with attention deficit-hyperactivity disorder to reward and response cost: differential impact on performance and motivation. J Consult Clin Psychol 2000; 68: 73-83.
33. Konrad K, Gauggel S, Manz A, Scholl M. Lack of inhibition: a motivational deficit in children with attention deficit/hyperactivity disorder and children with traumatic brain injury. Child Neuropsychol 2000; 6: 286-296.
34. Luman M, Oosterlaan J, Sergeant JA. Modulation of response timing in ADHD, effects of reinforcement valence and magnitude. J Abnorm Child Psychol 2008; 36: 445-456.
35. McInerney RJ, Kerns KA. Time reproduction in children with ADHD: motivation matters. Child Neuropsychol 2003; 9: 91-108.
36. Slusarek M, Velling S, Bunk D, Eggers C. Motivational effects on inhibitory control in children with ADHD. J Am Acad Child Adolesc Psychiatry 2001; 40: 355-363.
37. Crone EA, Jennings JR, van der Molen MW. Sensitivity to interference and response contingencies in attention-deficit/hyperactivity disorder. J Child Psychol Psychiatry 2003; 44: 214-226.
38. Iaboni F, Douglas VI, Ditto B. Psychophysiological response of ADHD children to reward and extinction. Psychophysiology 1997; 34: 116-123.
39. Luman M, Oosterlaan J, Hyde C, van Meel CS, Sergeant JA. Heart rate and reinforcement sensitivity in ADHD. J Child Psychol Psychiatry 2007; 48: 890-898.
40. Luman M, Oosterlaan J, Knol DL, Sergeant JA. Decision-making in ADHD: sensitive to frequency but blind to the magnitude of penalty? J Child Psychol Psychiatry 2008; 49: 712-722.
41. Antrop I, Stock P, Verte S, et al. ADHD and delay aversion: the influence of non-temporal stimulation on choice for delayed rewards. J Child Psychol Psychiatry 2006; 47: 1152-1158.
42. Bitsakou P, Psychogiou L, Thompson M, Sonuga-Barke EJ. Delay aversion in attention deficit/hyperactivity disorder: an empirical investigation of the broader phenotype. Neuropsychologia 2009; 47: 446-456.
43. Dalen L, Sonuga-Barke EJ, Hall M, Remington B. Inhibitory deficits, delay aversion and preschool AD/HD: implications for the dual pathway model. Neural Plast 2004; 11: 1-11.
44. Hoerger ML, Mace FC. A computerized test of self-control predicts classroom behavior. J Appl Behav Anal 2006; 39: 147-159.
45. Kuntsi J, Oosterlaan J, Stevenson J. Psychological mechanisms in hyperactivity: I. Response inhibition deficit, working memory impairment, delay aversion, or something else? J Child Psychol Psychiatry 2001; 42: 199-210.
46. Marco R, Miranda A, Schlotz W, et al. Delay and reward choice in ADHD: an experimental test of the role of delay aversion. Neuropsychology 2009; 23: 367-380.
47. Scheres A, Lee A, Sumiya M. Temporal reward discounting and ADHD: task and symptom specific effects. J Neural Transm 2008; 115: 221-226.
48. Scheres A, Dijkstra M, Ainslie E, et al. Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms. Neuropsychologia 2006; 44: 2092-2103.
49. Scheres A, Tontsch C, Thoeny AL, Kaczkurkin A. Temporal reward discounting in attention-deficit/hyperactivity disorder: the contribution of symptom domains, reward magnitude, and session length. Biol Psychiatry 2010; 67: 641-648.
50. Schweitzer JB, Sulzer-Azaroff B. Self-control in boys with attention deficit hyperactivity disorder: effects of added stimulation and time. J Child Psychol Psychiatry 1995; 36: 671-686.
51. Solanto MV, Abikoff H, Sonuga-Barke E, et al. The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. J Abnorm Child Psychol 2001; 29: 215-228.
52. Sonuga-Barke EJ, Taylor E, Sembi S, Smith J. Hyperactivity and delay aversion--I. The effect of delay on choice. J Child Psychol Psychiatry 1992; 33: 387-398.
53. Tripp G, Alsop B. Sensitivity to reward delay in children with attention deficit hyperactivity disorder (ADHD). J Child Psychol Psychiatry 2001; 42: 691-698.
54. Barkley RA, Edwards G, Laneri M, Fletcher K, Metevia L. Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). J Abnorm Child Psychol 2001; 29: 541-556.
55. Aase H, Sagvolden T. Infrequent, but not frequent, reinforcers produce more variable responding and deficient sustained attention in young children with attention-deficit/hyperactivity disorder (ADHD). J Child Psychol Psychiatry 2006; 47: 457-471.
56. Tripp G, Alsop B. Sensitivity to reward frequency in boys with attention-deficit hyperactivity disorder. J Clin Child Psychol 1999; 28: 366-375.
57. Frank MJ, Santamaria A, O'Reilly RC, Willcutt E. Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 2007; 32: 1583-1599.
58. Luman M, van Meel CS, Oosterlaan J, Sergeant JA, Geurts HM. Does reward frequency or magnitude drive reinforcement-learning in attention-deficit/hyperactivity disorder? Psychiatry Res 2009; 168: 222-229.
59. Aggarwal M, Wickens JR. A role for phasic dopamine neuron firing in habit learning. Neuron 2011; 72: 892-894.
60. Pawlak V, Wickens JR, Kirkwood A, Kerr JN. Timing is not everything: neuromodulation opens the STDP gate. Front Synaptic Neurosci 2010; 2: 1-14.
61. Wickens JR, Horvitz JC, Costa RM, Killcross S. Dopaminergic mechanisms in actions and habits. J Neurosci 2007; 27: 8181-8183.
62. Wickens JR. Synaptic plasticity in the basal ganglia. Behav Brain Res 2009; 199: 119-128.
63. Wise RA. Role of brain dopamine in food reward and reinforcement. Philos Trans R Soc Lond B Biol Sci 2006; 361: 1149-1158.
64. Wickens JR, Arbuthnott G, Structural and functional interactions in the striatum at the receptor level. In: Handbook of Chemical Neuroanatomy, Dunnett, et al., ed. Amsterdam: Elsevier, 2005.
65. Ljungberg T, Apicella P, Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 1992; 67: 145-163.
66. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 1998; 80: 1-27.
67. Ungless MA, Magill PJ, Bolam JP. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 2004; 303: 2040-2042.
68. Hyland BI, Reynolds JN, Hay J, Perk CG, Miller R. Firing modes of midbrain dopamine cells in the freely moving rat. Neuroscience 2002; 114: 475-492.
69. Ahn S, Phillips AG. Dopamine efflux in the nucleus accumbens during within-session extinction, outcome-dependent, and habit-based instrumental responding for food reward. Psychopharmacology (Berlin) 2007; 191: 641-651.
70. Ahn S, Phillips AG. Modulation by central and basolateral amygdalar nuclei of dopaminergic correlates of feeding to satiety in the rat nucleus accumbens and medial prefrontal cortex. J Neurosci 2002; 22: 10958-10965.
71. Fiorillo DF, Coury A, Phillips AG. Dynamic changes in nucleus accumbens dopamine efflux during the Coolidge effect in male rats. J Neurosci 1997; 17: 4849-4855.
72. Nakazato T. Striatal dopamine release in the rat during a cued lever-press task for food reward and the development of changes over time measured using high-speed voltammetry. Exp Brain Res 2005; 166: 137-146.
73. Beninger RJ. The role of dopamine in locomotor activity and learning. Brain Res 1983; 287: 173-196.
74. Miller R. Cortico-striatal and cortico-limbic circuits: a two tiered model of learning and memory function. In: Information Processing by the Brain: Views and Hypotheses from a Cognitive-Physiological Perspective. Markowitsch H, ed. Bern: Hans Huber Press, 1988: 179-198.
75. Wickens JR. Striatal dopamine in motor activation and reward-mediated learning. Steps towards a unifying model. J Neural Transm 1990; 80: 9-31.
76. Wickens JR, Kotter R, Cellular models of reinforcement. In: Models of Information Processing in the Basal Ganglia. Houk JC, Davis JL, Beiser DG, eds. Cambridge: M. I. T. Press, 1995: 187-214.
77. Groves PM. A theory of the functional organisation of the neostriatum and the neostriatal control of voluntary movement. Brain Res Rev 1983; 5: 109-132.
78. Wickens JR, Begg AJ, Arbuthnott GW. Dopamine reverses the depression of rat cortico-striatal synapses which normally follows high frequency stimulation of cortex in vitro. Neuroscience 1996; 70: 1-5.
79. Wickens JR. Dopamine regulation of synaptic plasticity in the neostriatum: a cellular model of reinforcement In: Brain Dynamics and the Striatal Complex. Miller R, Wickens JR, eds. Amsterdam: Harwood Academic, 2000: 65-76.
80. Floresco SB, Blaha CD, Yang CR, Phillips AG. Modulation of hippocampal and amygdalar-evoked activity of nucleus accumbens neurons by dopamine: cellular mechanisms of input selection. J Neurosci 2001; 21: 2851-2860.
81. Reynolds JNJ, Wickens JR. Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo. Neuroscience 2000; 99: 199-203.
82. Kerr JND, Wickens JR. Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J Neurophysiol 2001; 85: 117-124.
83. Centonze D, Gubellini P, Picconi B, et al. Unilateral dopamine denervation blocks corticostriatal LTP. J Neurophysiol 1999; 82: 3575-3579.
84. Kitada T, Pisani A, Porter DR, et al. Impaired dopamine release and synaptic plasticity in the striatum of PINK1-deficient mice. Proc Natl Acad Sci U S A 2007; 104: 11441-11446.
85. Stein L, Xue BG, and Belluzzi JD. In vitro reinforcement of hippocampal bursting: a search for Skinner's atoms of behavior. J Exp Anal Behav 1994; 61: 155-168.
86. Fino E, Glowinski J, Venance L. Bidirectional activity-dependent plasticity at corticostriatal synapses. J Neurosci 2005; 25: 11279-11287.
87. Pawlak V, Kerr JN. Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. J Neurosci 2008; 28: 2435-2446.
88. Wickens JR. Synaptic plasticity in the basal ganglia. Behav Brain Res 2009; 199: 119-128.
89. Dickinson A, Watt A, Griffiths W. Free-operant acquisition with delayed reinforcement. Q J Exp Psychol Sect B: Comp Pysiol Psychol 1992; 45: 241-258.
90. Critchfield TS, Lattal KA. Acquisition of a spatially defined operant with delayed reinforcement. J Exp Anal Behav 1993; 59: 373-387.
91. Lattal KA, Gleeson S. Response acquisition with delayed reinforcement. J Exp Psychol Anim Behav Process 1990; 16: 27-39.
92. Black J, Belluzzi JD, Stein L. Reinforcement delay of one second severely impairs acquisition of brain self-stimulation. Brain Res 1985; 359: 113-119.
93. Tripp G, Wickens JR. Neurobiology of ADHD. Neuropharmacology 2009; 57: 579-589.
94. Sergeant J. The cognitive-energetic model: an empirical approach to attention-deficit hyperactivity disorder. Neurosci Biobehav Rev 2000; 24: 7-12.
95. Sagvolden T, Johansen EB, Aase H, Russell VA. A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. Behav Brain Sci 2005; 28: 397-419.
96. Wickens JR, Tripp EG. A biological theory of ADHD: Dopamine timing is off. Int J Neurosci 1998; 97: 252.
97. Knutson B, Gibbs SE. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl) 2007; 191: 813-822.
98. Haruno M, Kuroda T, Doya K, et al. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J Neurosci 2004; 24: 1660-1665.
99. Delgado MR, Miller MM, Inati S, Phelps EA. An fMRI study of reward-related probability learning. Neuroimage 2005; 24: 862-873.
100. Galvan A, Hare TA, Davidson M, et al. The role of ventral frontostriatal circuitry in reward-based learning in humans. J Neurosci 2005; 25: 8650-8656.
101. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science 1997; 275: 1593-1599.
102. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 2003; 38: 329-337.
103. O'Doherty J, Dayan P, Schultz J, et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004; 304: 452-454.
104. Hariri AR, Brown SM, Williamson DE, et al. Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. J Neurosci 2006; 26: 13213-13217.
105. Scheres A, Milham MP, Knutson B, and Castellanos FX. Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol Psychiatry 2007; 61: 720-724.
106. Strohle A, Stoy M, Wrase J, et al. Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage 2008; 39: 966-972.
107. Plichta MM, Vasic N, Wolf RC, et al. Neural hyporesponsiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/hyperactivity disorder. Biol Psychiatry 2009; 65: 7-14.
108. Hoogman M, Aarts E, Zwiers M, et al. Nitric oxide synthase genotype modulation of impulsivity and ventral striatal activity in adult ADHD patients and healthy comparison subjects. Am J Psychiatry 2011; 168: 1099-1106.
109. Stoy M, Schlagenhauf F, Schlochtermeier L, et al. Reward processing in male adults with childhood ADHD - a comparison between drug-naive and methylphenidate-treated subjects. Psychopharmacology (Berl) 2011; 215: 467-481.
110. Furukawa E, Bado O, Tripp G et al. Functional MRI evidence compatible with dopamine transfer deficits in ADHD. Poster presented at 2nd International ADHD Conference; 23rd-25th May 2012; Barcelona, Spain.
111. Heal DJ, Smith SL, Kulkarni RS, Rowley HL. New perspectives from microdialysis studies in freely-moving, spontaneously hypertensive rats on the pharmacology of drugs for the treatment of ADHD. Pharmacol Biochem Behav 2008; 90: 184-197.
112. Carlson CL, Pelham WE Jr., Milich R, Dixon J. Single and combined effects of methylphenidate and behavior therapy on the classroom performance of children with attention-deficit hyperactivity disorder. J Abnorm Child Psychol 1992; 20: 213-232.
113. Brown RT, Amler RW, Freeman WS, et al. Treatment of attention-deficit/hyperactivity disorder: overview of the evidence. Pediatrics 2005; 115: e749-e757.
114. Pelham WE, Gnagy EM, Greiner AR, et al. Behavioral versus behavioral and pharmacological treatment in ADHD children attending a summer treatment program. J Abnorm Child Psychol 2000; 28: 507-525.
115. Swanson CJ, Perry KW, Koch-Krueger S, et al. Effect of the attention deficit/hyperactivity disorder drug atomoxetine on extracellular concentrations of norepinephrine and dopamine in several brain regions of the rat. Neuropharmacology 2006; 50: 755-760.
116. Bymaster FP, Katner JS, Nelson DL, et al. Atomoxetine increases extracellular levels of norepinephrine and dopamine in prefrontal cortex of rat: a potential mechanism for efficacy in attention deficit/hyperactivity disorder. Neuropsychopharmacology 2002; 27 699-711.
117. Volkow ND, Wang GJ, Fowler JS, et al. Dopamine transporter occupancies in the human brain induced by therapeutic doses of oral methylphenidate. Am J Psychiatry 1998; 155: 1325-1331.
118. Rosa Neto P, Lou H, Cumming P, Pryds O, Gjedde A. Methylphenidate-evoked potentiation of extracellular dopamine in the brain of adolescents with premature birth: correlation with attentional deficit. Ann N Y Acad Sci 2002; 965: 434-439.
119. Volkow ND, Wang GJ, Fowler JS, et al. Reinforcing effects of psychostimulants in humans are associated with increases in brain dopamine and occupancy of D(2) receptors. J Pharmacol Exp Ther 1999; 291: 409-415.
120. Volkow ND, Fowler JS, Wang G, Ding Y, Gatley SJ. Mechanism of action of methylphenidate: insights from PET imaging studies. J Atten Disord 2002; 6(suppl 1): S31-S43.
121. Volkow ND, Wang GJ, Fowler JS, et al. Evidence that methylphenidate enhances the saliency of a mathematical task by increasing dopamine in the human brain. Am J Psychiatry 2004; 161: 1173-1180.
122. Chelonis JJ, Johnson TA, Ferguson SA, et al. Effect of methylphenidate on motivation in children with attention-deficit/hyperactivity disorder. Exp Clin Psychopharmacol 2011; 19: 145-153.
123. Wilkison PC, Kircher JC, McMahon WM, Sloane HN. Effects of methylphenidate on reward strength in boys with attention-deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 1995; 34: 897-901.
124. Shiels K, Hawk LW Jr., Reynolds B, et al. Effects of methylphenidate on discounting of delayed rewards in attention deficit/hyperactivity disorder. Exp Clin Psychopharmacol 2009; 17: 291-301.
125. Russell VA. Neurobiology of animal models of attention-deficit hyperactivity disorder. J Neurosci Methods 2007; 161: 185-198.
126. Davids E, Zhang K, Tarazi FI, Baldessarini RJ. Animal models of attention-deficit hyperactivity disorder. Brain Res Brain Res Rev 2003; 42: 1-21.
127. Evenden JL. Varieties of impulsivity. Psychopharmacology (Berl) 1999; 146: 348-361.
128. Evenden J. Impulsivity: A discussion of clinical and experimental findings. J Psychopharmacol 1999; 13: 180-192.
129. Winstanley CA, Eagle DM, Robbins TW. Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 2006; 26: 379-395.
130. Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 1975; 82: 463-496.
131. Bizot JC, David S, Trovero F. Effects of atomoxetine, desipramine, d-amphetamine and methylphenidate on impulsivity in juvenile rats, measured in a T-maze procedure. Neurosci Lett 2011; 489: 20-24.
132. Robbins TW. The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology (Berl) 2002; 163: 362-380.
133. Day M, Pan JB, Buckley MJ, et al. Differential effects of ciproxifan and nicotine on impulsivity and attention measures in the 5-choice serial reaction time test. Biochem Pharmacol 2007; 73: 1123-1134.
134. Robinson ES, Eagle DM, Economidou D, et al. Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: specific deficits in "waiting" versus "stopping." Behav Brain Res 2009; 196: 310-316.
135. Puumala T, Ruotsalainen S, Jakala P, et al. Behavioral and pharmacological studies on the validation of a new animal model for attention deficit hyperactivity disorder. Neurobiol Learn Mem 1996; 66: 198-211.
136. Navarra R, Graf R, Huang Y, et al. Effects of atomoxetine and methylphenidate on attention and impulsivity in the 5-choice serial reaction time test. Prog Neuropsychopharmacol Biol Psychiatry 2008; 32: 34-41.
137. Cole BJ, Robbins TW. Amphetamine impairs the discriminative performance of rats with dorsal noradrenergic bundle lesions on a 5-choice serial reaction time task: new evidence for central dopaminergic-noradrenergic interactions. Psychopharmacology (Berl) 1987; 91: 458-466.
138. Cole BJ, Robbins TW. Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi on performance of a 5-choice serial reaction time task in rats: implications for theories of selective attention and arousal. Behav Brain Res 1989; 33: 165-179.
139. Alderson RM, Rapport MD, Kofler MJ. Attention-deficit/hyperactivity disorder and behavioral inhibition: a meta-analytic review of the stop-signal paradigm. J Abnorm Child Psychol 2007; 35: 745-758.
140. Eagle DM, Baunez C, Hutcheson DM, et al. Stop-signal reaction-time task performance: role of prefrontal cortex and subthalamic nucleus. Cereb Cortex 2008; 18: 178-188.
141. Harrison AA, Everitt BJ, Robbins TW. Central serotonin depletion impairs both the acquisition and performance of a symmetrically reinforced go/no-go conditional visual discrimination. Behav Brain Res 1999; 100: 99-112.
142. Eagle DM, Bari A, Robbins TW. The neuropsychopharmacology of action inhibition: cross-species translation of the stop-signal and go/no-go tasks. Psychopharmacology (Berl) 2008; 199: 439-456.
143. Robinson ES, Eagle DM, Mar AC, et al. Similar effects of the selective noradrenaline reuptake inhibitor atomoxetine on three distinct forms of impulsivity in the rat. Neuropsychopharmacology 2008; 33: 1028-1037.
144. Sagvolden T, Johansen EB, Woien G, et al. The spontaneously hypertensive rat model of ADHD - the importance of selecting the appropriate reference strain. Neuropharmacology 2009; 57: 619-626.
145. Sagvolden T, Russell VA, Aase H, Johansen EB, Farshbaf M. Rodent models of attention-deficit/hyperactivity disorder. Biol Psychiatry 2005; 57: 1239-1247.
146. Sagvolden T. Behavioral validation of the spontaneously hypertensive rat (SHR) as an animal model of attention-deficit/hyperactivity disorder (AD/HD). Neurosci Biobehav Rev 2000; 24: 31-39.
147. Sagvolden T, Berger DF. An animal model of attention-deficit disorder: the female shows more behavioural problems and is more impulsive than the male. Eur Psychol 1996; 1: 113-122.
148. Sagvolden T, Pettersen MB, Larsen MC. Spontaneously hypertensive rats (SHR) as a putative animal model of childhood hyperkinesis: SHR behavior compared to four other rat strains. Physiol Behav 1993; 54: 1047-1055.
149. Sagvolden T, Metzger MA, Schiorbeck HK, et al. The spontaneously hypertensive rat (SHR) as an animal model of childhood hyperactivity (ADHD): changed reactivity to reinforcers and to psychomotor stimulants. Behav Neural Biol 1992; 58: 103-112.
150. Bizot JC, Chenault N, Houze B, et al. Methylphenidate reduces impulsive behaviour in juvenile Wistar rats, but not in adult Wistar, SHR and WKY rats. Psychopharmacology (Berl) 2007; 193: 215-223.
151. Fox AT, Hand DJ, Reilly MP. Impulsive choice in a rodent model of attention-deficit/hyperactivity disorder. Behav Brain Res 2008; 187: 146-152.
152. Pardey MC, Homewood J, Taylor A, Cornish JL. Re-evaluation of an animal model for ADHD using a free-operant choice task. J Neurosci Methods 2009; 176: 166-171.
153. Sutherland KR, Alsop B, McNaughton N, et al. Sensitivity to delay of reinforcement in two animal models of attention deficit hyperactivity disorder (ADHD). Behav Brain Res 2009; 205: 372-376.
154. Kantak KM, Singh T, Kerstetter KA, et al. Advancing the spontaneous hypertensive rat model of attention deficit/hyperactivity disorder. Behav Neurosci 2008; 122: 340-357.
155. Liu LL, Yang J, Lei GF, et al. Atomoxetine increases histamine release and improves learning deficits in an animal model of attention-deficit hyperactivity disorder: the spontaneously hypertensive rat. Basic Clin Pharmacol Toxicol 2008; 102: 527-532.
156. van den Bergh BR, Mennes M, Stevens V, et al. ADHD deficit as measured in adolescent boys with a continuous performance task is related to antenatal maternal anxiety. Pediatr Res 2006; 59: 78-82.
157. Smirk FH, Hall WH. Inherited hypertension in rats. Nature 1958; 182: 727-728.
158. Phelan EL. The New Zealand strain of rats with genetic hypertension. N Z Med J 1968; 67: 334-344.
159. Simpson FO, Phelan EL, Clark DW, et al. Studies on the New Zealand strain of genetically hypertensive rats. Clin Sci Mol Med Suppl 1973; 45(suppl 1): 15s-21s.
160. McCarty R. Stress, behavior and experimental hypertension. Neurosci Biobehav Rev 1983; 7: 493-502.
161. McCarty R, Kirby RF. Spontaneous hypertension and open-field behavior. Behav Neural Biol 1982; 34: 450-452.
162. McCarty R, Kopin IJ. Patterns of behavioral development in spontaneously hypertensive rats and Wistar-Kyoto normotensive controls. Dev Psychobiol 1979; 12: 239-243.
163. Wickens JR, Macfarlane J, Booker C, McNaughton N. Dissociation of hypertension and fixed interval responding in two separate strains of genetically hypertensive rat. Behav Brain Res 2004; 152: 393-401.
164. Shaywitz BA, Klopper JH, Yager RD, Gordon JW. Paradoxical response to amphetamine in developing rats treated with 6- hydroxydopamine. Nature 1976; 261: 153-155.
165. Shaywitz BA, Yager RD, Klopper JH. Selective brain dopamine depletion in developing rats: an experimental model of minimal brain dysfunction. Science 1976; 191: 305-308.
166. Davids E, Zhang K, Tarazi FI, Baldessarini RJ. Stereoselective effects of methylphenidate on motor hyperactivity in juvenile rats induced by neonatal 6-hydroxydopamine lesioning. Psychopharmacology (Berl) 2002; 160: 92-98.
167. Heffner TG, Seiden LS. Possible involvement of serotonergic neurons in the reduction of locomotor hyperactivity caused by amphetamine in neonatal rats depleted of brain dopamine. Brain Res 1982; 244: 81-90.
168. Kuczenski R, Segal DS. Exposure of adolescent rats to oral methylphenidate: preferential effects on extracellular norepinephrine and absence of sensitization and cross-sensitization to methamphetamine. J Neurosci 2002; 22: 7264-7271.
169. Kuczenski R, Segal DS. Locomotor effects of acute and repeated threshold doses of amphetamine and methylphenidate: relative roles of dopamine and norepinephrine. J Pharmacol Exp Ther 2001; 296: 876-883.
170. Berridge CW, Devilbiss DM, Andrzejewski ME, et al. Methylphenidate preferentially increases catecholamine neurotransmission within the prefrontal cortex at low doses that enhance cognitive function. Biol Psychiatry 2006; 60: 1111-1120.
171. Avale ME, Falzone TL, Gelman DM, et al. The dopamine D4 receptor is essential for hyperactivity and impaired behavioral inhibition in a mouse model of attention deficit/hyperactivity disorder. Mol Psychiatry 2004; 9: 718-726.
172. Avale ME, Nemirovsky SI, Raisman-Vozari R, Rubinstein M. Elevated serotonin is involved in hyperactivity but not in the paradoxical effect of amphetamine in mice neonatally lesioned with 6-hydroxydopamine. J Neurosci Res 2004; 78: 289-296.
173. Gainetdinov RR. Dopamine transporter mutant mice in experimental neuropharmacology. N Schmied Arch Pharmacol 2008; 377: 301-313.
174. Gainetdinov RR, Caron MG. Monoamine transporters: from genes to behavior. Annu Rev Pharmacol Toxicol 2003; 43: 261-284.
175. Drago J, Padungchaichot P, Accili D, Fuchs S. Dopamine receptors and dopamine transporter in brain function and addictive behaviors: insights from targeted mouse mutants. Dev Neurosci 1998; 20: 188-203.
176. Gainetdinov RR, Wetsel WC, Jones SR, et al. Role of serotonin in the paradoxical calming effect of psychostimulants on hyperactivity. Science 1999; 283: 397-401.
177. Stuber GD, Sparta DR, Stamatakis AM, et al. Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature 2011; 475: 377-380.
178. Lingawi NW, Balleine BW. Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J Neurosci 2012; 32: 1073-1081.
179. Stephenson-Jones M, Floros O, Robertson B, Grillner S. Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proc Natl Acad Sci U S A 2012; 109: E164-E173.
180. Hong S, Hikosaka O. The globus pallidus sends reward-related signals to the lateral habenula. Neuron 2008; 60: 720-729.
181. Wickens J. Toward an anatomy of disappointment: reward-related signals from the globus pallidus. Neuron 2008; 60: 530-531.