Phasic mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task

Biological Psychiatry

Volumn 71, Issue 10, 2012, Pages 846-854

  Wassum, Kate M ^a,b   Ostlund, Sean B ^a,b   Maidment, Nigel T ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Dopamine; flupenthixol; free operant; reinforcement learning; reward; ventral striatum

Indexed keywords

DOPAMINE;

ACTION SEQUENCE TASK; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; CYCLIC POTENTIOMETRY; DOPAMINE RELEASE; EXPERIMENTAL TEST; LATENT PERIOD; LEARNING; MALE; MESOLIMBIC DOPAMINERGIC SYSTEM; NONHUMAN; PRIORITY JOURNAL; RAT; REWARD; SIGNAL TRANSDUCTION; TASK PERFORMANCE;

ANIMALS; CONDITIONING, OPERANT; DOPAMINE; MALE; NEOSTRIATUM; NUCLEUS ACCUMBENS; RATS; RATS, SPRAGUE-DAWLEY; REINFORCEMENT (PSYCHOLOGY); REWARD; SIGNAL TRANSDUCTION;

EID: 84860166687     PISSN: 00063223     EISSN: 18732402     Source Type: Journal    
DOI: 10.1016/j.biopsych.2011.12.019     Document Type: Article

References (59)

1. C. Hull Principles of Behavior 1943 Appleton New York
2. M. Minsky Steps toward artificial intelligence Proceedings of the IRE 49 1961 8 30
3. J. Jankovic Parkinson's disease: Clinical features and diagnosis J Neurol Neurosurg Psychiatry 79 2008 368 376
4. S.E. Hyman The neurobiology of addiction: Implications for voluntary control of behavior Am J Bioeth 7 2007 8 11
5. N.D. Volkow, J.S. Fowler, G.J. Wang, R. Baler, F. Telang Imaging dopamine's role in drug abuse and addiction Neuropharmacology 56 suppl 1 2009 3 8
6. G.F. Koob, N.D. Volkow Neurocircuitry of addiction Neuropsychopharmacology 35 2010 217 238
7. W. Schultz, P. Dayan, P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593 1599
8. W. Schultz The reward signal of midbrain dopamine neurons News Physiol Sci 14 1999 249 255
9. W. Schultz Getting formal with dopamine and reward Neuron 36 2002 241 263
10. T. Ljungberg, P. Apicella, W. Schultz Responses of monkey dopamine neurons during learning of behavioral reactions J Neurophysiol 67 1992 145 163
11. W. Schultz, P. Apicella, T. Ljungberg, R. Romo, E. Scarnati Reward-related activity in the monkey striatum and substantia nigra Prog Brain Res 99 1993 227 235
12. E.S. Bromberg-Martin, M. Matsumoto, O. Hikosaka Dopamine in motivational control: Rewarding, aversive, and alerting Neuron 68 2010 815 834
13. S.B. Flagel, J.J. Clark, T.E. Robinson, L. Mayo, A. Czuh, I. Willuhn A selective role for dopamine in stimulus-reward learning Nature 469 2011 53 57
14. J.J. Day, M.F. Roitman, R.M. Wightman, R.M. Carelli Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens Nat Neurosci 10 2007 1020 1028
15. M.F. Roitman, G.D. Stuber, P.E. Phillips, R.M. Wightman, R.M. Carelli Dopamine operates as a subsecond modulator of food seeking J Neurosci 24 2004 1265 1271
16. J.L. Jones, J.J. Day, B.J. Aragona, R.A. Wheeler, R.M. Wightman, R.M. Carelli Basolateral amygdala modulates terminal dopamine release in the nucleus accumbens and conditioned responding Biol Psychiatry 67 2010 737 744
17. Y. Takikawa, R. Kawagoe, O. Hikosaka A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping J Neurophysiol 92 2004 2520 2529
18. W. Schultz, P. Apicella, T. Ljungberg Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task J Neurosci 13 1993 900 913
19. P. Waelti, A. Dickinson, W. Schultz Dopamine responses comply with basic assumptions of formal learning theory Nature 412 2001 43 48
20. P.R. Montague, P. Dayan, T.J. Sejnowski A framework for mesencephalic dopamine systems based on predictive Hebbian learning J Neurosci 16 1996 1936 1947
21. R.E. Suri, W. Schultz Learning of sequential movements by neural network model with dopamine-like reinforcement signal Exp Brain Res 121 1998 350 354
22. D. Joel, Y. Niv, E. Ruppin Actor-critic models of the basal ganglia: New anatomical and computational perspectives Neural Netw 15 2002 535 547
23. M.M. Veeneman, M. van Ast, M.H. Broekhoven, J.H. Limpens, L.J. Vanderschuren Seeking-taking chain schedules of cocaine and sucrose self-administration: Effects of reward size, reward omission, and α-flupenthixol [published online ahead of print October 12] 2011 Psychopharmacology (Berl)
24. J.D. Salamone, A. Wisniecki, B.B. Carlson, M. Correa Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement Neuroscience 105 2001 863 870
25. K.C. Berridge, T.E. Robinson What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28 1998 309 369
26. A. Dickinson, J. Smith, J. Mirenowicz Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists Behav Neurosci 114 2000 468 483
27. K.M. Wassum, S.B. Ostlund, B.W. Balleine, N.T. Maidment Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling Learn Mem 18 2011 475 483
28. S.B. Ostlund, N.T. Maidment Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection Neuropsychopharmacology 37 2012 408 519
29. R. Romo, W. Schultz Dopamine neurons of the monkey midbrain: Contingencies of responses to active touch during self-initiated arm movements J Neurophysiol 63 1990 592 606
30. X. Jin, R.M. Costa Start/stop signals emerge in nigrostriatal circuits during sequence learning Nature 466 2010 457 462
31. G.D. Stuber, M.F. Roitman, P.E. Phillips, R.M. Carelli, R.M. Wightman Rapid dopamine signaling in the nucleus accumbens during contingent and noncontingent cocaine administration Neuropsychopharmacology 30 2005 853 863
32. P.E. Phillips, G.D. Stuber, M.L. Heien, R.M. Wightman, R.M. Carelli Subsecond dopamine release promotes cocaine seeking Nature 422 2003 614 618
33. A.D. Redish Addiction as a computational process gone awry Science 306 2004 1944 1947
34. S.M. Anderson, R.C. Pierce Cocaine-induced alterations in dopamine receptor signaling: Implications for reinforcement and reinstatement Pharmacol Ther 106 2005 389 403
35. R. Romo, W. Schultz Somatosensory input to dopamine neurones of the monkey midbrain: Responses to pain pinch under anaesthesia and to active touch in behavioural context Prog Brain Res 80 1989 473 478 discussion 465-466
36. T.W. Robbins, B.J. Everitt A role for mesencephalic dopamine in activation: Commentary on Berridge (2006) Psychopharmacology (Berl) 191 2007 433 437
37. J.D. Salamone, M. Correa, A. Farrar, S.M. Mingote Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits Psychopharmacology (Berl) 191 2007 461 482
38. S.B. Ostlund, K.M. Wassum, N.P. Murphy, B.W. Balleine, N.T. Maidment Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning J Neurosci 31 2011 200 207
39. E. Lynd-Balta, S.N. Haber The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum Neuroscience 59 1994 625 640
40. E. Lynd-Balta, S.N. Haber The organization of midbrain projections to the ventral striatum in the primate Neuroscience 59 1994 609 623
41. W.X. Pan, R. Schmidt, J.R. Wickens, B.I. Hyland Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network J Neurosci 25 2005 6235 6242
42. H. Nishino, T. Ono, K. Muramoto, M. Fukuda, K. Sasaki Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding in the monkey Brain Res 413 1987 302 313
43. C.A. Owesson-White, J. Ariansen, G.D. Stuber, N.A. Cleaveland, J.F. Cheer, R.M. Wightman, R.M. Carelli Neural encoding of cocaine-seeking behavior is coincident with phasic dopamine release in the accumbens core and shell Eur J Neurosci 30 2009 1117 1127
44. N.A. Addy, D.P. Daberkow, J.N. Ford, P.A. Garris, R.M. Wightman Sensitization of rapid dopamine signaling in the nucleus accumbens core and shell after repeated cocaine in rats J Neurophysiol 104 2010 922 931
45. L.G. Whitby, G. Hertting, J. Axelrod Effect of cocaine on the disposition of noradrenaline labelled with tritium Nature 187 1960 604 605
46. R.S. Sutton Learning to predict by methods of temporal differences Machine Learning 3 1988 9 44
47. A.G. Barto, R.S. Sutton, C.J.C.H. Watkins Sequential decision problems and neural networks D.S. Touretzky, Advances in Neural Information Processing Systems 1989 MIT Press Cambridge, MA 686 693
48. J.C. Houk, J.L. Adams, A.G. Barto A model of how the basal ganglia generate and use neural signals that predict reinforcement J.C. Houk, J.L. Davis, D.G. Beiser, Models of Information Processing in the Basal Ganglia 1995 MIT Press Cambridge, MA 249 270
49. K.C. Berridge The debate over dopamine's role in reward: The case for incentive salience Psychopharmacology (Berl) 191 2007 391 431
50. K.C. Berridge, T.E. Robinson, J.W. Aldridge Dissecting components of reward: 'Liking', 'wanting', and learning Curr Opin Pharmacol 9 2009 65 73
51. S. Ikemoto, J. Panksepp The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking Brain Res Brain Res Rev 31 1999 6 41
52. S.M. McClure, N.D. Daw, P.R. Montague A computational substrate for incentive salience Trends Neurosci 26 2003 423 428
53. J. Zhang, K.C. Berridge, A.J. Tindell, K.S. Smith, J.W. Aldridge A neural computational model of incentive salience PLoS Comput Biol 5 2009 e1000437
54. Y. Niv, N.D. Daw, D. Joel, P. Dayan Tonic dopamine: Opportunity costs and the control of response vigor Psychopharmacology (Berl) 191 2007 507 520
55. P.L. Tremblay, M.A. Bedard, M. Levesque, M. Chebli, M. Parent, R. Courtemanche, P.J. Blanchet Motor sequence learning in primate: Role of the D2 receptor in movement chunking during consolidation Behav Brain Res 198 2009 231 239
56. M. Levesque, M.A. Bedard, R. Courtemanche, P.L. Tremblay, P. Scherzer, P.J. Blanchet Raclopride-induced motor consolidation impairment in primates: Role of the dopamine type-2 receptor in movement chunking into integrated sequences Exp Brain Res 182 2007 499 508
57. S.B. Ostlund, N.E. Winterbauer, B.W. Balleine Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex J Neurosci 29 2009 8280 8287
58. A.M. Graybiel The basal ganglia and chunking of action repertoires Neurobiol Learn Mem 70 1998 119 136
59. G. Paxinos, C. Watson The Rat Brain in Stereotaxic Coordinates 4th ed. 1998 Academic Press San Diego