Cognitive Neurostimulation: Learning to Volitionally Sustain Ventral Tegmental Area Activation

Neuron

Volumn 89, Issue 6, 2016, Pages 1331-1342

  MacInnes, Jeff J ^a,b   Dickerson, Kathryn C ^a,b   Chen, Nan kuei ^a,b   Adcock, R Alison ^a,b,c  

^a DUKE UNIVERSITY   (United States)

^b DUKE UNIVERSITY MEDICAL CENTER   (United States)

^c DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMBIGUUS NUCLEUS; ARTICLE; ASSOCIATION; BOLD SIGNAL; BRAIN FUNCTION; COGNITION; CONNECTOME; CONTROLLED STUDY; DOPAMINERGIC SYSTEM; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MOTIVATION; NERVE CELL NETWORK; NERVE STIMULATION; NEUROFEEDBACK; NEUROMODULATION; NORMAL HUMAN; PRIORITY JOURNAL; REWARD; TASK PERFORMANCE; VENTRAL TEGMENTUM; ADAPTATION; BLOOD; BRAIN MAPPING; HEMISPHERIC DOMINANCE; IMAGE PROCESSING; NUCLEAR MAGNETIC RESONANCE IMAGING; NUCLEUS ACCUMBENS; PHYSIOLOGY; PROCEDURES; VASCULARIZATION; YOUNG ADULT;

OXYGEN;

ADAPTATION, PHYSIOLOGICAL; BRAIN MAPPING; COGNITION; FEMALE; FUNCTIONAL LATERALITY; GENERALIZATION (PSYCHOLOGY); HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MOTIVATION; NERVE NET; NEUROFEEDBACK; NUCLEUS ACCUMBENS; OXYGEN; REWARD; VENTRAL TEGMENTAL AREA; YOUNG ADULT;

EID: 84960807659     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.02.002     Document Type: Article

References (68)

1. Adcock R.A., Thangavel A., Whitfield-Gabrieli S., Knutson B., Gabrieli J.D. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 2006, 50:507-517.
2. Alcaro A., Huber R., Panksepp J. Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective. Brain Res. Brain Res. Rev. 2007, 56:283-321.
3. Ballard I.C., Murty V.P., Carter R.M., MacInnes J.J., Huettel S.A., Adcock R.A. Dorsolateral prefrontal cortex drives mesolimbic dopaminergic regions to initiate motivated behavior. J. Neurosci. 2011, 31:10340-10346.
4. Beeler J.A., Daw N., Frazier C.R.M., Zhuang X. Tonic dopamine modulates exploitation of reward learning. Front. Behav. Neurosci. 2010, 4:170.
5. Beierholm U., Guitart-Masip M., Economides M., Chowdhury R., Düzel E., Dolan R., Dayan P. Dopamine modulates reward-related vigor. Neuropsychopharmacology 2013, 38:1495-1503.
6. Botvinick M.M., Huffstetler S., McGuire J.T. Effort discounting in human nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2009, 9:16-27.
7. Braver T.S., Barch D.M. A theory of cognitive control, aging cognition, and neuromodulation. Neurosci. Biobehav. Rev. 2002, 26:809-817.
8. Braver T.S., Krug M.K., Chiew K.S., Kool W., Westbrook J.A., Clement N.J., Adcock R.A., Barch D.M., Botvinick M.M., Carver C.S., et al. Mechanisms of motivation-cognition interaction: challenges and opportunities. Cogn. Affect. Behav. Neurosci. 2014, 14:443-472. MOMCAI group.
9. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
10. Brooks J.C.W., Beckmann C.F., Miller K.L., Wise R.G., Porro C.A., Tracey I., Jenkinson M. Physiological noise modelling for spinal functional magnetic resonance imaging studies. Neuroimage 2008, 39:680-692.
11. Callan D.E., Schweighofer N. Positive and negative modulation of word learning by reward anticipation. Hum. Brain Mapp. 2008, 29:237-249.
12. Cools R., D'Esposito M. Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 2011, 69:e113-e125.
13. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
14. Dayan P., Niv Y. Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 2008, 18:185-196.
15. deCharms R.C. Reading and controlling human brain activation using real-time functional magnetic resonance imaging. Trends Cogn. Sci. 2007, 11:473-481.
16. Duncan K., Tompary A., Davachi L. Associative encoding and retrieval are predicted by functional connectivity in distinct hippocampal area CA1 pathways. J. Neurosci. 2014, 34:11188-11198.
17. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
18. Gasbarri A., Sulli A., Packard M.G. The dopaminergic mesencephalic projections to the hippocampal formation in the rat. Prog. Neuropsychopharmacol. Biol. Psychiatry 1997, 21:1-22.
19. Goldman-Rakic P.S. The cortical dopamine system: Role in memory and cognition. Advances in Pharmacology 1997, 707-711. Elsevier. D.S. Goldstein, G. Eisenhofer, R. McCarty (Eds.).
20. Goto Y., Otani S., Grace A.A. The Yin and Yang of dopamine release: a new perspective. Neuropharmacology 2007, 53:583-587.
21. Greer S.M., Trujillo A.J., Glover G.H., Knutson B. Control of nucleus accumbens activity with neurofeedback. Neuroimage 2014, 96:237-244.
22. Haber S.N., Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35:4-26.
23. Hall J., Parkinson J.A., Connor T.M., Dickinson A., Everitt B.J. Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci. 2001, 13:1984-1992.
24. Harvey A.K., Pattinson K.T.S., Brooks J.C.W., Mayhew S.D., Jenkinson M., Wise R.G. Brainstem functional magnetic resonance imaging: disentangling signal from physiological noise. J. Magn. Reson. Imaging 2008, 28:1337-1344.
25. Holm S. A Simple Sequentially Rejective Multiple Test Procedure. Scand. J. Stat. 1979, 6:65-70.
26. Howe M.W., Tierney P.L., Sandberg S.G., Phillips P.E., Graybiel A.M. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 2013, 500:575-579.
27. Huettel S.A., Song A.W., McCarthy G. Functional Magnetic Resonance Imaging 2009, Sinauer. Second Edition.
28. Jahanshahi M. Willed action and its impairments. Cogn. Neuropsychol. 1998, 15:483-533.
29. James W. The Principles of Psychology 1950, Volume 2. Dover Publications.
30. Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 2002, 17:825-841.
31. Lee W., Reeve J. Self-determined, but not non-self-determined, motivation predicts activations in the anterior insular cortex: an fMRI study of personal agency. Soc. Cogn. Affect. Neurosci. 2013, 8:538-545.
32. Lee W., Reeve J., Xue Y., Xiong J. Neural differences between intrinsic reasons for doing versus extrinsic reasons for doing: an fMRI study. Neurosci. Res. 2012, 73:68-72.
33. Leotti L.A., Delgado M.R. The inherent reward of choice. Psychol. Sci. 2011, 22:1310-1318.
34. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
35. Lisman J., Grace A.A., Düzel E. A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci. 2011, 34:536-547.
36. Lou H.C., Skewes J.C., Thomsen K.R., Overgaard M., Lau H.C., Mouridsen K., Roepstorff A. Dopaminergic stimulation enhances confidence and accuracy in seeing rapidly presented words. J. Vis. 2011, 11:15.
37. Maia T.V., Frank M.J. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 2011, 14:154-162.
38. Marder E. Neuromodulation of neuronal circuits: back to the future. Neuron 2012, 76:1-11.
39. Montague P.R., Hyman S.E., Cohen J.D. Computational roles for dopamine in behavioural control. Nature 2004, 431:760-767.
40. Murayama K., Matsumoto M., Izuma K., Matsumoto K. Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proc. Natl. Acad. Sci. USA 2010, 107:20911-20916.
41. Murty V.P., Shermohammed M., Smith D.V., Carter R.M., Huettel S.A., Adcock R.A. Resting state networks distinguish human ventral tegmental area from substantia nigra. Neuroimage 2014, 100:580-589.
42. Nishino H., Ono T., Muramoto K., Fukuda M., Sasaki K. Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding in the monkey. Brain Res. 1987, 413:302-313.
43. Niv Y., Duff M.O., Dayan P. Dopamine, uncertainty and TD learning. Behav. Brain Funct. 2005, 1:6.
44. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 2007, 191:507-520.
45. Pessoa L., Engelmann J.B. Embedding reward signals into perception and cognition. Front. Neurosci. 2010, 4:1-8.
46. Phillipson O.T., Griffiths A.C. The topographic order of inputs to nucleus accumbens in the rat. Neuroscience 1985, 16:275-296.
47. Plato The Republic of Plato 1991, Basic Books.
48. Rice W.R. Analyzing Tables of Statistical Tests. Evolution 1989, 43:223.
49. Roitman M.F., Stuber G.D., Phillips P.E.M., Wightman R.M., Carelli R.M. Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 2004, 24:1265-1271.
50. Salamone J.D., Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012, 76:470-485.
51. Schott B.H., Minuzzi L., Krebs R.M., Elmenhorst D., Lang M., Winz O.H., Seidenbecher C.I., Coenen H.H., Heinze H.J., Zilles K., et al. Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. J. Neurosci. 2008, 28:14311-14319.
52. Schultz W. Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 2007, 30:259-288.
53. Shibata K., Watanabe T., Sasaki Y., Kawato M. Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation. Science 2011, 334:1413-1415.
54. Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends Cogn. Sci. 2010, 14:464-472.
55. Smith S.M. Fast robust automated brain extraction. Hum. Brain Mapp. 2002, 17:143-155.
56. Stuber G.D., Roitman M.F., Phillips P.E.M., Carelli R.M., Wightman R.M. Rapid dopamine signaling in the nucleus accumbens during contingent and noncontingent cocaine administration. Neuropsychopharmacology 2005, 30:853-863.
57. Sulzer J., Sitaram R., Blefari M.L., Kollias S., Birbaumer N., Stephan K.E., Luft A., Gassert R. Neurofeedback-mediated self-regulation of the dopaminergic midbrain. Neuroimage 2013, 83:817-825.
58. Takahashi Y.K., Roesch M.R., Wilson R.C., Toreson K., O'Donnell P., Niv Y., Schoenbaum G. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat. Neurosci. 2011, 14:1590-1597.
59. Totah N.K.B., Kim Y., Moghaddam B. Distinct prestimulus and poststimulus activation of VTA neurons correlates with stimulus detection. J. Neurophysiol. 2013, 110:75-85.
60. Treadway M.T., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Baldwin R.M., Schwartzman A.N., Kessler R.M., Zald D.H. Dopaminergic mechanisms of individual differences in human effort-based decision-making. J. Neurosci. 2012, 32:6170-6176.
61. Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of caudate activity by action contingency. Neuron 2004, 41:281-292.
62. Volkow N.D., Wang G.-J., Kollins S.H., Wigal T.L., Newcorn J.H., Telang F., Fowler J.S., Zhu W., Logan J., Ma Y., et al. Evaluating dopamine reward pathway in ADHD: clinical implications. JAMA 2009, 302:1084-1091.
63. Volkow N.D., Wang G.-J., Newcorn J.H., Kollins S.H., Wigal T.L., Telang F., Fowler J.S., Goldstein R.Z., Klein N., Logan J., et al. Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathway. Mol. Psychiatry 2011, 16:1147-1154.
64. Voyvodic J.T. Real-time fMRI paradigm control, physiology, and behavior combined with near real-time statistical analysis. Neuroimage 1999, 10:91-106.
65. Weiskopf N., Scharnowski F., Veit R., Goebel R., Birbaumer N., Mathiak K. Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI). J. Physiol. Paris 2004, 98:357-373.
66. Wimmer G.E., Daw N.D., Shohamy D. Generalization of value in reinforcement learning by humans. Eur. J. Neurosci. 2012, 35:1092-1104.
67. Wittmann B.C., Schott B.H., Guderian S., Frey J.U., Heinze H.-J., Düzel E. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 2005, 45:459-467.
68. Wolosin S.M., Zeithamova D., Preston A.R. Reward modulation of hippocampal subfield activation during successful associative encoding and retrieval. J. Cogn. Neurosci. 2012, 24:1532-1547.