A universal role of the ventral striatum in reward-based learning: Evidence from human studies

Neurobiology of Learning and Memory

Volumn 114, Issue , 2014, Pages 90-100

  Daniel, Reka ^a,b   Pollmann, Stefan ^a,c  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b PRINCETON UNIVERSITY   (United States)

^c Center for Behavioral Brain Sciences   (Germany)

Author keywords

Feedback; FMRI; Human; Learning; Reward; Ventral striatum

Indexed keywords

BOLD SIGNAL; COGNITIVE FEEDBACK; CORPUS STRIATUM; DOPAMINERGIC ACTIVITY; DOPAMINERGIC NERVE CELL; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MESENCEPHALON; MOTIVATION; NONHUMAN; OBSERVATIONAL LEARNING; OPTOGENETICS; PREDICTION; PRIMARY REWARD; REINFORCEMENT; REVIEW; REWARD; SOICAL REWARD; TRIAL AND ERROR LEARNING; FUNCTIONAL NEUROIMAGING; PHYSIOLOGY; VENTRAL STRIATUM;

FUNCTIONAL NEUROIMAGING; HUMANS; LEARNING; REWARD; VENTRAL STRIATUM;

EID: 84902109003     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2014.05.002     Document Type: Review

References (151)

1. Abler B., Walter H., Erk S., Kammerer H., Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. NeuroImage 2006, 31(2):790-795.
2. Acevedo B.P., Aron A., Fisher H.E., Brown L.L. Neural correlates of long-term intense romantic love. Social Cognitive and Affective Neuroscience 2012, 7(2):145-159.
3. Adcock R.A., Thangavel A., Whitfield-Gabrieli S., Knutson B., Gabrieli J.D.E. Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron 2006, 50(3):507-517.
4. Aharon I., Etcoff N., Ariely D., Chabris C.F., O'Connor E., Breiter H.C. Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 2001, 32(3):351-537.
5. Aron A., Fisher H., Mashek D.J., Strong G., Li H., Brown L.L. Reward, motivation, and emotion systems associated with early-stage intense romantic love. Journal of Neurophysiology 2005, 94(1):327-337.
6. Aron A.R., Shohamy D., Clark J., Myers C.E., Gluck M.A., Poldrack R.A. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. Journal of Neurophysiology 2004, 92(2):1144-1152.
7. Arthurs O.J., Boniface S. How well do we understand the neural origins of the fMRI BOLD signal?. Trends in Neurosciences 2002, 25(1):27-31.
8. Ashby F.G., Ennis J.M. The role of the basal ganglia in category learning. The psychology of learning and motivation 2006, Vol. 46:1-36. Elsevier, New York, NY.
9. Ashby F.G., Maddox W. Human category learning. Annual Review of Psychology 2005, 56:149-178.
10. Attwell D., Iadecola C. The neural basis of functional brain imaging signals. Trends in Neurosciences 2002, 25(12):621-625.
11. Bandettini P.A., Wong E.C., Hinks R.S., Tikofsky R.S., Hyde J.S. Time course EPI of human brain function during task activation. Magnetic Resonance in Medicine 1992, 25(2):390-397.
12. Bandura A. Social learning theory 1977, Prentice-Hall, Englewood Cliffs, NJ.
13. Bartra O., McGuire J.T., Kable J.W. The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. NeuroImage 2013, 76:412-427.
14. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47(1):129-141.
15. Bellebaum C., Jokisch D., Gizewski E.R., Forsting M., Daum I. The neural coding of expected and unexpected monetary performance outcomes: Dissociations between active and observational learning. Behavioural Brain Research 2012, 227(1):241-251.
16. Belliveau J.W., Kennedy D.N., McKinstry R.C., Buchbinder B.R., Weisskoff R.M., Cohen M.S., et al. Functional mapping of the human visual cortex by magnetic resonance imaging. Science 1991, 254(5032):716-719.
17. Berridge K.C. The debate over dopamine's role in reward: The case for incentive salience. Psychopharmacology 2007, 191(3):391-431.
18. Bertsekas D.P., Tsitsiklis J.N. Neuro-dynamic programming 1996, Athena, London, UK.
19. Bhanji J.P., Delgado M.R. The social brain and reward: Social information processing in the human striatum. Wiley Interdisciplinary Reviews: Cognitive Science 2013.
20. Biederman G.B., Robertson H.A., Vanayan M. Observational learning of two visual discriminations by pigeons: A within-subjects design. Journal of the Experimental Analysis of Behavior 1986, 46(1):45-49.
21. Bromberg-Martin E.S., Hikosaka O. Lateral habenula neurons signal errors in the prediction of reward information. Nature Neuroscience 2011, 14(9):1209-1216.
22. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: Rewarding, aversive, and alerting. Neuron 2010, 68(5):815-834.
23. Bunzeck N., Düzel E. Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 2006, 51(3):369-379.
24. Burke C.J., Tobler P.N., Baddeley M., Schultz W. Neural mechanisms of observational learning. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(32):14431-14436.
25. Buxton R.B., Uluda K., Dubowitz D.J., Liu T.T. Modeling the hemodynamic response to brain activation. NeuroImage 2004, 23(Suppl 1):S220-S233.
26. Chamley C.P. Rational herds: Economic models of social learning 2004, Cambridge University Press, New York, NY, USA.
27. Chang S.W.C., Winecoff A.A., Platt M.L. Vicarious reinforcement in rhesus macaques (Macaca mulatta). Frontiers in Neuroscience 2011, 5(27).
28. Clithero J., Rangel A. Informatic parcellation of the network involved in the computation of subjective value. Social Cognitive and Affective Neuroscience 2013.
29. Cloutier J., Heatherton T.F., Whalen P.J., Kelley W.M. Are attractive people rewarding? Sex differences in the neural substrates of facial attractiveness. Journal of Cognitive Neuroscience 2008, 20(6):941-951.
30. Cohen M.X. Individual differences and the neural representations of reward expectation and reward prediction error. Social Cognitive and Affective Neuroscience 2007, 2(1):20-30.
31. Cohen M.X. Neurocomputational mechanisms of reinforcement-guided learning in humans: A review. Cognitive, Affective, and Behavioral Neuroscience 2008, 8(2):113-125.
32. Cohen M.X., Axmacher N., Lenartz D., Elger C.E., Sturm V., Schlaepfer T.E. Neuroelectric signatures of reward learning and decision-making in the human nucleus accumbens. Neuropsychopharmacology 2009, 34(7):1649-1658.
33. Cooper J.C., Dunne S., Furey T., O'Doherty J.P. Human dorsal striatum encodes prediction errors during observational learning of instrumental actions. Journal of Cognitive Neuroscience 2012, 24(1):106-118.
34. Düzel E., Bunzeck N., Guitart-Masip M., Wittmann B.C., Schott B.H., Tobler P.N. Functional imaging of the human dopaminergic midbrain. Trends in Neurosciences 2009, 32(6):321-328.
35. Daniel R., Pollmann S. Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning. The Journal of Neuroscience 2010, 30(1):47-55.
36. Daniel R., Pollmann S. Striatal activations signal prediction errors on confidence in the absence of external feedback. NeuroImage 2012, 59(4):3457-3467.
37. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319(5867):1264-1267.
38. Daw N.D. Trial-by-trial data analysis using computational models. Decision making, affect, and learning: Attention and performance 2011, 1-26. Oxford University Press. M.R. Delgrado, E.Q. Phelps, T.W. Robbins (Eds.).
39. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69(6):1204-1215.
40. de Bruijn E.R.a., de Lange F.P., von Cramon D.Y., Ullsperger M. When errors are rewarding. The Journal of Neuroscience 2009, 29(39):12183-12186.
41. Delgado M.R. Reward-related responses in the human striatum. Annals of the New York Academy of Sciences 2007, 1104(1):70-88.
42. Delgado M.R., Frank R.H., Phelps E.A. Perceptions of moral character modulate the neural systems of reward during the trust game. Nature Neuroscience 2005, 8(11):1611-1618.
43. den Ouden H.E.M., Friston K.J., Daw N.D., McIntosh A.R., Stephan K.E. A dual role for prediction error in associative learning. Cerebral Cortex 2009, 19(5):1175-1185.
44. Diuk C., Tsai K., Wallis J., Botvinick M., Niv Y. Hierarchical learning induces two simultaneous, but separable, prediction errors in human basal ganglia. The Journal of Neuroscience 2013, 33(13):5797-5805.
45. Dreher J.-C., Kohn P., Berman K.F. Neural coding of distinct statistical properties of reward information in humans. Cerebral Cortex 2006, 16(4):561-573.
46. Dunne S., O'Doherty J.P. Insights from the application of computational neuroimaging to social neuroscience. Current Opinion in Neurobiology 2013, 23(3):387-392.
47. Fischer A.G., Ullsperger M. Real and fictive outcomes are processed differently but converge on a common adaptive mechanism. Neuron 2013, 79(6):1243-1255.
48. Frahm J., Bruhn H., Merboldt K.D., Hänicke W. Dynamic MR imaging of human brain oxygenation during rest and photic stimulation. Journal of Magnetic Resonance Imaging 1992, 2(5):501-505.
49. Frith C.D., Frith U. Mechanisms of social cognition. Annual Review of Psychology 2012, 63:287-313.
50. Gallistel C.R., Shizgal P., Yeomans J.S. A portrait of the substrate for self-stimulation. Psychological Review 1981, 88(3):228-273.
51. Garris P., Kilpatrick M., Bunin M. Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature 1999, 8569(1985):67-69.
52. Gläscher J., Daw N., Dayan P., O'Doherty J. States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66(4):585-595.
53. Goense J.B.M., Logothetis N.K. Neurophysiology of the BOLD fMRI signal in awake monkeys. Current Biology 2008, 18(9):631-640.
54. Han S., Huettel S.A., Raposo A., Adcock R.A., Dobbins I.G. Functional significance of striatal responses during episodic decisions: Recovery or goal attainment?. The Journal of Neuroscience 2010, 30(13):4767-4775.
55. Harbaugh W.T., Mayr U., Burghart D.R. Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 2007, 316(5831):1622-1625.
56. Haruno M., Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. Journal of Neurophysiology 2006, 95(2):948-959.
57. Hernandez G., Hamdani S., Rajabi H., Conover K., Stewart J., Arvanitogiannis A., et al. Prolonged rewarding stimulation of the rat medial forebrain bundle: Neurochemical and behavioral consequences. Behavioral Neuroscience 2006, 120(4):888-904.
58. Heyes C.M., Dawson G.R. A demonstration of observational learning in rats using a bidirectional control. The Quarterly Journal of Experimental Psychology. B, Comparative and Physiological Psychology 1990, 42(1):59-71.
59. Hogarth R.M. Is confidence in decisions related to feedback? Evidence from random samples of real-world behavior. Information sampling and adaptive cognition 2006, 456-484. Cambridge University Press, New York, NY. K. Fiedler, P. Juslinn (Eds.).
60. Izuma K., Saito D.N., Sadato N. Processing of the incentive for social approval in the ventral striatum during charitable donation. Journal of Cognitive Neuroscience 2010, 22(4):621-631.
61. Jensen J., Smith A.J., Willeit M., Crawley A.P., Mikulis D.J., Vitcu I., et al. Separate brain regions code for salience vs. valence during reward prediction in humans. Human Brain Mapping 2007, 28(4):294-302.
62. Jurado-Parras M.T., Gruart A., Delgado-García J.M. Observational learning in mice can be prevented by medial prefrontal cortex stimulation and enhanced by nucleus accumbens stimulation. Learning and Memory 2012, 19(3):99-106.
63. Kühn S., Gallinat J. The neural correlates of subjective pleasantness. NeuroImage 2012, 61(1):289-294.
64. Kätsyri J., Hari R., Ravaja N., Nummenmaa L. Just watching the game ain't enough: Striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing. Frontiers in Human Neuroscience 2013, 7(278).
65. Kampe K.K., Frith C.D., Dolan R.J., Frith U. Reward value of attractiveness and gaze. Nature 2001, 413(6856):589.
66. Kayser C., Kim M., Ugurbil K., Kim D.-S., König P. A comparison of hemodynamic and neural responses in cat visual cortex using complex stimuli. Cerebral Cortex 2004, 14(8):881-891.
67. Klein-Flügge M. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. The Journal of Neuroscience 2013, 33(7):3202-3211.
68. Knutson B., Gibbs S.E.B. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology 2007, 191(3):813-822.
69. Knutson B., Taylor J., Kaufman M. Distributed neural representation of expected value. The Journal of Neuroscience 2005, 25(19):4806-4812.
70. Kwong K.K. Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proceedings of the National Academy of Sciences of the United States of America 1992, 89(12):5675-5679.
71. Li J., Delgado M.R., Phelps E.a. How instructed knowledge modulates the neural systems of reward learning. Proceedings of the National Academy of Sciences of the United States of America 2011, 108(1):55-60.
72. Liljeholm M., Molloy C.J., O'Doherty J.P. Dissociable brain systems mediate vicarious learning of stimulus-response and action-outcome contingencies. The Journal of Neuroscience 2012, 32(29):9878-9886.
73. Lin A., Adolphs R., Rangel A. Social and monetary reward learning engage overlapping neural substrates. Social Cognitive and Affective Neuroscience 2012, 7:274-281.
74. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cerebral C ortex 2011, 21(1):95-102.
75. Liu X., Hairston J., Schrier M., Fan J. Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies. Neuroscience and Biobehavioral Reviews 2011, 35(5):1219-1236.
76. Ljungberg T. Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology 1992, 67(1):145-163.
77. Logothetis N.K. The underpinnings of the BOLD functional magnetic resonance imaging signal. The Journal of Neuroscience 2003, 23(10):3963-3971.
78. Logothetis N.K. What we can do and what we cannot do with fMRI. Nature 2008, 453(7197):869-878.
79. Logothetis N.K. Neurovascular uncoupling: Much ado about nothing. Frontiers in Neuroenergetics 2010, 2:1-4.
80. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412(6843):150-157.
81. Logothetis N.K., Wandell B.A. Interpreting the BOLD signal. Annual Review of Physiology 2004, 66:735-769.
82. Lohrenz T., McCabe K., Camerer C.F., Montague P.R. Neural signature of fictive learning signals in a sequential investment task. Proceedings of the National Academy of Sciences of the United States of America 2007, 104(22):9493-9498.
83. Münte T.F., Heldmann M., Hinrichs H., Marco-Pallares J., Krämer U.M., Sturm V., et al. Nucleus accumbens is involved in human action monitoring: Evidence from invasive electrophysiological recordings. Frontiers in Human Neuroscience 2007, 1(11).
84. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459(7248):837-841.
85. McDannald M. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. European Journal of Neuroscience 2012, 35(7):991-996.
86. Menon M., Jensen J., Vitcu I., Graff-Guerrero A., Crawley A.P., Smith M.A., et al. Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: Effects of dopaminergic modulation. Biological Psychiatry 2007, 62(7):765-772.
87. Metereau E., Dreher J. Cerebral correlates of salient prediction error for different rewards and punishments. Cerebral Cortex 2013, 23(2):477-487.
88. Meunier M., Monfardini E., Boussaoud D. Learning by observation in rhesus monkeys. Neurobiology of Learning and Memory 2007, 88(2):243-248.
89. Mobbs D., Yu R., Meyer M., Passamonti L., Seymour B., Calder A.J., et al. A key role for similarity in vicarious reward. Science 2009, 324(5929):900.
90. Moll J., Krueger F., Zahn R. Human frontomesolimbic networks guide decisions about charitable donation. Proceedings of the National Academy of Sciences of the United States of America 2006, 103(42):15623-15628.
91. Montague P., Dayan P., Sejnowski T. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience 1996, 16(5):1936-1947.
92. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., Malach R. Coupling between neuronal firing, field potentials, and fMRI in human auditory cortex. Science 2005, 309(5736):951-954.
93. Murayama K., Matsumoto M., Izuma K., Matsumoto K. Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(49):20911-20916.
94. Myers W.A. Observational learning in monkeys. Journal of the Experimental Analysis of Behavior 1970, 14(2):225-235.
95. Niv Y. Reinforcement learning in the brain. Journal of Mathematical Psychology 2009, 53(3):139-154.
96. Niv Y., Chan S. On the value of information and other rewards. Nature Neuroscience 2011, 14(9):1095-1097.
97. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: Opportunity costs and the control of response vigor. Psychopharmacology 2007, 191(3):507-520.
98. Niv Y., Edlund J.A., Dayan P., O'Doherty J.P. Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. The Journal of Neuroscience 2012, 32(2):551-562.
99. Niv Y., Montague P.R. Theoretical and empirical studies of learning. Neuroeconomics: Decision making and the brain 2008, 329-350. Academic Press, New York, NY. P.W. Glimcher, C.F. Camerer, E. Fehr, R.A. Poldrack (Eds.).
100. O'Doherty J.P., Buchanan T.W., Seymour B., Dolan R.J. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 2006, 49(1):157-166.
101. O'Doherty J.P., Deichmann R., Critchley H., Dolan R. Neural responses during anticipation of a primary taste reward. Neuron 2002, 33(5):815-826.
102. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Annals of the New York Academy of Sciences 2007, 1104:35-53.
103. Ogawa S. Intrinsic signal changes accompanying sensory stimulation: Functional brain mapping with magnetic resonance imaging. Proceedings of the National Academy of Sciences of the United States of America 1992, 89(13):5951-5955.
104. Ogawa S., Lee T.M., Kay A.R., Tank D.W. Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proceedings of the National Academy of Sciences of the United States of America 1990, 87(24):9868-9872.
105. Olds J., Milner P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. Journal of Comparative and Physiological Psychology 1954, 47(6):419-427.
106. Pagnoni G., Zink C.F., Montague P.R., Berns G.S. Activity in human ventral striatum locked to errors of reward prediction. Nature Neuroscience 2002, 5(2):97-98.
107. Pessiglione M., Seymour B., Flandin G., Dolan R.J., Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006, 442(7106):1042-1045.
108. Phan K.L., Sripada C.S., Angstadt M., McCabe K. Reputation for reciprocity engages the brain reward center. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(29):13099-13104.
109. Poldrack R.A. Can cognitive processes be inferred from neuroimaging data?. Trends in Cognitive Sciences 2006, 10(2):59-63.
110. Raichle M.E., Mintun M.A. Brain work and brain imaging. Annual Review of Neuroscience 2006, 29:449-476.
111. Range F., Viranyi Z., Huber L. Selective imitation in domestic dogs. Current Biology 2007, 17(10):868-872.
112. Redgrave P., Gurney K., Reynolds J. What is reinforced by phasic dopamine signals?. Brain Research Reviews 2008, 58(2):322-339.
113. Rendell L., Boyd R., Cownden D., Enquist M., Eriksson K., Feldman M.W., et al. Why copy others? Insights from the social learning strategies tournament. Science 2010, 328(5975):208-213.
114. Ribas-Fernandes J.J., Solway A., Diuk C., McGuire J.T., Barto A.G., Niv Y., et al. A neural signature of hierarchical reinforcement learning. Neuron 2011, 71(2):370-379.
115. Rilling J.K., Sanfey A.G. The neuroscience of social decision-making. Annual Review of Psychology 2011, 62:23-48.
116. Robinson O.J., Overstreet C., Charney D.R., Vytal K., Grillon C. Stress increases aversive prediction error signal in the ventral striatum. Proceedings of the National Academy of Sciences of the United States of America 2013, 110(10):4129-4133.
117. Salimpoor V.N., Benovoy M., Larcher K., Dagher A., Zatorre R.J. Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nature Neuroscience 2011, 14(2):257-262.
118. Schönberg T., Daw N.D., Joel D., O'Doherty J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. The Journal of Neuroscience 2007, 27(47):12860-12867.
119. Schönberg T., O'Doherty J.P., Joel D., Inzelberg R., Segev Y., Daw N.D. Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: Evidence from a model-based fMRI study. NeuroImage 2010, 49(1):772-781.
120. Schott B.H., Minuzzi L., Krebs R.M., Elmenhorst D., Lang M., Winz O.H., et al. Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. The Journal of Neuroscience 2008, 28(52):14311-14319.
121. Schott B.H., Niehaus L., Wittmann B.C., Schütze H., Seidenbecher C.I., Heinze H.J., et al. Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain 2007, 130(9):2412-2424.
122. Schultz W. Getting formal with dopamine and reward. Neuron 2002, 36(2):241-263.
123. Schultz W. Behavioral theories and the neurophysiology of reward. Annual Review of Psychology 2006, 57:87-115.
124. Schultz W. Behavioral dopamine signals. Trends in Neurosciences 2007, 30(5):203-210.
125. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275(5306):1593-1599.
126. Schultz W. Midbrain dopamine neurons: A retina of the reward system?. Neuroeconomics: Decision making and the brain 2008, 319-328. Academic Press, New York, NY. P.W. Glimcher, C.F. Camerer, E. Fehr, R.A. Poldrack (Eds.).
127. Sclafani A. Macronutrient-conditioned flavor preferences. Neural and metabolic control of macronutrient intake 1999, 93-107. CRC Press, Boca Raton, FL. H.-R. Berthoud, R. Seeley (Eds.).
128. Sescousse G., Caldú X., Segura B., Dreher J.-C. Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience and Biobehavioral Reviews 2013, 37(4):681-696.
129. Seymour B., O'Doherty J.P., Dayan P., Koltzenburg M., Jones A.K., Dolan R.J., et al. Temporal difference models describe higher-order learning in humans. Nature 2004, 429(10):664-667.
130. Shohamy D. Learning and motivation in the human striatum. Current Opinion in Neurobiology 2011, 21(3):408-414.
131. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A., Poldrack R.A. Cortico-striatal contributions to feedback-based learning: Converging data from neuroimaging and neuropsychology. Brain 2004, 127(4):851-859.
132. Shohamy D., Myers C.E., Kalanithi J., Gluck M.A. Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews 2008, 32(2):219-236.
133. Skinner B.F. Science and human behavior 1953, Simon and Schuster, New York, NY, USA.
134. Steinberg E.E., Keiflin R., Boivin J.R., Witten I.B., Deisseroth K., Janak P.H. A causal link between prediction errors, dopamine neurons and learning. Nature Neuroscience 2013, 16(7):966-973.
135. Subiaul F., Cantlon J.F., Holloway R.L., Terrace H.S. Cognitive imitation in rhesus macaques. Science 2004, 305(5682):407-410.
136. Sutton R.S., Barto A.G. Time-derivative models of pavlovian reinforcement. Learning and computational neuroscience: Foundations of adaptive networks 1990, 497-537. MIT Press, Cambridge, MA. M. Gabriel, J. Moore (Eds.).
137. Suzuki S., Harasawa N., Ueno K., Gardner J.L., Ichinohe N., Haruno M., et al. Learning to simulate others' decisions. Neuron 2012, 74(6):1125-1137.
138. Takahashi Y.K., Roesch M.R., Wilson R.C., Toreson K., O'Donnell P., Niv Y., et al. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nature Neuroscience 2011, 14(12):1590-1597.
139. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. The Journal of Neuroscience 2003, 23(32):10402-10410.
140. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307(5715):1642-1645.
141. Tricomi E., Fiez J.A. Feedback signals in the caudate reflect goal achievement on a declarative memory task. NeuroImage 2008, 41(3):1154-1167.
142. Tricomi E., Rangel A., Camerer C., O'Doherty J. Neural evidence for inequality-averse social preferences. Nature 2010, 463(7284):1089-1091.
143. Valentin V.V., O'Doherty J.P. Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain. Journal of Neurophysiology 2009, 102(6):3384-3391.
144. van der Schaaf M.E., van Schouwenburg M.R., Geurts D.E.M., Schellekens A.F.A., Buitelaar J.K., Verkes R.J., et al. Establishing the dopamine dependency of human striatal signals during reward and punishment reversal learning. Cerebral Cortex 2012.
145. Vitay J., Fix J., Beuth F., Schroll H., Hamker F.H. Biological models of reinforcement learning. Künstliche Intelligenz 2009, 3:12-18.
146. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412(6842):43-48.
147. Wimmer G.E., Shohamy D. Preference by association: How memory mechanisms in the hippocampus bias decisions. Science 2012, 338(6104):270-273.
148. Wittmann B.C., Bunzeck N., Dolan R.J., Düzel E. Anticipation of novelty recruits reward system and hippocampus while promoting recollection. NeuroImage 2007, 38(1):194-202.
149. Wittmann B.C., Schott B.H., Guderian S., Frey J.U., Heinze H.J., Düzel E. Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 2005, 45(3):459-467.
150. Zaehle T., Bauch E.M., Hinrichs H., Schmitt F.C., Voges J., Heinze H.-J., et al. Nucleus accumbens activity dissociates different forms of salience: Evidence from human intracranial recordings. The Journal of Neuroscience 2013, 33(20):8764-8771.
151. Zink C.F., Pagnoni G., Chappelow J., Martin-Skurski M., Berns G.S. Human striatal activation reflects degree of stimulus saliency. NeuroImage 2006, 29(3):977-983.