Reward and neurocomputational processes

Current Topics in Behavioral Neurosciences

Volumn 6, Issue 1, 2011, Pages 95-110

  Frank, Guido K W ^a,b  

^a UNIVERSITY OF COLORADO SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF COLORADO   (United States)

Author keywords

Anorexia nervosa; Brain imaging; Dopamine; Food reward; Learning signal; Neurocomputational modeling; Neurotransmitter; Reinforcement; Reward processing; Reward system; Substance use; Taste; Temporal difference model

Indexed keywords

ANOREXIA NERVOSA; ARTICLE; BRAIN ELECTROPHYSIOLOGY; BRAIN FUNCTION; COMPUTER MODEL; DIET RESTRICTION; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; EMOTIONALITY; FEEDING BEHAVIOR; FOOD INTAKE; GABAERGIC TRANSMISSION; HUMAN; MATHEMATICAL MODEL; NEUROIMAGING; NONHUMAN; PRIORITY JOURNAL; REWARD; TASTE ACUITY; WEIGHT GAIN; WEIGHT REDUCTION; BIOLOGICAL MODEL; BRAIN; COMPUTER SIMULATION; EATING DISORDER; NERVE TRACT; PATHOLOGY; PATHOPHYSIOLOGY; PSYCHOLOGICAL ASPECT; REVIEW;

BRAIN; COMPUTER SIMULATION; EATING DISORDERS; HUMANS; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEUROIMAGING; REWARD;

EID: 84861124978     PISSN: 18663370     EISSN: 18663389     Source Type: Book Series    
DOI: 10.1007/7854_2010_81     Document Type: Article

References (69)

1. Anderluh MB, Tchanturia K et al (2003) Childhood obsessive-compulsive personality traits in adult women with eating disorders: defining a broader eating disorder phenotype. Am J Psychiatry 160(2):242-247
2. APA (2000) Diagnostic & statistical manual of mental disorders: DSM-IV-TR. American Psychiatric Association
3. Apicella P, Ljungberg T et al (1991) Responses to reward in, monkey dorsal and ventral striatum. Exp Brain Res 85(3):491-500
4. Bartoshuk LM, Beauchamp GK (1994) Chemical senses. Annu Rev Psychol 45:419-449
5. Bergh C, Sodersten P (1996) Anorexia nervosa, self-starvation and the reward of stress. Nat Med 2 (1):21-22
6. Berns G, McClure S et al (2001) Predictability modulates human brain response to reward. J Neurosci 21(8):2793-2798
7. Berridge KC (1996) Food reward: brain substrates of wanting and liking. Neurosci Biobehav Rev 20(1):1-25
8. Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28(3):309-369
9. Berridge KC, Robinson T (2003) Parsing reward. Trends Neurosci 26(9):507-513
10. Blum K, Sheridan PJ et al (1995) Dopamine D2 receptor gene variants: association and linkage studies in impulsive-addictive-compulsive behaviour. Pharmacogenetics 5(3):121-141
11. Breiter HC, Aharon I et al (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30(2):619-639
12. Cannon C, Bseikri M (2004) Is dopamine required for natural reward? Physiol Behav 81(5): 741-748
13. Cannon CM, Palmiter RD (2003) Reward without dopamine. J Neurosci 23(34):10827-10831
14. Carr K, Tsimberg Y et al (2003) Evidence of increased dopamine receptor signaling in foodrestricted rats. Neuroscience 119:1157-1167
15. Cooper J, Bloom F et al (2003) The biochemical basis of neuropharmacology. Oxford University Press, Oxford
16. Crystal S, Frye CA et al (1995) Taste preferences and sensory perceptions in female varsity swimmers. Appetite 24(1):25-36
17. D'Ardenne K, McClure SM et al (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319(5867):1264-1267
18. Delgado MR, Nystrom LE et al (2000) Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84:3072-3077
19. Delgado MR, Locke HM et al (2003) Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci 3(1):27-38
20. Di Costanzo V, Rodde G et al (1998) Food preferences in anorectic girls at the beginning of therapy. Diabetes Metab 24(3):262-271
21. Drewnowski A, Halmi KA et al (1987) Taste and eating disorders. Am J Clin Nutr 46(3):442-450
22. Eiber R, Berlin I et al (2002) Hedonic response to sucrose solutions and the fear of weight gain in patients with eating disorders. Psychiatry Res 113:173-180
23. Francis S, Rolls ET et al (1999) The representation of pleasant touch in the brain and its relationship with taste and olfactory areas. Neuroreport 10(3):453-459
24. Frank G, Kaye W et al (2003) The evaluation of brain activity in response to taste stimuli - a pilot study and method for central taste activation as assessed by event related fMRI. J Neurosci Methods 131(1-2):99-105
25. Frank G, Bailer UF et al (2005) Increased dopamine D2/D3 receptor binding after recovery from anorexia nervosa measured by positron emission tomography and [11C]raclopride. Biol Psychiatry 58(11):908-912
26. Grigson PS (2002) Like drugs for chocolate: separate rewards modulated by common mechanisms? Physiol Behav 76:389-395
27. Hajnal A, Norgren R et al (2009) Parabrachial coding of sapid sucrose: relevance to reward and obesity. Ann N Y Acad Sci 1170:347-364
28. Hazy TE, Frank MJ et al (2010) Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci Biobehav Rev 34:701-720
29. Higgins GA, Fletcher PJ (2003) Serotonin and drug reward: focus on 5-HT2C receptors. Eur J Pharmacol 480(1-3):151-162
30. Hikosaka K, Watanabe M (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb Cortex 10(3):263-271
31. Jappe LM, Frank GKW et al (2010) Heightened sensitivity to reward and punishment in anorexia nervosa. International Journal of Eating Disorders (Article first published online: 28 JUN)
32. Kampov-Polevoy AB, Ziedonis D et al (2003) Association between sweet preference and paternal history of alcoholism in psychiatric and substance abuse patients. Alcohol Clin Exp Res 27(12):1929-1936
33. Kaye WH, Frank GK et al (1999) Altered dopamine activity after recovery from restricting-type anorexia nervosa. Neuropsychopharmacology 21(4):503-506
34. Kelley AE, Baldo BA et al (2005) Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action and reward. Physiol Behav 86(5):773-795
35. Knutson B, Gibbs SE (2007) Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl) 191(3):813-822
36. Knutson B, Westdorp A et al (2000) FMRI visualisation of brain activity during a monetary incentive dealy task. Neuroimage 12:20-27
37. Koob GF, Le Moal M (2005) Plasticity of reward neurocircuitry and the 'dark side' of drug addiction. Nat Neurosci 8(11):1442-1444
38. Koslow SH (2005) Discovery and integrative neuroscience. Clin EEG Neurosci 36(2):55-63
39. Logothetis NK (2002) The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. Philos Trans R Soc Lond B Biol Sci 357(1424):1003-1037
40. Mansvelder HD (2005) Yin and yang of VTA opioid signaling. Focus on "both kappa and mu opioid agonists inhibit glutamatergic input to ventral tegmental area neurons". J Neurophysiol 93(6):3046-3047
41. Martin-Soelch C, Leenders KL et al (2001) Reward mechanisms in the brain and their role in dependence: evidence from neurophysiological and neuroimaging studies. Brain Res Brain Res Rev 36(2-3):139-149
42. May JC, Delgado MR et al (2004) Event-related functional magnetic resonance imaging of reward-related brain circuity in children and adolescents. Biol Psychiatry 55:359-366
43. Montague R, Hyman S et al (2004) Computational roles for dopamine in behavioural control. Nature 431:760-767
44. Norgren R, Hajnal A et al (2006) Gustatory reward and the nucleus accumbens. Physiol Behav 89(4):531-535
45. O'Doherty JP, Dayan P et al (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38(2):329-337
46. O'Doherty J, Dayan P et al (2004) Dissocaible roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454
47. O'Reilly RC, Frank MJ et al (2007) PVLV: the primary value and learned value Pavlovian learning algorithm. Behav Neurosci 121(1):31-49
48. Price JL (2005) Free will versus survival: brain systems that underlie intrinsic constraints on behavior. J Comp Neurol 493(1):132-139
49. Saper CB, Chou TC et al (2002) The need to feed: homeostatic and hedonic control of eating. Neuron 36(2):199-211
50. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80(1):1-27
51. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36(2):241-263
52. Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115
53. Schultz W, Tremblay L et al (2000) Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex 10(3):272-284
54. Schweiger U, Fichter M (1997) Eating disorders: clinical presentation, classification and etiologic models. In: Jimerson DC, Kaye WH (eds) Balliere's clinical psychiatry. Balliere's Tindall, London, pp 199-216
55. Simon Y, Bellisle F et al (1993) Taste responsiveness in anorexia nervosa. Br J Psychiatry 162:244-246
56. Sullivan PF (1995) Mortality in anorexia nervosa. Am J Psychiatry 152(7):1073-1074
57. Sunday SR, Halmi KA (1990) Taste perceptions and hedonics in eating disorders. Physiol Behav 48(5):587-594
58. Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88(2):135-170
59. Tanaka SC, Doya K et al (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7(8):887-893
60. Toth E, Kondakor I et al (2004) Nonlinear and linear EEG complexity changes caused by gustatory stimuli in anorexia nervosa. Int J Psychophysiol 51(3):253-260
61. Tricomi EM, Delgado MR et al (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292
62. Volkow ND, Fowler JS et al (2004) Dopamine in drug abuse and addiction: results from imaging studies and treatment implications. Mol Psychiatry 9(6):557-569
63. Wagner A, May C et al (2005) Reward-related neural responses in anorexia and bulimia nervosa after recovery using functional magnetic resonance imaging. Biol Psychiatry 57(S7):709
64. Wagner A, Aizenstein H et al (2007) Altered reward processing in women recovered from anorexia nervosa. Am J Psychiatry 164(12):1842-1849
65. Wise RA (2002) Brain reward circuitry: insights from unsensed incentives. Neuron 36(2):229-240
66. Wise RA (2005) Forebrain substrates of reward and motivation. J Comp Neurol 493(1):115-121
67. Worgotter F, Porr B (2005) Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput 17(2):245-319
68. Yasoshima Y, Yamamoto T (2005) Effects of midazolam on the expression of conditioned taste aversion in rats. Brain Res 1043(1-2):115-123
69. Zhou QY, Palmiter RD (1995) Dopamine-deficient mice are severely hypoactive, adipsic, and aphagic. Cell 83(7):1197-1209