Computational models of incentive-sensitization in addiction: Dynamic limbic transformation of learning into motivation

Computational Neuroscience of Drug Addiction

Volumn , Issue , 2012, Pages 189-203

  Zhang, Jun ^a   Berridge, Kent C ^a   Aldridge, J Wayne ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84865333303     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4614-0751-5_7     Document Type: Chapter

References (50)

1. Berridge KC (2001) Reward learning: Reinforcement, incentives, and expectations. In: Medin DL (ed) The psychology of learning and motivation, vol 40. Academic Press, New York, pp 223-278
2. Berridge KC (2004) Motivational concepts in behavioral neuroscience. Physiol Behav 81:179-209
3. Berridge KC (2007) The debate over dopamine in reward: the case for incentive salience. Psychopharmacology 191:391-431 (2007)
4. Berridge KC, Aldridge JW (2008) Decision utility, the brain, and pursuit of hedonic goals. Social Cogn 26:621-646
5. Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, and incentive salience? Brains Res Rev 28:309-369
6. Berridge KC, Robinson TE (2003) Parsing reward. Trends Neurosci 26:507-513
7. Berridge KC, Valenstein ES (1991) What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus? Behav Neurosci 105:3-14
8. Bindra D (1978) How adaptive behavior is produced: a perceptual-motivation alternative to response reinforcement. Behav Brain Sci 1:41-91
9. Daw ND, Niv Y, Dayan P (2005a) Uncertainty-based competition between prefrontal and dorsal striatal systems of behavioral control. Nat Neurosci 8:1704-1711
10. Daw ND, Niv Y, Dayan P (2005b) Actions, policies, values, and the basal ganglia. In: Bezard (ed) Recent breakthroughs in basal ganglia research. Nova Publ, New York, pp 91-106
11. Dayan P (2009) Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry 42(S 01):S56-S65
12. Dayan P, Balleine BW (2002) Reward, motivation and reinforcement learning. Neuron 36:285-298
13. Dickinson A, Balleine B (2002) The role of learning in the operation of motivational systems. In: Gallistel CR (ed) Stevens' handbook of experimental psychology: learning, motivation, and emotion, vol 3, 3rd edn. Wiley, New York, pp 497-534
14. Frederick S, Loewenstein G, O'Donoghue T (2002) Time discounting and time preference: A critical review. J Econ Lit 40:351-401
15. Giordano LA, Bickel WK, Loewenstein G, Jacobs EA, Marsch L, Badger GJ (2002) Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology 163:174-182
16. Glimcher PW, Kable O (2005) Neural mechanisms of temporal discounting in humans. Abstract for 2005 annual meeting of the society for neuroeconomics
17. Gong W, Neill D, Justice JB Jr (1996) Conditioned place preference and locomotor activation produced by injection of psychostimulants into ventral pallidum. Brain Res 707(1):64-74
18. Gutkin BS, Dehaene S, Changeux JP (2006) A neurocomputational hypothesis for nicotine addiction. Proc Natl Acad Sci USA 103(4):1106-1111
19. Koob GF, Le Moal M (2006) Neurobiology of addiction. Academic Press, New York
20. Laibson D (1997) Golden eggs and hyperbolic discounting. Q J Econ 112(2):443-477
21. Louie K, Glimcher PW (2005) Intertemporal choice behavior in monkeys: interaction between delay to reward, subjective value, and area LP. Abstract for 2005 annual meeting of the society for neuroeconomics
22. McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-428
23. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503-507
24. McFarland K, Davidge SB, Lapish CC, Kalivas PW (2004) Limbic and motor circuitry underlying footshock-induced reinstatement of cocaine-seeking behavior. J Neurosci 24(7):1551-1560
25. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167-202
26. Montague PR, Hyman SE, Cohen JD (2004) Computational roles for dopamine in behavioral control. Nature 760-767
27. Niv Y, Joel D, Dayan P (2006) A normative perspective on motivation. Trends Cogn Sci 10:375-381
28. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454
29. O'Reilly RC (2006) Biologically based computational models of high-level cognition. Science 314:91-94
30. Pan W-X, Schmidt R, Wickens JR, Hyland BI (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25:6235-6242
31. Puterman ML (1994) Markov decision processes. Wiley, New York
32. Redgrave P, Gurney K (2006) The short-latency dopamine signal: a role in discovering novel actions? Nat Rev, Neurosci 7:967-975
33. Redgrave P, Prescott TJ, Gurney K (1999) Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22:146-151
34. Redish AD (2004) Addiction as a computational process gone awry. Nature 306:1944-1947
35. Redish AD, Jensen S, Johnson A (2008) A unified framework for addiction: Vulnerabilities in the decision process. Behav Brain Sci 31(4):415-437; discussion 437-487
36. Robinson TE, Berridge KC (1993) The neural basis of drug craving: an incentive-sensitization theory of addiction. Brains Res Rev 18:247-291
37. Robinson TE, Berridge KC (2003) Addiction. Annu Rev Psychol 54:25-53
38. Robinson TE, Berridge KC (2008) The incentive sensitization theory of addiction: some current issues. Philos Trans R Soc Lond B Biol Sci 363(1507):3137-3146
39. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27
40. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-263
41. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599
42. Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88(2):135-170
43. Tindell AJ, Berridge KC, Aldridge JW (2004) Ventral pallidal representation of pavlovian cues and reward: population and rate codes. J Neurosci 24:1058-1069
44. Tindell AJ, Berridge KC, Zhang J, Peciña S, Aldridge JW (2005) Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. Eur J Neurosci 22:2617-2634
45. Tindell AJ, Smith KS, Pecina S, Berridge KC, Aldridge JW (2006) Ventral pallidum firing codes hedonic reward: when a bad taste turns good. J Neurophysiol 96(5):2399-2409
46. Tindell AJ, Smith KS, Berridge KC, Aldridge JW (2009) Dynamic computation of incentive salience: "wanting" what was never "liked". J Neurosci 29(39):12220-12228
47. Toates F (1986) Motivational systems. Cambridge University Press, Cambridge
48. Zahm DS (2000) An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens. Neurosci Biobehav Rev 24:85-105
49. Zahm DS (2006) The evolving theory of basal forebrain functional-anatomical 'macrosystems'. Neurosci Biobehav Rev 30:148-172
50. Zhang J, Berridge KC, Tindell AJ, Smith KS, Aldridge JW (2009) Modeling the neural computation of incentive salience. PLoS Comput Biol 5:1-14