Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement

PLoS ONE

Volumn 7, Issue 4, 2012, Pages

  Kim, Kyung Man ^a   Baratta, Michael V ^b   Yang, Aimei ^b   Lee, Doheon ^a   Boyden, Edward S ^b   Fiorillo, Christopher D ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHANNELRHODOPSIN 2 PROTEIN; RHODOPSIN; UNCLASSIFIED DRUG; CHANNELRHODOPSIN 2, MOUSE; DOPAMINE;

ANIMAL BEHAVIOR; ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; CELL ACTIVATION; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; DOPAMINERGIC TRANSMISSION; GENE TARGETING; INSTRUMENTAL CONDITIONING; LOCOMOTION; MALE; MOUSE; NONHUMAN; PHOTOSTIMULATION; PROTEIN EXPRESSION; PROTEIN LOCALIZATION; REINFORCEMENT; REWARD; ROTATION; STIMULUS RESPONSE; VENTRAL TEGMENTUM; VISUAL STIMULATION; ANIMAL; LEARNING; METABOLISM; METHODOLOGY; PHYSIOLOGY;

MUS;

ANIMALS; CONDITIONING, OPERANT; DOPAMINE; DOPAMINERGIC NEURONS; LEARNING; LOCOMOTION; MALE; MICE; PHOTIC STIMULATION; REINFORCEMENT (PSYCHOLOGY); RHODOPSIN; ROTATION; VENTRAL TEGMENTAL AREA;

EID: 84859593263     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0033612     Document Type: Article

References (50)

1. Wise RA, (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5: 483-494.
2. Wise RA, Bozarth MA, (1987) A psychomotor stimulant theory of addiction. Psychol Rev 94: 469-492.
3. Bayer HM, Glimcher PW, (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141.
4. Fiorillo CD, Newsome WT, Schultz W, (2008) The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 11: 966-973.
5. Fiorillo CD, Tobler PN, Schultz W, (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
6. Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H, (2004) Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43: 133-143.
7. Nakahara H, Itoh H, Kawagoe R, Takikawa Y, Hikosaka O, (2004) Dopamine neurons can represent context-dependent prediction error. Neuron 41: 269-280.
8. Pan WX, Schmidt R, Wickens JR, Hyland BI, (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25: 6235-6242.
9. Roesch MR, Calu DJ, Schoenbaum G, (2007) Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10: 1615-1624.
10. Tobler PN, Fiorillo CD, Schultz W, (2005) Adaptive coding of reward value by dopamine neurons. Science 307: 1642-1645.
11. Rescorla RA, Wagner AR, (1972) Classical Conditioning II: Current Research and Theory In: Black AH, Prokasy WS, editors. New York Appleton-Century-Crofts.
12. Sutton RS, Barto AG, (1998) Reinforcement Learning Cambridge MA MIT Press.
13. Montague PR, Dayan P, Sejnowski TJ, (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947.
14. Schultz W, Dayan P, Montague PR, (1997) A neural substrate of prediction and reward. Science 275: 1593-1599.
15. Spyraki C, Fibiger HC, Phillips AG, (1982) Dopaminergic substrates of amphetamine-induced place preference conditioning. Brain Res 253: 185-193.
16. Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, et al. (2009) Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324: 1080-1084.
17. Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM, (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24: 1265-1271.
18. Horvitz JC, (2000) Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96: 651-656.
19. Redgrave P, Prescott TJ, Gurney K, (1999) Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22: 146-151.
20. Redgrave P, Gurney K, Reynolds J, (2008) What is reinforced by phasic dopamine signals? Brain Res Rev 58: 322-339.
21. Brischoux F, Chakraborty S, Brierley DI, Ungless MA, (2009) Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci U S A 106: 4894-4899.
22. Matsumoto M, Hikosaka O, (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
23. Berridge KC, (2007) The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191: 391-431.
24. Berridge KC, Robinson TE, (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28: 309-369.
25. Cannon CM, Palmiter RD, (2003) Reward without dopamine. J Neurosci 23: 10827-10831.
26. Robinson S, Sandstrom SM, Denenberg VH, Palmiter RD, (2005) Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. Behav Neurosci 119: 5-15.
27. Boyden ES, Zhang F, Bamberg E, Nagel G, Deisseroth K, (2005) Millisecond-timescale, genetically targeted optical control of neural activity. Nat Neurosci 8: 1263-1268.
28. Adamantidis AR, Tsai HC, Boutrel B, Zhang F, Stuber GD, et al. (2011) Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior. J Neurosci 31: 10829-10835.
29. Brown MT, Bellone C, Mameli M, Labouebe G, Bocklisch C, et al. (2010) Drug-driven AMPA receptor redistribution mimicked by selective dopamine neuron stimulation. PLoS One 5: e15870.
30. Domingos AI, Vaynshteyn J, Voss HU, Ren X, Gradinaru V, et al. (2011) Leptin regulates the reward value of nutrient. Nat Neurosci 14: 1562-1568.
31. Stuber GD, Hnasko TS, Britt JP, Edwards RH, Bonci A, (2010) Dopaminergic terminals in the nucleus accumbens but not the dorsal striatum corelease glutamate. J Neurosci 30: 8229-8233.
32. Tecuapetla F, Patel JC, Xenias H, English D, Tadros I, et al. (2010) Glutamatergic signaling by mesolimbic dopamine neurons in the nucleus accumbens. J Neurosci 30: 7105-7110.
33. Backman CM, Malik N, Zhang Y, Shan L, Grinberg A, et al. (2006) Characterization of a mouse strain expressing Cre recombinase from the 3′ untranslated region of the dopamine transporter locus. Genesis 44: 383-390.
34. Atasoy D, Aponte Y, Su HH, Sternson SM, (2008) A FLEX switch targets Channelrhodopsin-2 to multiple cell types for imaging and long-range circuit mapping. J Neurosci 28: 7025-7030.
35. Nomoto K, Schultz W, Watanabe T, Sakagami M, (2010) Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J Neurosci 30: 10692-10702.
36. Holmes LJ, Wise RA, (1985) Contralateral circling induced by tegmental morphine: anatomical localization, pharmacological specificity, and phenomenology. Brain Res 326: 19-26.
37. Olds J, Milner P, (1954) Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol 47: 419-427.
38. Conover KL, Shizgal P, (1994) Competition and summation between rewarding effects of sucrose and lateral hypothalamic stimulation in the rat. Behav Neurosci 108: 537-548.
39. Routtenberg A, Lindy J, (1965) Effects of the availability of rewarding septal and hypothalamic stimulation on bar pressing for food under conditions of deprivation. J Comp Physiol Psychol 60: 158-161.
40. Cabeza de Vaca S, Krahne LL, Carr KD, (2004) A progressive ratio schedule of self-stimulation testing in rats reveals profound augmentation of d-amphetamine reward by food restriction but no effect of a "sensitizing" regimen of d-amphetamine. Psychopharmacology (Berl) 175: 106-113.
41. Depoortere R, Perrault G, Sanger DJ, (1999) Intracranial self-stimulation under a progressive-ratio schedule in rats: effects of strength of stimulation, d-amphetamine, 7-OH-DPAT and haloperidol. Psychopharmacology (Berl) 142: 221-229.
42. Easterling KW, Plovnick RM, Holtzman SG, (2000) Acute opioid but not benzodiazepine dependence in rats responding for intracranial self-stimulation. Psychopharmacology (Berl) 148: 263-271.
43. Keesey RE, Goldstein MD, (1968) Use of progressive fixed-ratio procedures in the assessment of intracranial reinforcement. J Exp Anal Behav 11: 293-301.
44. Michaels CC, Easterling KW, Holtzman SG, (2007) Maternal separation alters ICSS responding in adult male and female rats, but morphine and naltrexone have little affect on that behavior. Brain Res Bull 73: 310-318.
45. Wellman PJ, Elliott AE, Barbee S, Hollas CN, Clifford PS, et al. (2008) Lobeline attenuates progressive ratio breakpoint scores for intracranial self-stimulation in rats. Physiol Behav 93: 952-957.
46. Phillips AG, Carter DA, Fibiger HC, (1976) Dopaminergic substrates of intracranial self-stimulation in the caudate-putamen. Brain Res 104: 221-232.
47. Nakahara D, Fuchikami K, Ozaki N, Iwasaki T, Nagatsu T, (1992) Differential effect of self-stimulation on dopamine release and metabolism in the rat medial frontal cortex, nucleus accumbens and striatum studied by in vivo microdialysis. Brain Res 574: 164-170.
48. Zweifel LS, Parker JG, Lobb CJ, Rainwater A, Wall VZ, et al. (2009) Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc Natl Acad Sci U S A 106: 7281-7288.
49. Redish AD, (2004) Addiction as a computational process gone awry. Science 306: 1944-1947.
50. Morikawa H, Khodakhah K, Williams JT, (2003) Two intracellular pathways mediate metabotropic glutamate receptor-induced Ca2+ mobilization in dopamine neurons. J Neurosci 23: 149-157.