Reinforcement signalling in Drosophila; dopamine does it all after all

Current Opinion in Neurobiology

Volumn 23, Issue 3, 2013, Pages 324-329

  Waddell, Scott ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE; OCTOPAMINE;

APPETITE; AVERSION; DOPAMINERGIC NERVE CELL; DROSOPHILA; MEMORY; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NONHUMAN; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REVIEW;

ANIMALS; BEHAVIOR, ANIMAL; DOPAMINE; DROSOPHILA MELANOGASTER; LEARNING; MUSHROOM BODIES; NEURONS; OCTOPAMINE; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84878352097     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2013.01.005     Document Type: Review

References (49)

1. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
2. Maia T.V. Reinforcement learning, conditioning, and the brain: successes and challenges. Cogn Affect Behav Neurosci 2009, 9:343-364.
3. Schwaerzel M., Monastirioti M., Scholz H., Friggi-Grelin F., Birman S., Heisenberg M. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. J Neurosci 2003, 23:10495-10502.
4. Heisenberg M. Mushroom body memoir: from maps to models. Nat Rev Neurosci 2003, 4:266-275.
5. Claridge-Chang A., Roorda R.D., Vrontou E., Sjulson L., Li H., Hirsh J., Miesenbock G. Writing memories with light-addressable reinforcement circuitry. Cell 2009, 139:405-415.
6. Aso Y., Siwanowicz I., Bracker L., Ito K., Kitamoto T., Tanimoto H. Specific dopaminergic neurons for the formation of labile aversive memory. Curr Biol 2010, 20:1445-1451.
7. Aso Y., Herb A., Ogueta M., Siwanowicz I., Templier T., Friedrich A.B., Ito K., Scholz H., Tanimoto H. Three dopamine pathways induce aversive odor memories with different stability. PLoS Genet 2012, 8:e1002768.
8. Hammer M. An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature 1993, 366:59-63.
9. Hammer M., Menzel R. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn Mem 1998, 5:146-156.
10. Schroll C., Riemensperger T., Bucher D., Ehmer J., Voller T., Erbguth K., Gerber B., Hendel T., Nagel G., Buchner E., Fiala A. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Curr Biol 2006, 16:1741-1747.
11. Burke C.J., Waddell S. Remembering nutrient quality of sugar in Drosophila. Curr Biol 2011, 21:746-750.
12. Burke C.J., Huetteroth W., Owald D., Perisse E., Krashes M.J., Das G., Gohl D., Silies M., Certel S., Waddell S. Layered reward signalling through octopamine and dopamine in Drosophila. Nature 2012, 492:433-437.
13. Kim Y.C., Lee H.G., Han K.A. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J Neurosci 2007, 27:7640-7647.
14. Qin H., Cressy M., Li W., Coravos J.S., Izzi S.A., Dubnau J. Gamma neurons mediate dopaminergic input during aversive olfactory memory formation in Drosophila. Curr Biol 2012, 22:608-614.
15. Liu C., Placais P.Y., Yamagata N., Pfeiffer B.D., Aso Y., Friedrich A.B., Siwanowicz I., Rubin G.M., Preat T., Tanimoto H. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 2012, 488:512-516.
16. Han K.A., Millar N.S., Davis R.L. A novel octopamine receptor with preferential expression in Drosophila mushroom bodies. J Neurosci 1998, 18:3650-3658.
17. 2+ release in Drosophila melanogaster. J Neurochem 2005, 93:440-451.
18. Krashes M.J., DasGupta S., Vreede A., White B., Armstrong J.D., Waddell S. A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 2009, 139:416-427.
19. Waddell S. Dopamine reveals neural circuit mechanisms of fly memory. Trends Neurosci 2010, 33:457-464.
20. Hiroi M., Meunier N., Marion-Poll F., Tanimura T. Two antagonistic gustatory receptor neurons responding to sweet-salty and bitter taste in Drosophila. J Neurobiol 2004, 61:333-342.
21. Thorne N., Chromey C., Bray S., Amrein H. Taste perception and coding in Drosophila. Curr Biol 2004, 14:1065-1079.
22. Wang Z., Singhvi A., Kong P., Scott K. Taste representations in the Drosophila brain. Cell 2004, 117:981-991.
23. Wright G.A., Mustard J.A., Simcock N.K., Ross-Taylor A.A., McNicholas L.D., Popescu A., Marion-Poll F. Parallel reinforcement pathways for conditioned food aversions in the honeybee. Curr Biol 2010, 20:2234-2240.
24. Tanaka N.K., Tanimoto H., Ito K. Neuronal assemblies of the Drosophila mushroom body. J Comp Neurol 2008, 508:711-755.
25. Sejourne J., Placais P.Y., Aso Y., Siwanowicz I., Trannoy S., Thoma V., Tedjakumala S.R., Rubin G.M., Tchenio P., Ito K., et al. Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nat Neurosci 2011, 14:903-910.
26. Cassenaer S., Laurent G. Conditional modulation of spike-timing-dependent plasticity for olfactory learning. Nature 2012, 482:47-52.
27. Ito I., Ong R.C., Raman B., Stopfer M. Sparse odor representation and olfactory learning. Nat Neurosci 2008, 11:1177-1184.
28. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
29. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behav Brain Funct 2010, 6:24.
30. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
31. Zweifel L.S., Fadok J.P., Argilli E., Garelick M.G., Jones G.L., Dickerson T.M., Allen J.M., Mizumori S.J., Bonci A., Palmiter R.D. Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nat Neurosci 2011, 14:620-626.
32. Darvas M., Fadok J.P., Palmiter R.D. Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learn Mem 2011, 18:136-143.
33. Lammel S., Ion D.I., Roeper J., Malenka R.C. Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 2011, 70:855-862.
34. Lammel S., Lim B.K., Ran C., Huang K.W., Betley M.J., Tye K.M., Deisseroth K., Malenka R.C. Input-specific control of reward and aversion in the ventral tegmental area. Nature 2012, 491:212-217.
35. Ungless M.A., Magill P.J., Bolam J.P. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 2004, 303:2040-2042.
36. Matsumoto M., Hikosaka O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 2007, 447:1111-1115.
37. Dietrich M.O., Bober J., Ferreira J.G., Tellez L.A., Mineur Y.S., Souza D.O., Gao X.B., Picciotto M.R., Araujo I., Liu Z.W., Horvath T.L. AgRP neurons regulate development of dopamine neuronal plasticity and nonfood-associated behaviors. Nat Neurosci 2012, 15:1108-1110.
38. Watabe-Uchida M., Zhu L., Ogawa S.K., Vamanrao A., Uchida N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 2012, 74:858-873.
39. Cohen J.Y., Haesler S., Vong L., Lowell B.B., Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 2012, 482:85-88.
40. Zweifel L.S., Parker J.G., Lobb C.J., Rainwater A., Wall V.Z., Fadok J.P., Darvas M., Kim M.J., Mizumori S.J., Paladini C.A., et al. Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc Natl Acad Sci U S A 2009.
41. Parker J.G., Wanat M.J., Soden M.E., Ahmad K., Zweifel L.S., Bamford N.S., Palmiter R.D. Attenuating GABA(A) receptor signaling in dopamine neurons selectively enhances reward learning and alters risk preference in mice. J Neurosci 2011, 31:17103-17112.
42. Pawlak V., Wickens J.R., Kirkwood A., Kerr J.N. Timing is not everything: neuromodulation opens the STDP gate. Front Synaptic Neurosci 2010, 2:146.
43. Pawlak V., Kerr J.N. Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. J Neurosci 2008, 28:2435-2446.
44. Shen W., Flajolet M., Greengard P., Surmeier D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 2008, 321:848-851.
45. Zhang J.C., Lau P.M., Bi G.Q. Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc Natl Acad Sci U S A 2009, 106:13028-13033.
46. Krashes M.J., Keene A.C., Leung B., Armstrong J.D., Waddell S. Sequential use of mushroom body neuron subsets during Drosophila odor memory processing. Neuron 2007, 53:103-115.
47. Dubnau J., Grady L., Kitamoto T., Tully T. Disruption of neurotransmission in Drosophila mushroom body blocks retrieval but not acquisition of memory. Nature 2001, 411:476-480.
48. McGuire S.E., Le P.T., Davis R.L. The role of Drosophila mushroom body signaling in olfactory memory. Science 2001, 293:1330-1333.
49. Mao Z., Davis R.L. Eight different types of dopaminergic neurons innervate the Drosophila mushroom body neuropil: anatomical and physiological heterogeneity. Front Neural Circuits 2009, 3:5.