Reward signal in a recurrent circuit drives appetitive long-term memory formation

eLife

Volumn 4, Issue NOVEMBER2015, 2015, Pages

  Ichinose, Toshiharu ^a,b   Aso, Yoshinori ^c   Yamagata, Nobuhiro ^a,b   Abe, Ayako ^a   Rubin, Gerald M ^c   Tanimoto, Hiromu ^a,b  

^a TOHOKU UNIVERSITY   (Japan)

^b MAX PLANCK INSTITUTE OF NEUROBIOLOGY   (Germany)

^c HOWARD HUGHES MEDICAL INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE RECEPTOR; N METHYL DEXTRO ASPARTIC ACID RECEPTOR; TRANSCRIPTION FACTOR GAL4;

ANIMAL TISSUE; ARTICLE; CELL LABELING; CONFOCAL MICROSCOPY; CONTROLLED STUDY; DENDRITE; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; DROSOPHILA MELANOGASTER; FEEDBACK SYSTEM; FEMALE; IMMUNOHISTOCHEMISTRY; IMMUNOREACTIVITY; INTRACELLULAR SIGNALING; KENYON CELL; LONG TERM MEMORY; MALE; MUSHROOM BODY; NONHUMAN; PROTEIN EXPRESSION; REGULATORY MECHANISM; SHORT TERM MEMORY; SYNAPTOSOME; ANIMAL; APPETITE; CONDITIONED REFLEX; DROSOPHILA; NERVE TRACT; PHYSIOLOGY; RECURRENT DISEASE;

ANIMALS; APPETITIVE BEHAVIOR; CONDITIONING, CLASSICAL; DOPAMINERGIC NEURONS; DROSOPHILA; MEMORY, LONG-TERM; NEURAL PATHWAYS; RECURRENCE;

EID: 84949937157     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.10719     Document Type: Article

References (78)

1. Abraham WC, Robins A. 2005. Memory retention–the synaptic stability versus plasticity dilemma. Trends in Neurosciences 28:73–78. doi: 10.1016/j.tins.2004.12.003.
2. Alexander J Jr, Audesirk TE, Audesirk GJ. 1984. One-trial reward learning in the snail Lymnea stagnalis. Journal of Neurobiology 15:67–72. doi: 10.1002/neu.480150107.
3. Aso Y, Grubel K, Busch S, Friedrich AB, Siwanowicz I, Tanimoto H. 2009. The mushroom body of adult Drosophila characterized by GAL4 drivers. Journal of Neurogenetics 23:156–172. doi: 10.1080/01677060802471718.
4. Aso Y, Hattori D, Yu Y, Johnston RM, Iyer NA, Ngo TT, Dionne H, Abbott L, Axel R, Tanimoto H, Rubin GM. 2014a. The neuronal architecture of the mushroom body provides a logic for associative learning. eLife 3:e04577. doi: 10.7554/eLife.04577.
5. Aso Y, Sitaraman D, Ichinose T, Kaun KR, Vogt K, Belliart-Guerin G, Placais PY, Robie AA, Yamagata N, Schnaitmann C, Rowell WJ, Johnston RM, Ngo TT, Chen N, Korff W, Nitabach MN, Heberlein U, Preat T, Branson KM, Tanimoto H, Rubin GM. 2014b. Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. eLife 3:e04580. doi: 10.7554/eLife.04580.
6. Boto T, Louis T, Jindachomthong K, Jalink K, Tomchik SM. 2014. Dopaminergic modulation of cAMP drives nonlinear plasticity across the Drosophila mushroom body lobes. Current Biology 24:822–831. doi: 10.1016/j.cub.2014.03.021.
7. Burke CJ, Huetteroth W, Owald D, Perisse E, Krashes MJ, Das G, Gohl D, Silies M, Certel S, Waddell S. 2012. Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492:433–437. doi: 10.1038/nature11614.
8. Burke CJ, Waddell S. 2011. Remembering nutrient quality of sugar in Drosophila. Current Biology 21:746–750. doi: 10.1016/j.cub.2011.03.032.
9. Campbell RA, Honegger KS, Qin H, Li W, Demir E, Turner GC. 2013. Imaging a population code for odor identity in the Drosophila mushroom body. The Journal of Neuroscience 33:10568–10581. doi: 10.1523/JNEUROSCI.0682-12.2013.
10. Cervantes-Sandoval I, Martin-Pena A, Berry JA, Davis RL. 2013. System-like consolidation of olfactory memories in Drosophila. The Journal of Neuroscience 33:9846–9854. doi: 10.1523/JNEUROSCI.0451-13.2013.
11. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. 2012. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482:85–88. doi: 10.1038/nature10754.
12. Colomb J, Kaiser L, Chabaud MA, Preat T. 2009. Parametric and genetic analysis of Drosophila appetitive long-term memory and sugar motivation. Genes, brain, and behavior 8:407–415. doi: 10.1111/j.1601-183X.2009.00482.x.
13. Daniels RW, Gelfand MV, Collins CA, DiAntonio A. 2008. Visualizing glutamatergic cell bodies and synapses in Drosophila larval and adult CNS. The Journal of Comparative Neurology 508:131–152. doi: 10.1002/cne.21670.
14. Das G, Klappenbach M, Vrontou E, Perisse E, Clark CM, Burke CJ, Waddell S. 2014. Drosophila learn opposing components of a compound food stimulus. Current biology 24:1723–1730. doi: 10.1016/j.cub.2014.05.078.
15. Featherstone DE, Rushton EM, Hilderbrand-Chae M, Phillips AM, Jackson FR, Broadie K. 2000. Presynaptic glutamic acid decarboxylase is required for induction of the postsynaptic receptor field at a glutamatergic synapse. Neuron 27:71–84. doi: 10.1016/S0896-6273(00)00010-6.
16. Feinberg EH, Vanhoven MK, Bendesky A, Wang G, Fetter RD, Shen K, Bargmann CI. 2008. GFP reconstitution across synaptic partners (GRASP) defines cell contacts and synapses in living nervous systems. Neuron 57:353–363. doi: 10.1016/j.neuron.2007.11.030.
17. Garcia J, Kimeldorf DJ, Koelling RA. 1955. Conditioned aversion to saccharin resulting from exposure to gamma radiation. Science 122:157–158.
18. Gerber B, Tanimoto H, Heisenberg M. 2004. An engram found? Evaluating the evidence from fruit flies. Current Opinion in Neurobiology 14:737–744. doi: 10.1016/j.conb.2004.10.014.
19. Gervasi N, Tchenio P, Preat T. 2010. PKA dynamics in a Drosophila learning center: coincidence detection by rutabaga adenylyl cyclase and spatial regulation by dunce phosphodiesterase. Neuron 65:516–529. doi: 10.1016/j.neuron.2010.01.014.
20. Gordon MD, Scott K. 2009. Motor control in a Drosophila taste circuit. Neuron 61:373–384. doi: 10.1016/j.neuron.2008.12.033.
21. Grunewald B. 1999a. Morphology of feedback neurons in the mushroom body of the honeybee, Apis mellifera. The Journal of Comparative Neurology 404:114–126.
22. Grunewald B. 1999b. Physiological properties and response modulations of mushroom body feedback neurons during olfactory learning in the honeybee, Apis mellifera. Journal of Comparative Physiology A 185:565–576.
23. Hamada FN, Rosenzweig M, Kang K, Pulver SR, Ghezzi A, Jegla TJ, Garrity PA. 2008. An internal thermal sensor controlling temperature preference in Drosophila. Nature 454:217–220. doi: 10.1038/nature07001.
24. Hammer M. 1993. An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature 366:59–63. doi: 10.1038/366059a0.
25. HammerM, Menzel R. 1998. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learning & Memory 5:146–156.
26. Hofbauer A, Ebel T, Waltenspiel B, Oswald P, Chen YC, Halder P, Biskup S, Lewandrowski U, Winkler C, Sickmann A, Buchner S, Buchner E. 2009. The Wuerzburg hybridoma library against Drosophila brain. Journal of Neurogenetics 23:78–91. doi: 10.1080/0167706080247162.
27. Honegger KS, Campbell RA, Turner GC. 2011. Cellular-resolution population imaging reveals robust sparse coding in the Drosophila mushroom body. The Journal of Neuroscience 31:11772–11785. doi: 10.1523/JNEUROSCI.1099-11.2011.
28. Huang C, Wang P, Xie Z, Wang L, Zhong Y. 2013. The differential requirement of mushroom body alpha/beta subdivisions in long-term memory retrieval in Drosophila. Protein & Cell 4:512–519. doi: 10.1007/s13238-013-3035-8.
29. Huang C, Zheng X, Zhao H, Li M, Wang P, Xie Z, Wang L, Zhong Y. 2012. A permissive role of mushroom body alpha/beta core neurons in long-term memory consolidation in Drosophila. Current Biology 22:1981–1989. doi: 10.1016/j.cub.2012.08.048.
30. Huetteroth W, Perisse E, Lin S, Klappenbach M, Burke C, Waddell S. 2015. Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Current Biology 25:751–758. doi: 10.1016/j.cub.2015.01.036.
31. Jackson FR, Newby LM, Kulkarni SJ. 1990. Drosophila GABAergic systems: sequence and expression of glutamic acid decarboxylase. Journal of Neurochemistry 54:1068–1078. doi: 10.1111/j.1471-4159.1990.tb02359.x.
32. Jenett A, Rubin GM, Ngo TT, Shepherd D, Murphy C, Dionne H, Pfeiffer BD, Cavallaro A, Hall D, Jeter J, Iyer N, Fetter D, Hausenfluck JH, Peng H, Trautman ET, Svirskas RR, Myers EW, Iwinski ZR, Aso Y, DePasquale GM, Enos A, Hulamm P, Lam SC, Li HH, Laverty TR, Long F, Qu L, Murphy SD, Rokicki K, Safford T, Shaw K, Simpson JH, Sowell A, Tae S, Yu Y, Zugates CT. 2012. A GAL4-driver line resource for Drosophila neurobiology. Cell Reports 2:991–1001. doi: 10.1016/j.celrep.2012.09.011.
33. Kim HF, Ghazizadeh A, Hikosaka O. 2014. Separate groups of dopamine neurons innervate caudate head and tail encoding flexible and stable value memories. Frontiers in neuroanatomy 8:120. doi: 10.3389/fnana.2014.00120.
34. Kim HF, Hikosaka O. 2013. Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values. Neuron 79:1001–1010. doi: 10.1016/j.neuron.2013.06.044.
35. Kim YC, Lee HG, Han KA. 2007. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. The Journal of Neuroscience 27:7640–7647. doi: 10.1523/JNEUROSCI.1167-07.2007.
36. Kitamoto T. 2001. Conditional modification of behavior in Drosophila by targeted expression of a temperaturesensitive shibire allele in defined neurons. Journal of Neurobiology 47:81–92. doi: 10.1002/neu.1018.
37. Krashes MJ, Keene AC, Leung B, Armstrong JD, Waddell S. 2007. Sequential use of mushroom body neuron subsets during Drosophila odor memory processing. Neuron 53:103–115. doi: 10.1016/j.neuron.2006.11.021.
38. Krashes MJ, Waddell S. 2008. Rapid consolidation to a radish and protein synthesis-dependent long-term memory after single-session appetitive olfactory conditioning in Drosophila. The Journal of Neuroscience 28:3103–3113. doi: 10.1523/JNEUROSCI.5333-07.2008.
39. Liljenstrom H. 2003. Neural stability and flexibility: a computational approach. Neuropsychopharmacology 28(Suppl 1):S64–S73.
40. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46:703–713. doi: 10.1016/j.neuron.2005.05.002.
41. Liu C, Placais PY, Yamagata N, Pfeiffer BD, Aso Y, Friedrich AB, Siwanowicz I, Rubin GM, Preat T, Tanimoto H. 2012. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488:512–516. doi: 10.1038/nature11304.
42. Liu WW, Wilson RI. 2013. Glutamate is an inhibitory neurotransmitter in the Drosophila olfactory system. Proceedings of the National Academy of Sciences of USA 110:10294–10299. doi: 10.1073/pnas.1220560110.
43. Mery F, Kawecki TJ. 2005. A cost of long-term memory in Drosophila. Science 308:1148. doi: 10.1126/science.1111331.
44. Mirenowicz J, Schultz W. 1994. Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology 72:1024–1027.
45. Musso PY, Tchenio P, Preat T. 2015. Delayed dopamine signaling of energy level builds appetitive long-term memory in Drosophila. Cell Reports 10:1023–1031. doi: 10.1016/j.celrep.2015.01.036.
46. Nern A, Pfeiffer BD, Rubin GM. 2015. Optimized tools for multicolor stochastic labeling reveal diverse stereotyped cell arrangements in the fly visual system. Proceedings of the National Academy of Sciences of USA 112:E2967–E2976. doi: 10.1073/pnas.1506763112.
47. Ni JQ, Zhou R, Czech B, Liu LP, Holderbaum L, Yang-Zhou D, Shim HS, Tao R, Handler D, Karpowicz P, Binari R, Booker M, Brennecke J, Perkins LA, Hannon GJ, Perrimon N. 2011. A genome-scale shRNA resource for transgenic RNAi in Drosophila. Nature Methods 8:405–407. doi: 10.1038/nmeth.1592.
48. Pagani MR, Oishi K, Gelb BD, Zhong Y. 2009. The phosphatase SHP2 regulates the spacing effect for long-term memory induction. Cell 139:186–198. doi: 10.1016/j.cell.2009.08.033.
49. Pai TP, Chen CC, Lin HH, Chin AL, Lai JS, Lee PT, Tully T, Chiang AS. 2013. Drosophila ORB protein in two mushroom body output neurons is necessary for long-term memory formation. Proceedings of the National Academy of Sciences of USA 110:7898–7903. doi: 10.1073/pnas.1216336110.
50. Perisse E, Yin Y, Lin AC, Lin S, Huetteroth W, Waddell S. 2013. Different kenyon cell populations drive learned approach and avoidance in Drosophila. Neuron 79:945–956. doi: 10.1016/j.neuron.2013.07.045.
51. Perry CJ, Barron AB. 2013. Neural mechanisms of reward in insects. Annual Review of Entomology 58:543–562. doi: 10.1146/annurev-ento-120811-153631.
52. Pfeiffer BD, Ngo TT, Hibbard KL, Murphy C, Jenett A, Truman JW, Rubin GM. 2010. Refinement of tools for targeted gene expression in Drosophila. Genetics 186:735–755. doi: 10.1534/genetics.110.119917.
53. Philips GT, Kopec AM, Carew TJ. 2013. Pattern and predictability in memory formation: from molecular mechanisms to clinical relevance. Neurobiology of Learning and Memory 105:117–124. doi: 10.1016/j.nlm.2013.05.003.
54. Placais PY, Preat T. 2013. To favor survival under food shortage, the brain disables costly memory. Science 339:440–442. doi: 10.1126/science.1226018.
55. Placais PY, Trannoy S, Friedrich AB, Tanimoto H, Preat T. 2013. Two pairs of mushroom body efferent neurons are required for appetitive long-term memory retrieval in Drosophila. Cell Reports 5:769–780. doi: 10.1016/j.celrep.2013.09.032.
56. Placais PY, Trannoy S, Isabel G, Aso Y, Siwanowicz I, Belliart-Guerin G, Vernier P, Birman S, Tanimoto H, Preat T. 2012. Slow oscillations in two pairs of dopaminergic neurons gate long-term memory formation in Drosophila. Nature Neuroscience 15:592–599. doi: 10.1038/nn.3055.
57. Qin H, Cressy M, Li W, Coravos JS, Izzi SA, Dubnau J. 2012. Gamma neurons mediate dopaminergic input during aversive olfactory memory formation in Drosophila. Current Biology 22:608–614. doi: 10.1016/j.cub.2012.02.014.
58. Riemensperger T, Voller T, Stock P, Buchner E, Fiala A. 2005. Punishment prediction by dopaminergic neurons in Drosophila. Current Biology 15:1953–1960. doi: 10.1016/j.cub.2005.09.042.
59. Robinson IM, Ranjan R, Schwarz TL. 2002. Synaptotagmins I and IV promote transmitter release independently of Ca(2+) binding in the C(2)A domain. Nature 418:336–340. doi: 10.1038/nature00915.
60. Rossato JI, Bevilaqua LR, Izquierdo I, Medina JH, Cammarota M. 2009. Dopamine controls persistence of long-term memory storage. Science 325:1017–1020. doi: 10.1126/science.1172545.
61. Schroll C, Riemensperger T, Bucher D, Ehmer J, Völler T, Erbguth K, Gerber B, Hendel T, Nagel G, Buchner E, Fiala A. 2006. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Current Biology 16:1741–1747. doi: 10.1016/j.cub.2006.07.023.
62. SchultzW. 2013. Updating dopamine reward signals. Current Opinion in Neurobiology 23:229–238. doi: 10.1016/j.conb.2012.11.012.
63. Schwaerzel M, Monastirioti M, Scholz H, Friggi-Grelin F, Birman S, Heisenberg M. 2003. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. The Journal of Neuroscience 23:10495–10502.
64. Sejourne J, Placais PY, Aso Y, Siwanowicz I, Trannoy S, Thoma V, Tedjakumala SR, Rubin GM, Tchénio P, Ito K, Isabel G, Tanimoto H, Preat T. 2011. Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nature Neuroscience 14:903–910. doi: 10.1038/nn.2846.
65. Stach S, Giurfa M. 2005. The influence of training length on generalization of visual feature assemblies in honeybees. Behavioural Brain Research 161:8–17. doi: 10.1016/j.bbr.2005.02.008.
66. Takagawa K, Salvaterra P. 1996. Analysis of choline acetyltransferase protein in temperature sensitive mutant flies using newly generated monoclonal antibody. Neuroscience Research 24:237–243. doi: 10.1016/0168-0102(95)00999-X.
67. Tomchik SM, Davis RL. 2009. Dynamics of learning-related cAMP signaling and stimulus integration in the Drosophila olfactory pathway. Neuron 64:510–521. doi: 10.1016/j.neuron.2009.09.029.
68. Trannoy S, Redt-Clouet C, Dura JM, Preat T. 2011. Parallel processing of appetitive short- and long-term memories in Drosophila. Current Biology 21:1647–1653. doi: 10.1016/j.cub.2011.08.032.
69. Turner GC, Bazhenov M, Laurent G. 2008. Olfactory representations by Drosophila mushroom body neurons. Journal of Neurophysiology 99:734–746. doi: 10.1152/jn.01283.2007.
70. Viswanathan S, Williams ME, Bloss EB, Stasevich TJ, Speer CM, Nern A, Pfeiffer BD, Hooks BM, Li WP, English BP, Tian T, Henry GL, Macklin JJ, Patel R, Gerfen CR, Zhuang X, Wang Y, Rubin GM, Looger LL. 2015. Highperformance probes for light and electron microscopy. Nature Methods 12:568–576. doi: 10.1038/nmeth.3365.
71. Vogt K, Schnaitmann C, Dylla KV, Knapek S, Aso Y, Rubin GM, Tanimoto H. 2014. Shared mushroom body circuits underlie visual and olfactory memories in Drosophila. eLife 3:e02395. doi: 10.7554/eLife.02395.
72. Waddell S. 2013. Reinforcement signalling in Drosophila; dopamine does it all after all. Current Opinion in Neurobiology 23:324–329. doi: 10.1016/j.conb.2013.01.005.
73. Watabe-Uchida M, Zhu L, Ogawa SK, Vamanrao A, Uchida N. 2012. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74:858–873. doi: 10.1016/j.neuron.2012.03.017.
74. Wiltgen BJ, Silva AJ. 2007. Memory for context becomes less specific with time. Learning & Memory 14:313–317. doi: 10.1101/lm.430907.
75. Xia S, Miyashita T, Fu TF, Lin WY, Wu CL, Pyzocha L, Lin IR, Saitoe M, Tully T, Chiang AS. 2005. NMDA receptors mediate olfactory learning and memory in Drosophila. Current Biology 15:603–615. doi: 10.1016/j.cub.2005.02.059.
76. Xie Z, Huang C, Ci B, Wang L, Zhong Y. 2013. Requirement of the combination of mushroom body gamma lobe and alpha/beta lobes for the retrieval of both aversive and appetitive early memories in Drosophila. Learning & Memory 20:474–481. doi: 10.1101/lm.031823.113.
77. Yamagata N, Ichinose T, Aso Y, Placais PY, Friedrich AB, Sima RJ, Preat T, Rubin GM, Tanimoto H. 2015. Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proceedings of the National Academy of Sciences of USA 112:578–583. doi: 10.1073/pnas.1421930112.
78. Yang MY, Armstrong JD, Vilinsky I, Strausfeld NJ, Kaiser K. 1995. Subdivision of the Drosophila mushroom bodies by enhancer-trap expression patterns. Neuron 15:45–54.