Event timing in associative learning: From biochemical reaction dynamics to behavioural observations

PLoS ONE

Volumn 7, Issue 3, 2012, Pages

  Yarali, Ayse ^a   Nehrkorn, Johannes ^a,b,c   Tanimoto, Hiromu ^a   Herz, Andreas V M ^b,c  

^a MAX PLANCK INSTITUTE OF NEUROBIOLOGY   (Germany)

^b UNIVERSITY OF MUNICH   (Germany)

^c Bernstein Center for Computational Neuroscience   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADENYLATE CYCLASE; CALCIUM ION; DOPAMINE; SEROTONIN; CALCIUM;

ANIMAL EXPERIMENT; APLYSIA; ARTICLE; AVOIDANCE BEHAVIOR; BEHAVIOR; BIOCHEMISTRY; CALCIUM SIGNALING; CONDITIONING; CONTROLLED STUDY; DROSOPHILA; ELECTRIC SHOCK; LEARNING; NERVE CELL PLASTICITY; NONHUMAN; OBSERVATION; PUNISHMENT LEARNING; QUANTITATIVE ANALYSIS; RELIEF LEARNING; SMELLING; STATE DEPENDENT LEARNING; TIME PERCEPTION; TRAINING; ANIMAL; METABOLISM; PHYSIOLOGY; THEORETICAL MODEL;

APLYSIA;

ADENYLATE CYCLASE; ANIMALS; APLYSIA; CALCIUM; CALCIUM SIGNALING; LEARNING; MODELS, THEORETICAL; NEURONAL PLASTICITY; SEROTONIN;

EID: 84859125224     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0032885     Document Type: Article

References (66)

1. Rescorla RA, (1988) Behavioral studies of Pavlovian conditioning. Annu Rev Neurosci 11: 329-352.
2. Solomon RL, Corbit JD, (1974) An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol Rev 81: 119-145.
3. Wagner AR, (1981) SOP: A model of automatic memory processing in animal behavior. In: Spear NE, Miller RR, editors. Information Processing in Animals: Memory Mechanisms Hillsdale, NJ Erlbaum pp. 5-47.
4. Sutton RS, Barto AG, (1990) Time-derivative models of pavlovian reinforcement. In: Gabriel M, Moore J, editors. Learning and computational neuroscience: Foundations of adaptive networks Cambridge, MA MIT Press pp. 497-537.
5. Chang RC, Blaisdell AP, Miller RR, (2003) Backward conditioning: mediation by the context. J Exp Psychol Anim Behav Process 29: 171-183.
6. Moscovitch A, LoLordo VM, (1968) Role of safety in the Pavlovian backward fear conditioning procedure. J Comp Physiol Psychol 66: 673-678.
7. Plotkin HC, Oakley DA, (1975) Backward conditioning in the rabbit (Oryctolagus cuniculus). J Comp Physiol Psychol 88: 586-590.
8. Maier SF, Rapaport P, Wheatley KL, (1976) Conditioned inhibition and the UCS-CS interval. Anim Learn Behav 4: 217-220.
9. Hellstern F, Malaka R, Hammer M, (1998) Backward inhibitory learning in honeybees: a behavioral analysis of reinforcement processing. Learn Mem 4: 429-444.
10. Britton G, Farley J, (1999) Behavioral and neural bases of noncoincidence learning in Hermissenda. J Neurosci 19: 9126-9132.
11. Tanimoto H, Heisenberg M, Gerber B, (2004) Experimental psychology: event timing turns punishment to reward. Nature 430: 983.
12. Andreatta M, Muhlberger A, Yarali A, Gerber B, Pauli P, (2010) A rift between implicit and explicit conditioned valence in human pain relief learning. Proc Biol Sci 277: 2411-2416.
13. Yarali A, Niewalda T, Chen Y-c, Tanimoto H, Duerrnagel S, et al. (2008) 'Pain relief' learning in fruit flies. Animal Behavior 76: 1173-1185.
14. Khurana S, Abu Baker MB, Siddiqi O, (2009) Odor avoidance learning in the larva of Drosophila melanogaster. J Biosci 34: 621-631.
15. Yarali A, Krischke M, Michels B, Saumweber T, Mueller MJ, et al. (2009) Genetic distortion of the balance between punishment and relief learning in Drosophila. J Neurogenet 23: 235-247.
16. Yarali A, Gerber B, (2010) A Neurogenetic Dissociation between Punishment-, Reward-, and Relief-Learning in Drosophila. Front Behav Neurosci 4: 189.
17. Murakami S, Dan C, Zagaeski B, Maeyama Y, Kunes S, et al. (2010) Optimizing Drosophila olfactory learning with a semi-automated training device. J Neurosci Methods 188: 195-204.
18. Drew PJ, Abbott LF, (2006) Extending the effects of spike-timing-dependent plasticity to behavioral timescales. Proc Natl Acad Sci U S A 103: 8876-8881.
19. Ito I, Ong RC, Raman B, Stopfer M, (2008) Olfactory learning and spike timing dependent plasticity. Commun Integr Biol 1: 170-171.
20. Murthy M, Fiete I, Laurent G, (2008) Testing odor response stereotypy in the Drosophila mushroom body. Neuron 59: 1009-1023.
21. Turner GC, Bazhenov M, Laurent G, (2008) Olfactory representations by Drosophila mushroom body neurons. J Neurophysiol 99: 734-746.
22. Wang Y, Guo HF, Pologruto TA, Hannan F, Hakker I, et al. (2004) Stereotyped odor-evoked activity in the mushroom body of Drosophila revealed by green fluorescent protein-based Ca2+ imaging. J Neurosci 24: 6507-6514.
23. Yu D, Akalal DB, Davis RL, (2006) Drosophila alpha/beta mushroom body neurons form a branch-specific, long-term cellular memory trace after spaced olfactory conditioning. Neuron 52: 845-855.
24. Wang Y, Mamiya A, Chiang AS, Zhong Y, (2008) Imaging of an early memory trace in the Drosophila mushroom body. J Neurosci 28: 4368-4376.
25. Schwaerzel M, Monastirioti M, Scholz H, Friggi-Grelin F, Birman S, et al. (2003) Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. J Neurosci 23: 10495-10502.
26. Riemensperger T, Voller T, Stock P, Buchner E, Fiala A, (2005) Punishment prediction by dopaminergic neurons in Drosophila. Curr Biol 15: 1953-1960.
27. Kim YC, Lee HG, Han KA, (2007) D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J Neurosci 27: 7640-7647.
28. Claridge-Chang A, Roorda RD, Vrontou E, Sjulson L, Li H, et al. (2009) Writing memories with light-addressable reinforcement circuitry. Cell 139: 405-415.
29. Aso Y, Siwanowicz I, Bräcker L, Ito K, Kitamoto T, et al. (2010) Specific dopaminergic neurons for the formation of labile aversive memory. Curr Biol 20: 1445-1451.
30. Livingstone MS, Sziber PP, Quinn WG, (1984) Loss of calcium/calmodulin responsiveness in adenylate cyclase of rutabaga, a Drosophila learning mutant. Cell 37: 205-215.
31. Connolly JB, Roberts IJ, Armstrong JD, Kaiser K, Forte M, et al. (1996) Associative learning disrupted by impaired Gs signaling in Drosophila mushroom bodies. Science 274: 2104-2107.
32. Zars T, Fischer M, Schulz R, Heisenberg M, (2000) Localization of a short-term memory in Drosophila. Science 288: 672-675.
33. Blum AL, Li W, Cressy M, Dubnau J, (2009) Short- and long-term memory in Drosophila require cAMP signaling in distinct neuron types. Curr Biol 19: 1341-1350.
34. Tomchik SM, Davis RL, (2009) Dynamics of learning-related cAMP signaling and stimulus integration in the Drosophila olfactory pathway. Neuron 64: 510-521.
35. Gervasi N, Tchenio P, Preat T, (2010) PKA dynamics in a Drosophila learning center: coincidence detection by rutabaga adenylyl cyclase and spatial regulation by dunce phosphodiesterase. Neuron 65: 516-529.
36. Séjourné J, Plaçais PY, Aso Y, Siwanowicz I, Trannoy S, et al. (2011) Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nat Neurosci 14: 903-910.
37. Lin AH, Cohen JE, Wan Q, Niu K, Shrestha P, et al. (2010) Serotonin stimulation of cAMP-dependent plasticity in Aplysia sensory neurons is mediated by calmodulin-sensitive adenylyl cyclase. Proc Natl Acad Sci U S A 107: 15607-15612.
38. Abrams TW, (1985) Activity-dependent presynaptic facilitation: an associative mechanism in Aplysia. Cell Mol Neurobiol 5: 123-145.
39. Ocorr KA, Walters ET, Byrne JH, (1985) Associative conditioning analog selectively increases cAMP levels of tail sensory neurons in Aplysia. Proc Natl Acad Sci U S A 82: 2548-2552.
40. Abrams TW, Karl KA, Kandel ER, (1991) Biochemical studies of stimulus convergence during classical conditioning in Aplysia: dual regulation of adenylate cyclase by Ca2+/calmodulin and transmitter. J Neurosci 11: 2655-2665.
41. Yovell Y, Abrams TW, (1992) Temporal asymmetry in activation of Aplysia adenylyl cyclase by calcium and transmitter may explain temporal requirements of conditioning. Proc Natl Acad Sci U S A 89: 6526-6530.
42. Abrams TW, Yovell Y, Onyike CU, Cohen JE, Jarrard HE, (1998) Analysis of sequence-dependent interactions between transient calcium and transmitter stimuli in activating adenylyl cyclase in Aplysia: possible contribution to CS-US sequence requirement during conditioning. Learn Mem 4: 496-509.
43. Onyike CU, Lin AH, Abrams TW, (1998) Persistence of the interaction of calmodulin with adenylyl cyclase: implications for integration of transient calcium stimuli. J Neurochem 71: 1298-1306.
44. Lin AH, Onyike CU, Abrams TW, (1998) Sequence-dependent interactions between transient calcium and transmitter stimuli in activation of mammalian brain adenylyl cyclase. Brain Res 800: 300-307.
45. Adams JA, Omann GM, Linderman JJ, (1998) A mathematical model for ligand/receptor/G-protein dynamics and actin polymerization in human neutrophils. J Theor Biol 193: 543-560.
46. Rospars JP, Lucas P, Coppey M, (2007) Modeling the early steps of transduction in insect olfactory receptor neurons. Biosystems 89: 101-109.
47. Preat T, (1998) Decreased odor avoidance after electric shock in Drosophila mutants biases learning and memory tests. J Neurosci 18: 8534-8538.
48. Acevedo SF, Froudarakis EI, Tsiorva A-A, Skoulakis EMC, (2007) Distinct neuronal circuits mediate experience-dependent, non-associative osmotactic responses in Drosophila. Mol Cell Neurosci 34: 378-389.
49. Alberts B, Johnson A, Levis J, Raff M, Roberts K, et al. (2002) Molecular Biology of the Cell. 4th ed New York Garland Science pp. 868-869.
50. Halnes G, Ulfhielm E, Ljunggren EE, Kotaleski JH, Rospars J-P, (2009) Modelling and sensitivity analysis of the reactions involving receptor, G-protein and effector in vertebrate olfactory receptor neurons. J Comput Neurosci 27: 471-491.
51. Tully T, Quinn WG, (1985) Classical conditioning and retention in normal and mutant Drosophila melanogaster. J Comp Physiol A 157: 263-277.
52. Galili DS, Lüdke A, Galizia CG, Szyszka P, Tanimoto H, (2011) Olfactory trace conditioning in Drosophila. J Neurosci 31: 7240-7248.
53. Dougherty DP, Wright GA, Yew AC, (2005) Computational model of the cAMP-mediated sensory response and calcium-dependent adaptation in vertebrate olfactory receptor neurons. Proc Natl Acad Sci U S A 102: 10415-10420.
54. Shuai Y, Hu Y, Qin H, Campbell RA, Zhong Y, (2011) Distinct molecular underpinnings of Drosophila olfactory trace conditioning. Proc Natl Acad Sci U S A 108: 20201-20206.
55. Lindskog M, Kim M, Wikström MA, Blackwell KT, Kotaleski JH, (2006) Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation. PLoS Comp Biol 2: e19.
56. Zhang J, Lau P, Bi G, (2009) Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc Natl Acad Sci U S A 106: 13028-13033.
57. Whitlock JR, Heynen AJ, Shuler MG, Bear MF, (2006) Learning induces long-term potentiation in the hippocampus. Science 313: 1093-1097.
58. Michels B, Chen YC, Saumweber T, Mishra D, Tanimoto H, et al. (2011) Cellular site and molecular mode of synapsin action in associative learning. Learn Mem 18: 332-344.
59. Muller U, (2000) Prolonged activation of cAMP-dependent protein kinase during conditioning induces long-term memory in honeybees. Neuron 27: 159-168.
60. Aszodi A, Muller U, Friedrich P, Spatz HC, (1991) Signal convergence on protein kinase A as a molecular correlate of learning. Proc Natl Acad Sci U S A 88: 5832-5836.
61. Pagani MR, Oishi K, Gelb BD, Zhong Y, (2009) The phosphatase SHP2 regulates the spacing effect for long-term memory induction. Cell 139: 186-198.
62. Pan Y, Zhou Y, Guo C, Gong H, Gong Z, et al. (2009) Differential roles of the fan-shaped body and the ellipsoid body in Drosophila visual pattern memory. Learn Mem 16: 289-295.
63. Selcho M, Pauls D, Han KA, Stocker RF, Thum AS, (2009) The role of dopamine in Drosophila larval classical olfactory conditioning. PLoS One 4: e5897.
64. Seugnet L, Suzuki Y, Vine L, Gottschalk L, Shaw PJ, (2008) D1 receptor activation in the mushroom bodies rescues sleep-loss-induced learning impairments in Drosophila. Curr Biol 18: 1110-1117.
65. Cassenaer S, Laurent G, (2007) Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts. Nature 448: 709-713.
66. Cassenaer S, Laurent G, (2012) Conditional modulation of spike-timing-dependent plasticity for olfactory learning. Nature 482: 47-52.