Associative learning in invertebrates

Cold Spring Harbor Perspectives in Biology

Volumn 7, Issue 5, 2015, Pages 1-18

  Hawkins, Robert D ^a,b   Byrne, John H ^c  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^c UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APLYSIA; INVERTEBRATA; VERTEBRATA;

ANIMAL; INVERTEBRATE; LEARNING; PHYSIOLOGY;

ANIMALS; INVERTEBRATES; LEARNING;

EID: 84930455343     PISSN: None     EISSN: 19430264     Source Type: Journal    
DOI: 10.1101/cshperspect.a021709     Document Type: Article

References (108)

1. Abrams TW, Castellucci VF, Camardo JS, Kandel ER, Lloyd PE. 1984. Two endogenous neuropeptides modulate the gill and siphon withdrawal reflex in Aplysia by presynap-tic facilitation involving cAMP-dependent closure of a serotonin-sensitive potassium channel. Proc Natl Acad Sci 81: 7956–7960.
2. Abrams TW, Karl KA, Kandel ER. 1991. Biochemical studies of stimulus convergence during classical conditioning in Aplysia: Dual regulation of adenylate cyclase by Ca2þ/calmodulin and transmitter. J Neurosci 11: 2655–2665.
3. Abrams TW, Yovell Y, Onyike CU, Cohen JE, Jarrard HE. 1998. Analysis of sequence-dependent interactions between calcium and transmitter stimuli in activating ad-enylyl cyclase in Aplysia: Possible contributions to CS– US sequence requirement during conditioning. Learn Mem 4: 496–509.
4. Alkon DL. 1984. Calcium-mediated reduction of ionic currents: A biophysical memory trace. Science 226: 1037–1045.
5. Alkon DL, Lederhendler I, Shoukimas JJ. 1982. Primary changes of membrane currents during retention of associative learning. Science 215: 693–695.
6. Alkon DL, Acosta-Urquidi J, Olds J, Kuzma G, Neary JT. 1983. Protein kinase injection reduces voltage-dependent potassium currents. Science 219: 303–306.
7. Antonov I, Kandel ER, Hawkins RD. 1999. The contribution of facilitation of monosynaptic PSPs to dishabituation and sensitization of the Aplysia siphon withdrawal reflex. J Neurosci 19: 10438–10450.
8. Antonov I, Antonova I, Kandel ER, Hawkins RD. 2001. The contribution of activity-dependent synaptic plasticity to classical conditioning in Aplysia. J Neurosci 21: 6413–6422.
9. Antonov I, Antonova I, Kandel ER, Hawkins RD. 2003. Activity-dependent presynaptic facilitation and Hebbian LTP are both required and interact during classical conditioning in Aplysia. Neuron 37: 135–147.
10. Antonov I, Ha T, Antonova I, Moroz LL, Hawkins RD. 2007. Role of nitric oxide in classical conditioning of siphon withdrawal in Aplysia. J Neurosci 27: 10993–11002.
11. Antzoulatos EG, Byrne JH. 2004. Learning insights transmitted by glutamate. More than synaptic plasticity: Role of nonsynaptic plasticity in learning and memory. Trends Neurosci 27: 555–560.
12. Baldwin AE, Sadeghian K, Holahan MR, Kelley AE. 2002. Appetitive instrumental learning is impaired by inhibition of cAMP-dependent protein kinase within the nucleus accumbens. Neurobiol Learn Mem 77: 44–62.
13. Bao J-X, Kandel ER, Hawkins RD. 1998. Involvement of presynaptic and postsynaptic mechanisms in a cellular analog of classical conditioning at Aplysia sensory-motor neuron synapses in isolated cell culture. J Neurosci 18: 458–466.
14. Basu J, Siegelbaum SA. 2015. The cortico-hippocampal circuit, synaptic plasticity, and memory. Cold Spring Harb Perspect Biol doi: 10.1101/cshperspect.a021733.
15. Berry JA, Cervantes-Sandoval I, Nicholas EP, Davis RL. 2012. Dopamine is required for learning and forgetting in Drosophila. Neuron 74: 530-542.
16. Botzer D, Markovich S, Susswein A. 1998. Multiple memory processes following training that a food is inedible in Aplysia. Learn Mem 5: 204-219.
17. Brembs B, Plendl W. 2008. Double dissociation of protein-kinase C and adenylyl cyclase manipulations on operant and classical learning in Drosophila. Curr Biol 18: 1168-1171.
18. Brembs B, Lorenzetti F, Reyes F, Baxter DA, Byrne JH. 2002. Operant reward learning in Aplysia: Neuronal correlates and mechanisms. Science 296: 1706–1709.
19. Buonomano DV, Byrne JH. 1990. Long-term synaptic changes produced by a cellular analogue of classical conditioning in Aplysia. Science 249: 420-423.
20. Buonomano DV, Baxter DA, Byrne JH. 1990. Small networks of empirically derived adaptive elements simulate some higher-order features of classical conditioning. Neural Networks 3: 507-523.
21. Byrne JH, Hawkins RD. 2015. Nonassociative learning in invertebrates. Cold Spring Harb Perspect Biol doi:10.1101/cshperspect.a021675.
22. Carew TJ, Walters ET, Kandel ER. 1981. Classical conditioning in a simple withdrawal reflex in Aplysia californica. J Neurosci 1: 1426-1437.
23. Carew TJ, Hawkins RD, Kandel ER. 1983. Differential classical conditioning of a defensive withdrawal reflex in Aplysia californica. Science 219: 397-400.
24. Chen CC, Wu JK, Lin HW, Pai TP, Fu TF, Wu CL, Tully T, Chiang AS. 2012. Visualizing long-term memory formation in two neurons of the Drosophila brain. Science 335: 678–685.
25. Clark GA, Hawkins RD, Kandel ER. 1994. Activity-dependent enhancement of presynaptic facilitation provides a cellular mechanism for the temporal specificity of classical conditioning in Aplysia. Learn Mem 1: 243-257.
26. Cohen-Armon M, Visochek L, Katzoff A, Levitan D, Susswein AJ, Klein R, Valbrun M, Schwartz JH. 2004. Long-term memory requires polyADP-ribosylation. Science 304: 1820-1822.
27. Colwill R, Goodrum K, Martin A. 1997. Pavlovian appetitive discriminative conditioning in Aplysia californica. Anim Learn Behav 25: 268-276.
28. Cook DG, Carew TJ. 1986. Operant conditioning of head waving in Aplysia. Proc Natl Acad Sci 83: 1120-1124.
29. Crow TJ, Alkon DL. 1978. Retention of an associative behavioral change in Hermissenda. Science 201:1239–1241.
30. Crow T, Forrester J. 1990. Inhibition of protein synthesis blocks long-term enhancement of generator potentials produced by one-trial in vivo conditioning in Hermissenda. Proc Natl Acad Sci 87: 4490-4494.
31. Crow T, Jin NG. 2013. Multisite cellular and synaptic mechanisms in Hermissenda Pavlovian conditioning. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 236–250. Academic, San Diego.
32. Crow T, Siddiqi V, Dash PK. 1997. Long-term enhancement but not short-term in Hermissenda is dependent upon mRNA synthesis. Neurobiol Learn Mem 68: 343-350.
33. Crow T, Xue-Bian JJ, Siddiqi V, Kang Y, Neary JT. 1998. Phosphorylation of mitogen-activated protein kinase by one-trial and multi-trial classical conditioning. JNeu-rosci 18: 3480–3487.
34. Dale N, Kandel ER. 1993. L-glutamate may be the fast excitatory transmitter of Aplysia sensory neurons. Proc Natl Acad Sci 90: 7163-7167.
35. Davis RL. 2005. Olfactory memory formation in Drosophila: From molecular to systems neuroscience. Annu Rev Neurosci 28: 275-302.
36. Dong Y, Green T, Saal D, Marie H, Neve R, Nestler EJ, Ma-lenka RC. 2006. CREB modulates excitability of nucleus accumbens neurons. Nat Neurosci 9: 475–477.
37. Dudai Y, Tully T. 2003. Invertebrate learning. In Learning and memory (ed. Byrne JH), pp. 292–296. Macmillan, New York.
38. Eliot LS, Hawkins RD, Kandel ER, Schacher S. 1994. Pairing-specific, activity-dependent presynaptic facilitation at Aplysia sensory-motor neuron synapses in isolated cell cultures. JNeurosci 14: 368-383.
39. Farley J, Auerbach S. 1986. Protein kinase C activation induces conductance changes in Hermissenda photoreceptors like those seen in associative learning. Nature 319: 220–223.
40. Gelperin A. 2013. Associative memory mechanisms in terrestrial slugs and snails. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 280–292. Academic, San Diego.
41. Gervasi N, Tchenio P, Preat T. 2010. PKA dynamics in a Drosophila learning center: Coincidence detection by rutabaga adenylyl cyclase and spatial regulation by dunce phosphodiesterase. Neuron 65: 516–529.
42. Glanzman DL, Mackey SL, Hawkins RD, Dyke AM, Lloyd PE, Kandel ER. 1989. Depletion of serotonin in the nervous system of Aplysia reduces the behavioral enhancement of gill withdrawal as well as the heterosynaptic facilitation produced by tail shock. J Neurosci 9: 4200-4213.
43. Gormezano I. 1972. Investigations of defense and reward conditioning in the rabbit. In Classical conditioning: II. Current research and theory (ed. Black AH, Prokasy WF), pp. 151–181. Appleton-Century-Crofts, New York.
44. Graybiel A. 2015. The striatum: Where skills and habits meet. Cold Spring Harb Perspect Biol doi:10.1101/cshperspect.a021691.
45. Hawkins RD. 1981. Interneurons involved in mediation and modulation of gill-withdrawal reflex in Aplysia: III. Iden-tified facilitating neurons increase Ca current in sensory neurons. JNeurophysiol 45: 327-339.
46. Hawkins RD. 1989. A biologically based computational model for several simple forms of learning. Psychol Learn Motiv 23: 65-108.
47. Hawkins RD. 2013. Possible contributions of a novel form of synaptic plasticity in Aplysia to reward, memory, and their dysfunctions in mammalian brain. Learn Mem 20: 580–591.
48. Hawkins RD, Kandel ER. 1984. Is there a cell biological alphabet for simple forms of learning? Psychol Rev 91: 375–391.
49. Hawkins RD, Schacher S. 1989. Identified facilitator neurons L29 and L28 are excitedbycutaneous stimuli used in dishabituation, sensitization, and classical conditioning in Aplysia. J Neurosci 9: 4236–4245.
50. Hawkins RD, Castellucci VF, Kandel ER. 1981a. Interneu-rons involved in mediation and modulation of gill-withdrawal reflex in Aplysia: I. Identification and characterization. J Neurophysiol 45: 304–314.
51. Hawkins RD, Castellucci VF, Kandel ER. 1981b. Interneu-rons involved in mediation and modulation of gill-withdrawal reflex in Aplysia: II. Identified neurons produce heterosynaptic facilitation contributing to behavioral sensitization. J Neurophysiol 45: 315–326.
52. Hawkins RD, Abrams TW, Carew TJ, Kandel ER. 1983. A cellular mechanism of classical conditioning in Aplysia: Activity-dependent amplification of presynaptic facilitation. Science 219: 400–415.
53. Hawkins RD, Carew TJ, Kandel ER. 1986. Effects of inter-stimulus interval and contingencyon classical conditioning of the Aplysia siphon withdrawal reflex. J Neurosci 6: 1695–1701.
54. Hawkins RD, Lalevic N, Clark GA, Kandel ER. 1989. Classical conditioning of the Aplysia siphon-withdrawal reflex exhibits response specificity. Proc Natl Acad Sci 86: 7620–7624.
55. Hawkins RD, Greene W, Kandel ER. 1998. Classical conditioning, differential conditioning, and second-ordercon-ditioning of the Aplysia gill-withdrawal reflex in a simplified mantle organ preparation. Behav Neurosci 112: 636–645.
56. Hawkins RD, Clark GA, Kandel ER. 2006. Operant conditioning of gill withdrawal in Aplysia. J Neurosci 26: 2443–2448.
57. Kamin LJ. 1969. Predictability, surprise, attention, and conditioning. In Punishment and aversive behavior (ed. Campbell BA, Church RM), pp. 279–296. Appleton-Century-Crofts, New York.
58. Kandel ER, Abrams T, Bernier L, Carew TJ, Hawkins RD, Schwartz JH. 1983. Classical conditioning and sensitiza-tion share aspects of the same molecular cascade in Aply-sia. Cold Spring Harbor Symp Quant Biol 48: 821–830.
59. Katzoff A, Ben-Gedalya T, Susswein AJ. 2002. Nitric oxide is necessary for multiple memory processes after learning that food is inedible inAplysia. J Neurosci 22: 9581–9594.
60. Katzoff A, Miller N, Susswein AJ. 2010. Nitric oxide and histamine signal attempts to swallow: A component of learning that food is inedible in Aplysia. Learn Mem 17: 50–62.
61. Keene AC, Waddell S. 2007. Drosophila olfactory memory: Single genes to complex neural circuits. Nat Rev Neurosci 8: 341–354.
62. Kemenes G. 2013. Molecular and cellular mechanisms of classical conditioning in the feeding system of Lymnea. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 251–264. Academic, San Diego.
63. Lechner HA, Baxter DA, Byrne JH. 2000a. Classical conditioning of feeding in Aplysia: I. Behavioral analysis. J Neurosci 20: 3369–3376.
64. Lechner HA, Baxter DA, Byrne JH. 2000b. Classical conditioning of feeding in Aplysia: II. Neurophysiological correlates. J Neurosci 20: 3377–3386.
65. Lederhendler II, Gart S, Alkon DL. 1986. Classical conditioning of Hermissenda: Origin of a new response. J Neu-rosci 6: 1325–1331.
66. Levitan D, Lyons LC, Perelman A, Green CL, Motro B, Eskin A, Susswein AJ. 2008. Training with inedible food in Aplysia causes expression of C/EBP in the buccal but not cerebral ganglion. Learn Mem 15: 412–416.
67. Lin XY, Glanzman DL. 1994a. Hebbian induction of long-term potentiation of Aplysia sensorimotor synapses: Partial requirement for activation of an NMDA-related receptor. Proc Biol Sci 255: 215–221.
68. Lin XY, Glanzman DL. 1994b. Long-term potentiation of Aplysia sensorimotor synapses in cell culture: Regulation by postsynaptic voltage. Proc Biol Sci 255: 113–118.
69. Lorenzetti FD, Mozzachiodi R, Baxter DA, Byrne JH. 2006. Classical and operant conditioning differentially modify the intrinsic properties of an identified neuron. Nat Neu-rosci 9: 17–19.
70. Lorenzetti FD, Baxter DA, Byrne JH. 2008. Molecular mechanisms underlying a cellular analog of operant reward learning. Neuron 59: 815–828.
71. Lukowiak K, Ringseis E, Spencer G, Wildering W, Syed N. 1996. Operant conditioning of aerial respiratory behaviour in Lymnaea stagnalis. J Exp Biol 199: 683–691.
72. Lukowiak K, Sangha S, Scheibenstock A, Parvez K, McComb C, Rosenegger D, Varshney N, Sadamoto H. 2003. A mol-luscan model system in the search for the engram. J Phys-iol Paris 97: 69–76.
73. Mackey SL, Kandel ER, Hawkins RD. 1989. Identified sero-tonergic neurons LCB1 and RCB1 in the cerebral ganglia of Aplysia produce presynaptic facilitation of siphon sensory neurons. J Neurosci 9: 4227–4235.
74. Menzel R. 2001. Searching for the memory trace in a mini-brain, the honeybee. Learn Mem 8: 53–62.
75. Menzel R. 2013. In search of the engram in the honeybee brain.In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 397–415. Academic, San Diego.
76. Menzel R, Benjamin PR. 2013. Beyond the cellular alphabet of learning and memory in invertebrates. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 3–8. Academic, San Diego.
77. Menzel R, Leboulle G, Eisenhardt D. 2006. Small brains, bright minds. Cell 124: 237–239.
78. Michel M, Green CL, Lyons LC. 2011. PKA and PKC are required for long-term but not short-term in vivo oper-ant memory in Aplysia. Learn Mem 18: 19–23.
79. Michel M, Green CL, Gardner JS, Organ CL, Lyons LC. 2012. Massed training-induced intermediate-term oper-ant memory in Aplysia requires protein synthesis and multiple persistent kinase cascades. J Neurosci 32: 4581–4591.
80. Muller U. 2013. Memory phases and signaling cascades in honeybees. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 433–441. Academic, San Diego.
81. Murphy GG, Glanzman DL. 1996. Enhancement of sensor-imotor connections by conditioning-related stimulation in Aplysia depends on postsynaptic Ca2þ. Proc Natl Acad Sci 93: 9931–9936.
82. Murphy GG, Glanzman DL. 1997. Mediation of classical conditioning in Aplysia californica by long-term poten-tiation of sensorimotor synapses. Science 278: 467–471.
83. Murphy GG, Glanzman DL. 1999. Cellular analog of differential classical conditioning in Aplysia: Disruption by the NMDA receptor antagonist DL-2-amino-5-phosphono-valerate. J Neurosci 19: 10595–10602.
84. Nargeot R, Baxter DA, Byrne JH. 1999. In vitro analog of operant conditioning in Aplysia: I. Contingent reinforcement modifies the functional dynamics of an identified neuron. J Neurosci 15: 2247–2260.
85. Nargeot R, Le Bon-Jego M, Simmers J. 2009. Cellular and network mechanisms of operant learning-induced compulsive behavior in Aplysia. Curr Biol 19: 975–998.
86. Ocorr KA, Walters ET, Byrne JH. 1985. Associative conditioning analog selectively increases cAMP levels of tail sensory neurons in Aplysia. Proc Natl Acad Sci 82: 2548–2552.
87. Pieroni JP, Byrne JH. 1992. Differential effects of serotonin, FMRFamide and small cardioactive peptide on multiple, distributed processes modulating sensorimotor synaptic transmission in Aplysia. J Neurosci 12: 2633–2647.
88. Rescorla RA. 1967. Pavlovian conditioning and its proper control procedures. Psychol Rev 74: 71–80.
89. Rescorla RA. 1968. Probability of shock in the presence and absence ofCS infearconditioning. J Comp Physiol Psychol 66: 1–5.
90. Rescorla RA, Wagner AR. 1972. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and non-reinforcement. In Classical conditioning II: Current research and theory (ed. Black AH, Prokasy WF). Appleton-Century-Crofts, New York.
91. Reynolds JN, Hyland BI, Wickens JR. 2001. A cellular mechanism of reward-related learning. Nature 413: 67–70.
92. Rosenegger D, Lukowiak K. 2010. The participation of NMDA receptors, PKC, and MAPK in the formation of memory following operant conditioning in Lymnaea. Mol Brain 3: 24.
93. Sahley C, Rudy JW, Gelperin A. 1981. Analysis of associative learning in a terrestrial mollusk: I. Higher-order conditioning, blocking, and atransient US pre-exposure effect. J Comp Physiol 144: 1–8.
94. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science 275: 1593–1599.
95. Schwarz M, Feldman E, Susswein AJ. 1991. Variables affecting long-term memory of learning that a food is inedible in Aplysia. Behav Neurosci 105: 193–201.
96. Shuai Y, Hu Y, Qin H, Campbell RA, Zhong Y. 2011. Distinct molecular underpinnings of Drosophila olfactory trace conditioning. Proc Natl Acad Sci 108: 20201–20206.
97. Smith-Roe SL, Kelley AE. 2000. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J Neurosci 20: 7737–7742.
98. Spencer GE, Kazmi MH, Syed NI, Lukowiak K. 2002. Changes in the activity of a CpG neuron after the rein- forcement of an operantly conditioned behavior in Lym-naea. J Neurophysiol 88: 1915–1923.
99. Susswein A, Schwartz M. 1983.Alearned change ofresponse to inedible food in Aplysia. Behav Neural Biol 39: 1–6.
100. Susswein A, Schwartz M, Feldman E. 1986. Learned changes of feeding behavior in Aplysia in response to edible and inedible foods. J Neurosci 16: 1513–1527.
101. Tomchik SM, Davis RL. 2009. Dynamics of learning-related cAMP signaling and stimulus integration in the Dro-sophila olfactory pathway. Neuron 64: 510–521.
102. Tomchik SM, Davis RL. 2013. Drosophila memory research through four eras. In Invertebrate learning and memory (ed. Menzel R, Benjamin PR), pp. 359–377. Academic, San Diego.
103. Trudeau LE, Castellucci VF. 1993. Excitatory amino acid neurotransmission at sensory-motor and interneuronal synapses of Aplysia californica. J Neurophysiol 70: 1221–1230.
104. Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K. 2009. Phasic firing in dopaminer-gic neurons is sufficient for behavioral conditioning. Science 324: 1080–1084.
105. Walters ET. 1989. Transformation of siphon responses during conditioning of Aplysia suggests a model of primitive stimulus-response association. Proc Natl Acad Sci 86: 7616–7619.
106. Walters ET, Byrne JH. 1983. Associative conditioning of single sensory neurons suggests a cellular mechanism for learning. Science 219: 405–408.
107. Walters ET, Carew TJ, Kandel ER. 1981. Associative learning in Aplysia: Evidence for conditioned fear in an invertebrate. Science 211: 504–506.
108. Yovell Y, Kandel ER, Dudai Y, Abrams TW. 1992. A quantitative study of the Ca2þ/calmodulin sensitivity of ad-enylyl cyclase in Aplysia, Drosophila, and rat. J Neurochem 59: 1736–1744.