An integrated computational model of the two phase theory of classical conditioning

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Inderbitzin, Martin ^a   Herreros Alonso, Ivan ^a   Verschure, Paul F M J ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; COMPUTATION THEORY; COMPUTATIONAL METHODS; PLASTICITY;

AUDITORY CORTEX; BASAL FOREBRAIN; CLASSICAL CONDITIONING; EYE BLINK; INTEGRATED COMPUTATIONAL MODELS; MOTOR RESPONSE; PERFORMANCE; SPECIFIC LEARNING; SPECIFIC STATE; TWO PHASE THEORY;

LEARNING SYSTEMS;

EID: 79959403466     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596874     Document Type: Conference Paper

References (77)

1. J. Konorksi, Conditioned reflex and neuron organization. Cambridge, Univ,. Press, 1948.
2. J. Konorski, Integrative Activity of the Brain. An Interdisciplinary Approach. University of Chicago Press, 1968.
3. G. D. Ellison and J. Konorski, "Separation of the salivary and motor responses in instrumental conditioning," Science, vol. 146, no. 3647, pp. 1071-1072, Nov. 1964.
4. M. A. Sanchez-Montanes, P. Koenig, and P. F. M. J. Verschure, "Learning sensory maps with real-world stimuli in real time using biophysically realistic learning rule," IEEE Transaction on neural networks, vol. 13, pp. 619-632, 2002.
5. C. Hofstoffer, M. Mintz, and P. F. M. J. Verschure, "The cerebellum in action: a simulation and a robotics study," European Journal of Neuroscience, vol. 16, pp. 1361-1376, 2002.
6. N. Mackintosh, "The psychology of animal learning," Academic Press London, 1974.
7. I. Pavlov, "Conditioned reflexes," Oxford University Press, Oxford, 1927.
8. I. Gormezano, "Classical conditioning," Experimental methods and instrumentation in psychology, Mc Graw Hill, New York, 1966.
9. N. Schneiderman, I. Fuentes, and I. Gormezano, "Acquisition and extinction of the classically conditioned eyelid response in the albino rabbit." Science, vol. 136, pp. 650-652, 1962.
10. J. F. Medina, J. C. Repa, M. D. Mauk, and J. E. LeDoux, "Parallels between cerebellum- and amygdala-dependent conditioning." Nat Rev Neurosci, vol. 3, no. 2, pp. 122-131, 2002.
11. J. E. LeDoux, The emotional brain. New York: Simon and Schuster Paperbacks, 1996.
12. J. L. Armony, G. J. Quirk, and J. E. LeDoux, "Differential effects of amygdala lesions on early and late plastic components of auditory cortex spike trains during fear conditioning." J Neurosci, vol. 18, no. 7, pp. 2592-601, April 1998.
13. R. G. Phillips and J. E. LeDoux, "Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning," Behavioral Neuroscience, vol. 106, no. 2, pp. 274-285, 1992.
14. J. LeDoux, "Emotion circuits in the brain," Annual review of neuroscience, vol. 23, p. 155184, 2000.
15. R. F. Thompson, "In search of memory traces." Annu Rev Psychol, vol. 56, pp. 1-23, 2005.
16. M. S. Fanselow and A. M. Poulos, "The neuroscience of mammalian associative learning." Annu Rev Psychol, vol. 56, pp. 207-234, 2005.
17. S. P. Perrett, B. P. Ruiz, and M. D. Mauk, "Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses." J Neurosci, vol. 13, no. 4, pp. 1708-18, April 1993.
18. R. Lennartz and N. M. Weinberger, "Analysis of response systems in pavlovian conditioning reveal rapidly versus slowly acquired conditioned responses: Support for two-factors and implications for neurobiology," Psychobiology, vol. 20, pp. 93-119, 1992.
19. N. Weinberger, The neural basis of behavior: Effects of conditioned arousal on the auditory system (Chapter 4), A. L. Beckman, Ed. New York: Spectrum Publications.
20. O. H. Mowrer, Learning theory and personality dynamics. Ronald Press Co, 1950.
21. N. Miller, "Studies of fear as acquirable drive," J Exp Psychol, vol. 38, pp. 89-101, 1948.
22. D. A. Powell and D. Levine-Bryce, "A comparison of two model systems of associative learning: heart rate and eyeblink conditioning in the rabbit." Psychophysiology, vol. 25, no. 6, pp. 672-682, 1988.
23. R. A. Rescorla and R. L. Solomon, "Two process learning theory: Realtionships between pavlovian conditioning and instrumental learning," Psychological Review, vol. 74, pp. 151-182, 1967.
24. R. Rescorla, A. Wagner, A. Black, and W. Prokasy, "Classical conditioning II: Current research and theory," A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Appleton-Century-Crofts, 1972.
25. J. B. Overmier and J. A. Lawry, "Pavlovian conditioning and the mdeigation of behavior," The Psychology of Learning and Motivation: Advances in Research and Theory, p. 1, 1978.
26. I. Gormezano, W. Prokasy, and R. Thompson, Classical conditioning. Lawrence Erlbaum, 1987.
27. J. Bakin and N. Weinberger, "Classical conditioning induces CS-specific receptive field plasticity in the auditory cortex of the guinea pig," Brain Research, vol. 536, no. 1-2, pp. 271-286, 1990.
28. P. F. M. J. Verschure, T. Voegtlin, and R. J. Douglas, "Environmentally mediated synergy between perception and behavior in mobile robots," Nature, vol. 425, pp. 620-624, 2003.
29. A. Duff and P. F. M. J. Verschure, "Unifying perceptual and behavioral learning with a correlative subspace learning rule,"" Neurocomputing (In Press).
30. R. Winters, P. McCabe, and N. Schneiderman, "Functional utility and neurobiology of conditioned autonomic responses," A neuroscientist's guide to classical conditioning, 2001.
31. R. Galambos, G. Sheatz, and V. G. Vernier, "Electrophysiological correlates of a conditioned response in cats." Science, vol. 123, no. 3192, pp. 376-377, 1956.
32. N. M. Weinberger, "Specific long-term memory traces in primary auditory cortex." Nat Rev Neurosci, vol. 5, no. 4, pp. 279-290, 2004.
33. D. V. Buonomano and M. M. Merzenich, "Cortical plasticity: from synapses to maps." Annual Rev of Neurosci, vol. 21, pp. 149-86, January 1998.
34. J. S. Bakin, D. A. South, and N. M. Weinberger, "Induction of receptive field plasticity in the auditory cortex of the guinea pig during instrumental avoidance conditioning." Behav Neurosci, vol. 110, no. 5, pp. 905-913, 1996.
35. J. S. Bakin and N. M. Weinberger, "Classical conditioning induces cs-specific receptive field plasticity in the auditory cortex of the guinea pig." Brain Res, vol. 536, no. 1-2, pp. 271-286, 1990.
36. M. A. Kisley and G. L. Gerstein, "Daily variation and appetitive conditioning-induced plasticity of auditory cortex receptive fields." Eur J Neurosci, vol. 13, no. 10, pp. 1993-2003, 2001.
37. J. M. Edeline, P. Pham, and N. M. Weinberger, "Rapid development of learning-induced receptive field plasticity in the auditory cortex." Behav Neurosci, vol. 107, no. 4, pp. 539-551, 1993.
38. J. J. Paton, M. A. Belova, S. E. Morrison, and C. D. Salzman, "The primate amygdala represents the positive and negative value of visual stimuli during learning." Nature, vol. 439, pp. 865-70, 2006.
39. T. Tazumi and H. Okaichi, "Effect of lesions in the lateral nucleus of the amygdala on fear conditioning using auditory and visual conditioned stimuli in rats." Neurosci Res, vol. 43, no. 2, pp. 163-170, 2002.
40. J. P. Aggleton, The Amygdala. New York: John Wiley and Sons, Inc., 1992.
41. J. E. LeDoux, "Emotion: clues from the brain." Annual review of psychology, vol. 46, pp. 209-35, January 1995.
42. P. Gold, "Acetylcholine modulation of neural systems involved in learning and memory," Neurobiology of Learning and Memory, vol. 80, pp. 194-210, 2003.
43. G. Wenk, "The nucleus basalis magnocellularis cholinergic system: one hundred years of progress," Neurobiology of Learning and Memory, vol. 67, p. 8595, 1997.
44. E. Hazeltine, L. Helmuth, and R. Ivry, "Neural mechanisms of timing," Trends in Cognitive Science, vol. 1(5), pp. 163-169, 1997.
45. E. Finel, C. Ionital, and L. Lohr, "The history of the development of the cerbellar examination," Semin Neurol, vol. 22(4), pp. 375-384, 2002.
46. I. Daum, M. M. Schugens, H. Ackermann, W. Lutzenberger, J. Dichgans, and N. Birbaumer, "Classical conditioning after cerebellar lesions in humans." Behavioral Neuroscience, vol. 107, no. 5, pp. 748-756, 1993.
47. S. J. Lincoln, A. D. McCormick, and F. R. Thompson, "Ipsilateral cerebellar lesions prevent learning of the classically condtioned nictitating membrane/eyelid response," Brain Research, vol. 242, pp. 190-193, 1982.
48. D. J. Krupa and R. F. Thompson, "Reversible inactivation of the cerebellar interpositus nucleus completely prevents acquisition of the classically conditioned eye-blink response." Learning & Memory, vol. 3, no. 6, pp. 545-556, 1997.
49. J. S. Albus, "A new approach to manipulator control: the cerebellar model articulation controller," Journal of Dynamic Systems, Measurement, and Control, vol. 97, pp. 220-227, 1975.
50. J. Albus, "A theory of cerebellar function," Math. Biosc., vol. 10, pp. 25-61, 1971.
51. D. Marr, "A theory of cerebellar cortex." J Physiol, vol. 202, no. 2, pp. 437-470, 1969.
52. M. Floeter and W. Greenough, "Cerebellar plasticity: modification of Purkinje cell structure by differential rearing in monkeys," Science, vol. 206, no. 4415, pp. 227-229, 1979.
53. M. Ito, "Long-term depression," Ann Rev of Neurosci, vol. 12, no. 1, pp. 85-102, 1989.
54. M.Ito, "Historical review of the signification of the cerebellum and the role of the purkinje cells in motor learning." Ann N Y Acad Sci, vol. 978, pp. 273-288, 2002.
55. C. H. James, T. J. Buckingham, and G. A. Barto, "Models of the cerebellum and motor learning," Behavioral and Brain Sciences, vol. 19, no. 1996, pp. 368-383, 2004.
56. C. D. Aizenman, P. B. Manis, and D. J. Linden, "Polarity of long-term synaptic gain change is related to postsynaptic spike firing at a cerebellar inhibitory synapse." Neuron, vol. 21, no. 4, pp. 827-835, 1998.
57. J. E. Steinmetz, L. L. Sears, M. Gabriel, Y. Kubota, and A. Poremba, "Cerebellar interpositus nucleus lesions disrupt classical nictitating membrane conditioning but not discriminative avoidance learning in rabbits," Behavioural Brain Research, vol. 45, no. 1, pp. 71-80, 1991.
58. R. F. Thompson, "The Neurobiology of learning and memory," Science, vol. 233, pp. 941-947, 1986.
59. L. M. Aitkin and J. Boyd, "Acoustic input to the lateral pontine nuclei," Hear Res, vol. 1(1), 1978.
60. J. E. Steinmetz, C. G. Logan, D. J. Rosen, J. K. Thompson, D. G. Lavond, and R. F. Thompson, "Initial localization of the acoustic conditioned stimulus projection system to the cerebellum essential for classical eyelid conditioning." Proceedings of the National Academy of Sciences of the United States of America, vol. 84, no. 10, pp. 3531-5, May 1987.
61. J. L. Lewis, J. J. LoTurco, and P. R. Solomon, "Lesions of the middle cerebellar peduncle disrupt acquisition and retention of the rabbits classically conditioned nictitating membrane response," Behav. Neurosci., vol. 101, 1987.
62. J. E. Steinmetz, D. J. Rosen, P. F. Chapman, D. G. Lavond, and R. Thompson, "Classical conditioning of the rabbit eyelid response with a mossy fiber stimulation cs: 1. pontine nuclei and middle cerebellar peduncle stimulation," Behav. Neurosci., vol. 100, 1986.
63. J. E. Steinmetz, "Neuronal activity in the cerebellar interpositus nucleus during classical nm conditioning with a pontine stimulation cs," Psychol. Sci., vol. 1, 1990.
64. K. Dedovic, A. Duchesne, J. Andrews, V. Engert, and J. C. Pruessner, "The brain and the stress axis: The neural correlates of cortisol regulation in response to stress." NeuroImage, vol. 47, pp. 864-871, 2009.
65. T. Lee and J. J. Kim, "Differential effects of cerebellar, amygdalar, and hippocampal lesions on classical eyeblink conditioning in rats." J Neurosci, vol. 24, no. 13, pp. 3242-3250, 2004.
66. N. M. Weinberger, "Learning-induced changes of auditory receptive fields." Curr Opin Neurobiol, vol. 3, no. 4, pp. 570-577, 1993.
67. G. H. Recanzone, C. E. Schreiner, and M. M. Merzenich, "Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys." J Neurosci, vol. 13, no. 1, pp. 87-103, 1993.
68. N. M. Weinberger, "Physiological memory in primary auditory cortex: characteristics and mechanisms." Neurobiol Learn Mem, vol. 70, no. 1-2, pp. 226-251, 1998.
69. W. Levy and O. Steward, "Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus," Neuroscience, vol. 8, no. 4, pp. 791-797, Apr. 1983.
70. H. Markram, J. Lubke, M. Frotscher, and B. Sakmann, "Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs," Science, vol. 275, no. 5297, pp. 213-215, 1997.
71. B. GuoQiang and P. MuMing, "Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type," J. Neurosci., vol. 18, no. 24, pp. 10 464-10 472, 1998.
72. G. J. Stuart and B. Sakmann, "Active propagation of somatic action potentials into neocortical pyramidal cell dendrites," Nature, vol. 367, no. 6458, pp. 69-72, 1994.
73. N. Kuczewski, C. Porcher, V. Lessmann, I. Medina, and J. Gaiarsa, "Back-propagating action potential: A key contributor in activity-dependent dendritic release of BDNF," Communicative & Integrative Biology, vol. 1, no. 2, pp. 153-155, Oct. 2008.
74. G. Lowe, "Inhibition of backpropagating action potentials in mitral cell secondary dendrites," J Neurophysiol, vol. 88, no. 1, pp. 64-85, Jul. 2002.
75. S. S. Wang, W. Denk, and M. Hausser, "Coincidence detection in single dendritic spines mediated by calcium release." Nat Neurosci, vol. 3, no. 12, pp. 1266-1273, 2000.
76. C. Hull, "The problem of stimulus equivalence in behavior theory," Psycholog. Rev., vol. 46, pp. 9-30, 1939.
77. M. Coesmans, J. T. Weber, C. I. De Zeeuw, and C. Hansel, "Bidirectional parallel fiber plasticity in the cerebellum under climbing fiber control." Neuron, vol. 44, no. 4, pp. 691-700, 2004.