The nature of reinforcement in cerebellar learning

Neurobiology of Learning and Memory

Volumn 70, Issue 1-2, 1998, Pages 150-176

  Thompson, Richard F ^a   Thompson, Judith K ^a   Kim, Jeansok J ^a,b   Krupa, David J ^a,c   Shinkman, Paul G ^a,d  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b YALE UNIVERSITY   (United States)

^c DUKE UNIVERSITY MEDICAL CENTER   (United States)

^d UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

4 AMINOBUTYRIC ACID RECEPTOR BLOCKING AGENT; AMPA RECEPTOR; CURARE; DOPAMINE; LIDOCAINE; METABOTROPIC RECEPTOR; MUSCIMOL; PICROTOXIN; TETRODOTOXIN;

ANIMAL EXPERIMENT; CEREBELLUM; CLIMBING FIBER; CONDITIONED REFLEX; CONDITIONING; CONFERENCE PAPER; CONTROLLED STUDY; DENTATE NUCLEUS; DOPAMINERGIC SYSTEM; ESCAPE BEHAVIOR; EYE HAND COORDINATION; INFERIOR OLIVE; INTERPOSITUS NUCLEUS; LEARNING; MEMORY CONSOLIDATION; MOTOR COORDINATION; MOUSE; NERVE PROJECTION; NONHUMAN; PURKINJE FIBER MEMBRANE POTENTIAL; RABBIT; REINFORCEMENT; STATE DEPENDENT LEARNING;

EID: 0032122318     PISSN: 10747427     EISSN: None     Source Type: Journal    
DOI: 10.1006/nlme.1998.3845     Document Type: Conference Paper

References (100)

1. Albus, J. S. (1971). A theory of cerebellar function, Mathematical Bioscience, 10, 25-61.
2. Andersson, G., Garwicz, M., & Hesslow, G. (1988). Evidence for a GABA-mediated cerebellar inhibition of the inferior olive in the cat. Experimental Brain Research, 72, 450-456.
3. Angaut, P., & Sotelo, C. (1989). Synaptology of the cerebello-olivary pathway. Double labelling with anterograde axonal tracing and GABA immunocytochemistry in the rat. Brain Research, 479, 361-365.
4. Benedeti, F., Montarolo, P. G., & Rabacchi, S. (1984). Inferior olive lesion induces long-lasting functional modification in the Purkinje cells. Experimental Brain Research, 55, 368-371.
5. Berry, S. D., & Swain, R. A. (1989). Water deprivation optimizes hippocampal activity and facilitates nictitating membrane conditioning. Behavioral Neuroscience, 103, 71-76.
6. Brandon, S. E., & Wagner, A. R. (1991). Modulation of a discrete Pavlovian conditioned reflex by a putative emotive conditioned stimulus. Journal of Experimental Psychology : Animal Behavior Processes, 17, 299-311.
7. Brindley, C. S. (1964). The use made by the cerebellum of the information that it receives from sense organs. IBRO Bulletin, 3, 80.
8. Brogden, W. J., & Gantt, W. H. (1937). Cerebellar conditioned reflexes. American Journal of Physiology, 119, 277-278.
9. Brogden, W. J., & Gantt, W. H. (1942). Intraneural conditioning: Cerebellar conditioned reflexes. Archives of Neurology and Psychiatry, 48, 437-455.
10. Brown, J. S. (1961). The motivation of behavior. New York: McGraw-Hill.
11. Bruner, A. (1963). Investigations of the properties of the unconditioned stimulus in classical conditioning of the nictitating membrane response in the albino rabbit. Doctoral dissertation, Indiana University.
12. Chapman, P. F., Steinmetz, J. E., & Thompson, R. F. (1988). Classical conditioning does not occur when direct stimulation of the red nucleus or cerebellar nuclei is the unconditioned stimulus. Brain Research, 442, 97-104.
13. Chen, C., Masanobu, K., Abeliovich, A., Chen, L., Bao, S., Kim, J. J., Hashimoto, K., Thompson, R. F., & Tonegawa, S. (1995). Impaired motor coordination correlates with persistent multiple climbing fiber innervation in PKCγ mutant mice. Cell 83, 1233-1242.
14. Chen, C., & Thompson, R. F. (1995). Temporal specificity of long-term depression in parallel fiber -Purkinje synapses in rat cerebellar slice. Learning and Memory, 2, 185-198.
15. Chen, L., Bao, S., Lockard, J. M., Kim, J. J., & Thompson, R. F. (1996). Impaired classical eyeblink conditioning in cerebellar lesioned and Purkinje cell degeneration (pcd) mutant mice. Journal of Neuroscience, 16, 2829-2838.
16. R. E., & Lavond, D. G. (1993). Reversible lesions of the red nucleus during acquisition and retention of a classically conditioned behavior in rabbit. Behavioral Neuroscience, 107, 264-270.
17. Clark, R. E., Zhang, A. A., & Lavond, D. G. (1992). Reversible lesions of the cerebellar interpositus nucleus during acquisition and retention of a classically conditioned behavior. Behavioral Neuroscience, 106, 879-888.
18. Crepel, F. (1982). Regression of functional synapses in the immature mammalian cerebellum. Trends in Neurosciences, 5, 266-269.
19. Donegan, N. H., Gluck, M. A., & Thompson, R. F. (1989). Integrating behavioral and biological models of classical conditioning. In R. D. Hawkins & G. H. Bower (Eds.), Psychology of learning and motivation (Vol. 23, pp. 109-156). New York: Academic Press.
20. Doty, R. W., & Giurgea, C. (1961). Conditioned reflexes established by coupling electrical excitation of two cortical areas. In J. F. Delafresnaye (Ed.), Brain mechanisms and learning (pp. 133-151). Oxford: Blackwell.
21. Eccles, J. C. (1977). An instruction-selection theory of learning in the cerebellar cortex. Brain Research, 127, 327-352.
22. Eccles, J. C., Ito, M., & Szentagothai, J. (1967). The cerebellum as a neuronal machine. Berlin: Springer-Verlag.
23. Estes, W. K. (1959). The statistical approach to learning theory. In S. Koch (Ed.), Psychology: A study of a science (Vol. 2, pp. 380-491). New York: McGraw-Hill.
24. Gantt, W. H. (1937). Contributions to the physiology of the conditioned reflex. Archives of Neurology and Psychiatry, 37, 848-858.
25. M. A., Reifsnider, E. S., & Thompson, R. F. (1990). Adaptive signal processing and the cerebellum: Models of classical conditioning and VOR adaptation. In M. A. Gluck & D. E. Rumelhart (Eds.), Neuroscience and connectionist models (pp. 131-185). Hillsdale, NJ: Erlbaum.
26. Gluck, M. A., & Thompson, R. F. (1987). Modeling the neural substrates of associative learning and memory: A computational approach. Psychological Review, 94, 176-191.
27. Gormezano, I., Kehoe, E. J., & Marshall-Goodell, B. S. (1983). Twenty years of classical conditioning research with the rabbit. In J. M. Sprague & A. N. Epstein (Eds.), Progress in physiological psychology (pp. 197-275). New York: Academic Press.
28. Graybiel, A. M., Aosaki, T., Flaherty, A. W., & Kimura, M. (1994). The basal ganglia and adaptive motor control. Science, 265, 1826-1831.
29. Guthrie, E. R. (1930). Conditioning as a principle of learning. Psychological Review, 40, 355-367.
30. Hardiman, M. J., Ramnani, N., & Yeo, C. H. (1996). Reversible inactivations of the cerebellum with muscimol prevent the acquisition and extinction of conditioned nicitating membrane responses in the rabbit. Experimental Brain Research, 110, 235-247.
31. Harlow, H. F., & Stagner, R. (1933). Effect of complete striate muscle paralysis upon the learning process. Journal of Experimental Psychology, 16, 283-294.
32. Hesslow, G., & Ivarsson, M. (1996). Inhibition of the inferior olive during conditioned responses in the decerebrate ferret. Experimental Brain Research, 110, 36-46.
33. Ito, M. (1972). Neural design of the cerebellar motor control system. Brain Research, 40, 81-84.
34. Ito, M. (1984). The cerebellum and neural control. New York: Appleton-Century-Crofts.
35. Ito, M. (1994). Cerebellar mechanisms of long-term depression. In M. Baudry, Davis, & R. F. Thompson (Eds.), Synaptic plasticity: Molecular and functional aspects. Cambridge, MA: MIT Press.
36. Ito, M., Sukurai, M., & Tongroach, P. (1982). Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells. Journal of Physiology, London, 324, 113-134.
37. Ivkovich, D., & Thompson, R. F. (in press). Motor cortex lesions do not effect learning or performance of the eyeblink response in rabbits. Behavioral Neuroscience.
38. Kamin, L. J. (1968). Attention-like processes in classical conditioning. In M. R. Jones (Ed.), Miami symposium on the prediction of behavior: Aversive stimulation (pp. 9-32). Miami: Univ. of Miami Press.
39. Kamin, L. J. (1969). Predictability, surprise, attention and conditioning. In R. M. Church (Ed.), Punishment and aversive behavior (pp. 279-296). New York: Appleton-Century-Crofts.
40. Kano, M., Hashimoto, K., Chen, C., Abeliovich, A., Aiba, A., Kurihara, H., Watanabe, M., Inoue, Y., & Tonegawa, S. (1995). Impaired synapse elimination during cerebellar development in PKC, mutant mice. Cell 83, 1223-1231.
41. Keele, S. W., & Ivry, R. B. (1990). Does the cerebellum provide a common computation for diverse tasks: A timing hypothesis. In A. Diamond (Ed.), The development and neural bases of higher cognitive functions (pp. 179-211). New York: New York Academy of Sciences Press.
42. Kim, J. J., Krupa, D. J., & Thompson, R. F. (1992). Intra-olivary infusions of picrotoxin prevent "blocking" of rabbit conditioned eyeblink response. Society for Neuroscience Abstracts, 18, 1562.
43. Kim, J. J., Krupa, D. J., & Thompson, R. F. (in press). Inhibitory cerebello-olivary projections mediate the "blocking" effect in classical conditioning. Science.
44. Kim, J. J., & Thompson, R. F. (1997). Cerebellar circuits and synaptic mechanisms involved in classical eyeblink conditioning. Trends in Neurosciences, 20, 177-181.
45. Krupa, D. J. (1993). Localization of the essential memory trace for a classically conditioned behavior. Doctoral dissertation, University of Southern California.
46. Krupa, D. J., Thompson, J. K., & Thompson, R. F. (1993). Localization of a memory trace in the mammalian brain. Science, 260, 989-991.
47. Krupa, D. J., & Thompson, R. F. (1995). Inactivation of the superior cerebellar peduncle blocks expression but not acquisition of the rabbit's classically conditioned eyeblink response. Proceedings of the National Academy of Sciences of the USA, 92, 5097-5101.
48. Krupa, D. J., & Thompson, R. F. (1997). Reversible inactivation of the cerebellar interpositus nucleus completely prevents acquisition of the classically conditioned eyeblink response. Learning and Memory, 3, 545-556.
49. Krupa, D. J., Weng, J., & Thompson, R. F. (1996). Inactivation of brainstem motor nuclei blocks expression but not acquisition of the rabbit's classically conditioned eyeblink response. Behavioral Neuroscience, 110, 1-9.
50. Lavond, D. G., Kim, J. J., & Thompson, R. F. (1993). Mammalian brain substrates of aversive classical conditioning. Annual Review of Psychology, 44, 317-342.
51. Light, J. S., & Gantt, W. H. (1936). Essential part of reflex arc for establishment of conditioned reflex. Journal of Comparative Psychology, 21, 19-36.
52. Linden, D. J., & Conner, J. A. (1995). Long-term synaptic depression. Annual Review of Neuroscience, 18, 319-357.
53. Loucks, R. B. (1935). The experimental delimitation of neural structures essential for learning: The attempt to condition striped muscle response with faradization of the sigmoid gyri. Journal of Psychology, 1, 5-44.
54. Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276-298.
55. Maren, S., DeCola, J. P., Swain, R. A., Fanselow, M. S., & Thompson, R. F. (1994). Parallel augmentation of hippocampal long-term potentiation, theta rhythm, and contextual fear conditioning water-deprived rats. Behavioral Neuroscience, 108, 44-56.
56. Marr, D. (1969). A theory of cerebellar cortex. Journal of Physiology, 202, 437-470.
57. Mauk, M. D., Steinmetz, J. E., & Thompson, R. F. (1986). Classical conditioning using stimulation of the inferior olive as the unconditioned stimulus. Proceedings of the National Academy of Sciences of the USA, 83, 5349-5353.
58. McCormick, D. A., Clark, G. A., Lavond, D. G., & Thompson, R. F. (1982). Initial localization of the memory trace for a basic form of learning. Proceedings of the National Academy of Sciences of the USA, 79, 2731-2742.
59. McCormick, D. A., Steinmetz, J. E., & Thompson, R. F. (1985). Lesions of the inferior olivary complex cause extinction of the classically conditioned eyeblink response. Brain Research, 359, 120-130.
60. McCormick, D. A., & Thompson, R. F. (1984). Neuronal responses of the rabbit cerebellum during acquisition and performance of a classically conditioned nictitating membrane-eyelid response. Journal of Neuroscience, 4, 2811-2822.
61. McLaren, I. P., & Dickinson, A. (1990). The conditioning connection. Philosophical Transactions of the Royal Society of London, B329, 179-186.
62. Mintz, M., Lavond, D. G., Zhang, A. A., Yun, Y., & Thompson, R. F. (1994). Unilateral inferior olive NMDA lesion leads to unilateral deficit in acquisition of NMR classical conditioning. Behavioral and Neural Biology, 61, 218-224.
63. Nelson, B., & Mugnoini, E. (1987). GABAergic innervation of the inferior olivary complex and experimental evidence for its origin. In P. Strata (Ed.). The olivocerebellar system in motor control. New York: Springer-Verlag.
64. Nordholm, A. F., Thompson, J. K., Dersarkissian, C., & Thompson, R. F. (1993). Lidocaine infusion in a critical region of cerebellum completely prevents learning of the conditioned eyeblink response. Behavioral Neuroscience, 107, 882-886.
65. Nowak, A. J., & Gormezano, I. (1990). Electrical stimulation of brainstem nuclei: Elicitation, modification and conditioning of the rabbit nictitating membrane response. Behavioral Neuroscience, 104, 4-10.
66. Pavlov, I. P. (1927). Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. London: Oxford Univ. Press. [G. V. Anrep, translator]
67. Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532-552.
68. Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71-80.
69. Rescorla, R. A. (1968). Probability of shock in the prescence and abscence of CS in fear conditioning. Journal of Comparative and Physiological Psychology, 66, 1-5.
70. Rescorla, R. A. (1988). Behavioral studies of Pavlovian conditioning. Annual Review of Neuroscience, 11, 329-352.
71. Rescorla, R. A., & Solomon, R. L. (1967). Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychological Review, 74, 151-182.
72. Rescorla, R., & Wagner, A. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research theory (pp. 64-99). New York: Appleton-Century-Crofts.
73. Rogers, R. F., Fender, A. S., & Steinmetz, J. E. (1997). Interpositus nucleus contributions to nonsomatosensory-based eyelid conditioning. American Psychological Society Abstracts, 31.
74. Rumelhart, D. E., & McClelland, J. L. (1986). Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge, MA: MIT Press.
75. Schlosberg, H. (1937). The relationship between success and the laws of conditioning. Psychological Review, 1937, 379-394.
76. Schreurs, B. G., Oh, M. M., & Alkon, D. L. (1996). Pairing-specific long-term depression of Purkinje cell excitatory postsynaptic potentials results from a classical conditioning procedure in the rabbit cerebellar slice. Journal of Neurophysiology, 75, 1051-1060.
77. Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Current Opinion in Neurobiology, 7, 191-197.
78. Schultz, W., Apicella, P., & Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience, 13, 900-913.
79. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
80. Sears, L. L., & Steinmetz, J. E. (1991). Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response. Brain Research, 545, 114-122.
81. Shinkman, P. G., Swain, R. A., & Thompson, R. F. (1996). Classical conditioning with electrical stimulation of cerebellum as both conditioned and unconditioned stimulus. Behavioral Neuroscience, 110, 914-921.
82. Steinmetz, J. E., Lavond, D. G., Ivkovich, D., Logan, C. G., & Thompson, R. F. (1992). Disruption of classical eyelid conditioning after cerebellar lesions: Damage to a memory trace system or a simple performance deficit? Journal of Neuroscience, 12, 4403-4426.
83. Steinmetz, J. E., Lavond, D. G., & Thompson, R. F. (1989). Classical conditioning in rabbits using pontine nucleus stimulation as a conditioned stimulus and inferior olive stimulation as an unconditioned stimulus. Synapse, 3, 225-232.
84. Steinmetz, J. E., McCormick, D. A., Baier, C. A., & Thompson, R. F. (1984). Involvement of the inferior olive in classical conditioning of the rabbit eyelid. Neuroscience Abstracts, 10, 122.
85. Swain, R. A., Shinkman, P. G., Nordholm, A. F., & Thompson, R. F. (1992). Cerebellar stimulation as an unconditioned stimulus in classical conditioning. Behavioral Neuroscience, 106, 739-750.
86. Tanaka, C., & Nishizuka, Y. (1994). The protein kinase C family for neuronal signaling. Annual Review of Neuroscience, 17, 551-567.
87. Thach, W. T., Goodkin, H. G., & Keating, J. G. (1992). The cerebellum and the adaptive coordination of movement. Annual Review of Neuroscience, 15, 403-442.
88. Thompson, R. F. (1989a). Role of inferior olive in classical conditioning. In P. Strata (Ed.), The olivocerebellar system in motor control. New York: Springer-Verlag.
89. Thompson, R. F. (1989b). The essential memory trace circuit and the essential reinforcement system for a basic form of associative learning. In T. Archer & L-G. Nilsson (Eds.), Aversion, avoidance and anxiety: Perspectives on aversively motivated behavior (pp. 251-264). Hillsdale, NJ: Erlbaum.
90. Thompson, R. F., & Kim, J. J. (1996). Memory systems in the brain and localization of a memory. Proceedings of the National Academy of Sciences of the USA, 93, 13438-13444.
91. Thompson, R. F., & Krupa, D. J. (1994). Organization of memory traces in the mammalian brain. Annual Review of Neuroscience, 17, 519-549.
92. Thorndike, E. L. (1911). Animal intelligence: Experimental studies. New York: Macmillian.
93. Voneida, T., Christie, D., Boganski, R., & Chopko, B. (1990). Changes in instrumentally and classically conditioned limb-flexion responses following inferior olivary lesions and olivocerebellar tractotomy in the cat. Journal of Neuroscience, 10, 3583-3593.
94. Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 5-47). Hillsdale, NJ: Erlbaum.
95. Wagner, A. R., & Brandon, S. E. (1989). Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 149-190). Hillsdale, NJ: Erlbaum.
96. Wagner, A. R., & Donegan, N. (1989). Some relationships between a computational model (SOP) and an essential neural circuit for Pavlovian (rabbit eyeblink) conditioning. In R. D. Hawkins & G. H. Bower (Eds.), Computational models of learning in simple neural systems: The psychology of learning and motivation (Vol. 23, pp. 157-203). New York: Academic Press.
97. Wagner, A. R., & Rescorla, R. A. (1972). Inhibition in Pavlovian conditioning: Application of a theory. In R. A. Boakes & M. S. Halliday (Eds.), Inhibition and learning (pp. 301-336). London: Academic Press.
98. Wagner, A. R., Thomas, E., & Norton, T. (1967). Conditioning with electrical stimulation of motor cortex: Evidence of a possible source of motivation. Journal of Comparative Physiological Psychology, 64, 191-199.
99. Widrow, G., & Hoff, M. E. (1960). Adaptive switching circuits. Institute of Radio Engineers, Western Electric Show and Convention, Convention Record, 4, 96-194.
100. Yeo, C. H., Hardiman, M. J., & Glickstein, M. (1986). Classical conditioning of the nictitating membrane response of the rabbit IV. Lesions of the inferior olive. Experimental Brain Research, 63, 81-92.