Extinction reveals that primary sensory cortex predicts reinforcement outcome

European Journal of Neuroscience

Volumn 35, Issue 3-4, 2012, Pages 598-613

  Bieszczad, Kasia M ^a   Weinberger, Norman M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Auditory cortex; Instrumental conditioning; Learning induced plasticity; Memory strength; Rat

Indexed keywords

ACOUSTIC NERVE FIBER; ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; AUDITORY STIMULATION; BEHAVIOR; BRAIN FUNCTION; CONTROLLED STUDY; MALE; NERVE CELL STIMULATION; NONHUMAN; PREDICTION; PRIMARY SENSORY CORTEX; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; RAT; REINFORCEMENT; SENSORY CORTEX; SOUND TRANSMISSION; ANIMAL BEHAVIOR; BRAIN REGION; PRIMARY AUDITORY CORTEX; PUNISHMENT; REWARD; STIMULUS RESPONSE;

ACOUSTIC STIMULATION; ACTION POTENTIALS; ANIMALS; BRAIN MAPPING; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; MALE; NEURONS; PREDICTIVE VALUE OF TESTS; PSYCHOACOUSTICS; RATS; RATS, SPRAGUE-DAWLEY; REINFORCEMENT (PSYCHOLOGY); SOMATOSENSORY CORTEX; TIME FACTORS;

EID: 84857038910     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2011.07974.x     Document Type: Article

References (110)

1. Bakin, J.S. & Weinberger, N.M. (1990) Classical conditioning induces CS-specific receptive field plasticity in the auditory cortex of the guinea pig. Brain Res., 536, 271-286.
2. Bakin, J.S. & Weinberger, N.M. (1996) Induction of a physiological memory in the cerebral cortex by stimulation of the nucleus basalis. Proc. Natl. Acad. Sci. USA, 93, 11219-11224.
3. Bakin, J.S., Kwon, M.C., Masino, S.A. & Weinberger, N.M. (1996) Suprathreshold auditory cortex activation visualized by intrinsic signal optical imaging. Cereb. Cortex, 6, 120-130.
4. Berlau, K.M. & Weinberger, N.M. (2008) Learning strategy determines auditory cortical plasticity. Neurobiol. Learn. Mem., 89, 153-166.
5. Bieszczad, K.M. & Weinberger, N.M. (2010a) Learning strategy trumps motivational level in determining learning-induced auditory cortical plasticity. Neurobiol. Learn. Mem., 93, 229-239.
6. Bieszczad, K.M. & Weinberger, N.M. (2010b) Remodeling the cortex in memory: increased use of a learning strategy increases the representational area of relevant acoustic cues. Neurobiol. Learn. Mem., 94, 127-144.
7. Bieszczad, K.M. & Weinberger, N.M. (2010c) Representational gain in cortical area underlies increase of memory strength. Proc. Natl. Acad. Sci. USA, 107, 3793-3798.
8. Blake, D.T., Strata, F., Churchland, A.K. & Merzenich, M.M. (2002) Neural correlates of instrumental learning in primary auditory cortex. Proc. Natl. Acad. Sci. USA, 99, 10114-10119.
9. Brandon, S.E., Vogel, E.H. & Wagner, A.R. (2003) Stimulus representation in SOP: I. Theoretical rationalization and some implications. Behav. Processes, 62, 5-25.
10. Brosch, M., Selezneva, E. & Scheich, H. (2011) Representation of reward feedback in primate auditory cortex. Front. Syst. Neurosci., 5, 5.
11. Brown, M., Irvine, D.R. & Park, V.N. (2004) Perceptual learning on an auditory frequency discrimination task by cats: association with changes in primary auditory cortex. Cereb. Cortex, 14, 952-965.
12. Carpenter-Hyland, E., Plummer, T., Vazdarjanova, A. & Blake, D. (2010) Arc expression and neuroplasticity in primary auditory cortex during initial learning are inversely related to neural activity. Proc. Natl. Acad. Sci. USA, 107, 14828-14832.
13. Condon, C.D. & Weinberger, N.M. (1991) Habituation produces frequency-specific plasticity of receptive fields in the auditory cortex. Behav. Neurosci., 105, 416-430.
14. Diamond, D.M. & Weinberger, N.M. (1986) Classical conditioning rapidly induces specific changes in frequency receptive fields of single neurons in secondary and ventral ectosylvian auditory cortical fields. Brain Res., 372, 357-360.
15. Dimyan, M.A. & Weinberger, N.M. (1999) Basal forebrain stimulation induces discriminative receptive field plasticity in the auditory cortex. Behav. Neurosci., 113, 691-702.
16. Disterhoft, J.F. & Stuart, D.K. (1976) Trial sequence of changed unit activity in auditory system of alert rat during conditioned response acquisition and extinction. J. Neurophysiol., 39, 266-281.
17. Downman, C.B., Woolsey, C.N. & Lende, R.A. (1960) Auditory areas I, II, and Ep: cochlear representation, afferent paths and interconnections. Bull. Johns Hopkins Hosp., 106, 127-142.
18. Edeline, J.-M., Pham, P. & Weinberger, N.M. (1993) Rapid development of learning-induced receptive field plasticity in the auditory cortex. Behav. Neurosci., 107, 539-557.
19. Fritz, J., Shamma, S., Elhilali, M. & Klein, D. (2003) Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat. Neurosci., 6, 1216-1223.
20. Fritz, J.B., Elhilali, M. & Shamma, S.A. (2005) Differential dynamic plasticity of A1 receptive fields during multiple spectral tasks. J. Neurosci., 25, 7623-7635.
21. Fritz, J.B., Elhilali, M. & Shamma, S.A. (2007) Adaptive changes in cortical receptive fields induced by attention to complex sounds. J. Neurophysiol., 98, 2337-2346.
22. Fritz, J.B., David, S.V., Radtke-Schuller, S., Yin, P. & Shamma, S.A. (2010) Adaptive, behaviorally gated, persistent encoding of task-relevant auditory information in ferret frontal cortex. Nat. Neurosci., 13, 1011-1019.
23. Galambos, R., Sheatz, G. & Vernier, V.G. (1956) Electrophysiological correlates of a conditioned response in cats. Science, 123, 376-377.
24. Gao, E. & Suga, N. (1998) Experience-dependent corticofugal adjustment of midbrain frequency map in bat auditory system. Proc. Natl. Acad. Sci. USA, 95, 12663-12670.
25. Gao, E. & Suga, N. (2000) Experience-dependent plasticity in the auditory cortex and the inferior colliculus of bats: role of the corticofugal system. Proc. Natl. Acad. Sci. USA, 97, 8081-8086.
26. Ghose, G.M. & Bearl, D.W. (2010) Attention directed by expectations enhances receptive fields in cortical area MT. Vision Res., 50, 441-451.
27. Gonzalez-Lima, F. & Scheich, H. (1986) Neural substrates for tone-conditioned bradycardia demonstrated with 2-deoxyglucose. II. Auditory cortex plasticity. Behav. Brain Res., 20, 281-293.
28. Gottfried, J.A., O'Doherty, J. & Dolan, R.J. (2003) Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science, 301, 1104-1107.
29. Hackett, T.A., Barkat, T.R., O'Brien, B.M., Hensch, T.K. & Polley, D.B. (2011) Linking topography to tonotopy in the mouse auditory thalamocortical circuit. J. Neurosci., 31, 2983-2995.
30. Harrison, R.V., Kakigi, A., Hirakawa, H., Harel, N. & Mount, R.J. (1996) Tonotopic mapping in auditory cortex of the chinchilla. Hear. Res., 100, 157-163.
31. Heil, P. (1997a) Auditory cortical onset responses revisited: I. First-spike timing. J. Neurophysiol., 77, 2616-2641.
32. Heil, P. (1997b) Auditory cortical onset responses revisited: II. Response strength. J. Neurophysiol., 77, 2642-2660.
33. Heil, P. & Irvine, D.R. (1998) The posterior field P of cat auditory cortex: coding of envelope transients. Cereb. Cortex, 8, 125-141.
34. Hoshino, O. (2007) Enhanced sound perception by widespread-onset neuronal responses in auditory cortex. Neural Comput., 19, 3310-3334.
35. Hui, G.K., Wong, K.L., Chavez, C.M., Leon, M.I., Robin, K.M. & Weinberger, N.M. (2009) Conditioned tone control of brain reward behavior produces highly specific representational gain in the primary auditory cortex. Neurobiol. Learn. Mem., 92, 27-34.
36. Jaramillo, S. & Zador, A.M. (2011) The auditory cortex mediates the perceptual effects of acoustic temporal expectation. Nat. Neurosci., 14, 246-251.
37. Ji, W., Gao, E. & Suga, N. (2001) Effects of acetylcholine and atropine on plasticity of central auditory neurons caused by conditioning in bats. J. Neurophysiol., 86, 211-225.
38. Kilgard, M.P. & Merzenich, M.M. (1998) Cortical map reorganization enabled by nucleus basalis activity. Science, 279, 1714-1718.
39. Kisley, M.A. & Gerstein, G.L. (2001) Daily variation and appetitive conditioning-induced plasticity of auditory cortex receptive fields. Eur. J. Neurosci., 13, 1993-2003.
40. Knight, P.L. (1977) Representation of the cochlea within the anterior auditory field (AAF) of the cat. Brain Res., 130, 447-463.
41. Kogan, A.B. (1960) Manifestations of processes of higher nervous activity in the electrical potentials of the cortex during free behavior of animals. In Jasper, H.H. & Smirnov, G.D. (eds), Moscow Colloquium on Electroencephalography of Higher Nervous Activity (Electroencephalography and Clinical Neurophysiology series, Suppl 13). EEG Journal, Montreal, pp. 51-65.
42. Konorski, J. (1948) Conditioned Reflexes and Neuron Organization. Cambridge University Press, New York.
43. Köver, H. & Bao, S. (2010) Cortical plasticity as a mechanism for storing Bayesian priors in sensory perception. PLoS ONE, 5, e10497.
44. Kringelbach, M.L. (2005) The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci., 6, 691-702.
45. Lauwereyns, J., Takikawa, Y., Kawagoe, R., Kobayashi, S., Koizumi, M., Coe, B., Sakagami, M. & Hikosaka, O. (2002) Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron, 33, 463-473.
46. Linden, J.F., Liu, R.C., Sahani, M., Schreiner, C.E. & Merzenich, M.M. (2003) Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. J. Neurophysiol., 90, 2660-2675.
47. Lubow, R.E. & Moore, A.U. (1959) Latent inhibition: the effect of nonreinforced pre-exposure to the conditional stimulus. J. Comp. Physiol. Psychol., 52, 415-419.
48. Manunta, Y. & Edeline, J.-M. (2004) Noradrenergic induction of selective plasticity in the frequency tuning of auditory cortex neurons. J. Neurophysiol., 92, 1445-1463.
49. Menning, H., Roberts, L.E. & Pantev, C. (2000) Plastic changes in the auditory cortex induced by intensive frequency discrimination training. Neuroreport, 11, 817-822.
50. Merzenich, M.M. & Brugge, J.F. (1973) Representation of the cochlear partition of the superior temporal plane of the macaque monkey. Brain Res., 50, 275-296.
51. Merzenich, M.M., Knight, P.L. & Roth, G.L. (1973) Cochleotopic organization of primary auditory cortex in the cat. Brain Res., 63, 343-346.
52. Merzenich, M.M., Knight, P.L. & Roth, G.L. (1975) Representation of the cochlea within the primary auditory cortex in the cat. J. Neurophysiol., 38, 231-249.
53. Merzenich, M.M., Nelson, R.J., Kaas, J.H., Stryker, M.P., Jenkins, W.M., Zook, J.M., Cynader, M.S. & Schoppmann, A. (1987) Variability in hand surface representations in areas 3b and 1 in adult owl and squirrel monkeys. J. Comp. Neurol., 258, 281-296.
54. Metherate, R. & Weinberger, N.M. (1990) Cholinergic modulation of responses to single tones produces tone-specific receptive field alterations in cat auditory cortex. Synapse, 6, 133-145.
55. Milad, M.R. & Quirk, G.J. (2002) Neurons in medial prefrontal cortex signal memory for fear extinction. Nature, 420, 70-74.
56. Molchan, S.E., Sunderland, T., McIntosh, A.R., Herscovitch, P. & Schreurs, B.G. (1994) A functional anatomical study of associative learning in humans. Proc. Natl. Acad. Sci. USA, 91, 8122-8126.
57. Molina-Luna, K., Hertler, B., Buitrago, M.M. & Luft, A.R. (2008) Motor learning transiently changes cortical somatotopy. Neuroimage, 40, 1748-1754.
58. Morrell, F. (1961) Electrophysiological contributions to the neural basis of learning. Physiol. Rev., 41, 443-494.
59. Morrell, F. & Jasper, H.H. (1956) Electrographic studies of the formation of temporary connections in the brain. Electroencephalogr. Clin. Neurophysiol., 8, 201-215.
60. Morris, J.S., Friston, K.J. & Dolan, R.J. (1998) Experience-dependent modulation of tonotopic neural responses in human auditory cortex. Proc. Biol. Sci., 265, 649-657.
61. Ohl, F.W. & Scheich, H. (1996) Differential frequency conditioning enhances spectral contrast sensitivity of units in auditory cortex (field Al) of the alert Mongolian gerbil. Eur. J. Neurosci., 8, 1001-1017.
62. Ohl, F.W. & Scheich, H. (1997) Learning-induced dynamic receptive field changes in primary auditory cortex of the unanaesthetized Mongolian gerbil. J. Comp. Physiol. A., 181, 685-696.
63. Pascual-Leone, A. & Hamilton, R. (2001) The metamodal organization of the brain. Prog. Brain Res., 134, 427-445.
64. Pavlov, I.P. 1927. Conditioned Reflexes. Dover Publications, New York.
65. Pedreira, M.E., Pérez-Cuesta, L.M. & Maldonado, H. (2004) Mismatch between what is expected and what actually occurs triggers memory reconsolidation or extinction. Learn. Mem., 11, 579-585.
66. Pennartz, C.M., Berke, J.D., Graybiel, A.M., Ito, R., Lansink, C.S., van der Meer, M., Redish, A.D., Smith, K.S. & Voorn, P. (2009) Corticostriatal interactions during learning, memory processing, and decision making. J. Neurosci., 29, 12831-12838.
67. Phillips, D.P., Hall, S.E. & Boehnke, S.E. (2002) Central auditory onset responses, and temporal asymmetries in auditory perception. Hear. Res., 167, 192-205.
68. Polley, D.B., Steinberg, E.E. & Merzenich, M.M. (2006) Perceptual learning directs auditory cortical map reorganization through top-down influences. J. Neurosci., 26, 4970-4982.
69. Polley, D.B., Read, H.L., Storace, D.A. & Merzenich, M.M. (2007) Multiparametric auditory receptive field organization across five cortical fields in the albino rat. J. Neurophysiol., 97, 3621-3638.
70. Rasmusson, D., Smith, S. & Semba, K. (2007) Inactivation of prefrontal cortex abolishes cortical acetylcholine release evoked by sensory or sensory pathway stimulation in the rat. Neuroscience, 149, 232-241.
71. Rauschecker, J.P. (1999) Auditory cortical plasticity: a comparison with other sensory systems. Trends Neurosci., 22, 74-80.
72. Reale, R.A. & Imig, T.J. (1980) Tonotopic organization in auditory cortex of the cat. J. Comp. Neurol., 192, 265-294.
73. Recanzone, G.H., Schreiner, C.E. & Merzenich, M.M. (1993) Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. J. Neurosci., 13, 87-103.
74. Reed, A., Riley, J., Carraway, R., Carrasco, A., Perez, C., Jakkamsetti, V. & Kilgard, M.P. (2011) Cortical map plasticity improves learning but is not necessary for improved performance. Neuron, 70, 121-131.
75. Rescorla, R.A. (2002) Savings tests: separating differences in rate of learning from differences in initial levels. J. Exp. Psychol. Anim. Behav. Process., 28, 369-377.
76. Rolls, E.T. (2000) The orbitofrontal cortex and reward. Cereb. Cortex, 10, 284-294.
77. Rose, J.E. & Woolsey, C.N. (1949) The relationships of thalamic connections, cellular structure and evokable electrical activity in the auditory region of the cat. J. Comp. Neurol., 91, 441-466.
78. Rutkowski, R.G. & Weinberger, N.M. (2005) Encoding of learned importance of sound by magnitude of representational area in primary auditory cortex. Proc. Natl. Acad. Sci. USA, 102, 12664-13669.
79. Rutkowski, R.G., Miasnikov, A.A. & Weinberger, N.M. (2003) Characterisation of multiple physiological fields within the anatomical core of rat auditory cortex. Hear. Res., 181, 116-130.
80. Sakurai, Y. (1994) Involvement of auditory cortical and hippocampal neurons in auditory working memory and reference memory in the rat. J. Neurosci., 14, 2606-2623.
81. Sally, S.L. & Kelly, J.B. (1988) Organization of auditory cortex in the albino rat: sound frequency. J. Neurophysiol., 59, 1627-1638.
82. Scheich, H., Brechmann, A., Brosch, M., Budinger, E., Ohl, F.W., Selezneva, E., Stark, H., Tischmeyer, W. & Wetzel, W. (2011) Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept. Hear. Res., 271, 3-15.
83. Schicknick, H., Schott, B.H., Budinger, E., Smalla, K.-H., Riedel, A., Seidenbecher, C.I., Scheich, H., Gundelfinger, E.D. & Tischmeyer, W. (2008) Dopaminergic modulation of auditory cortex-dependent memory consolidation through mTOR. Cereb. Cortex, 18, 2646-2658.
84. Schreiner, C.E. (1998) Spatial distribution of responses to simple and complex sounds in the primary auditory cortex. Audiol. Neurootol., 3, 104-122.
85. Schultz, W. (2001) Reward signaling by dopamine neurons. Neuroscientist, 7, 293-302.
86. Schultz, W., Tremblay, L. & Hollerman, J.R. (2000) Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex, 10, 272-284.
87. Siucinska, E. & Kossut, M. (1996) Short-lasting classical conditioning induces reversible changes of representational maps of vibrissae in mouse SI cortex - a 2DG study. Cereb. Cortex, 6, 506-513.
88. Skinner, B.F. (1938). The Behavior of Organisms. Prentice Hall, Englewood Cliffs, NJ.
89. Song, E.Y., Boatman, J.A., Jung, M.W. & Kim, J.J. (2010) Auditory cortex is important in the extinction of two different tone-based conditioned fear memories in rats. Front. Behav. Neurosci., 4, 24.
90. Stiebler, I., Neulist, R., Fichtel, I. & Ehret, G. (1997) The auditory cortex of the house mouse: left-right differences, tonotopic organization and quantitative analysis of frequency representation. J. Comp. Physiol. A., 181, 559-571.
91. Takahashi, H., Funamizu, A., Mitsumori, Y., Kose, H. & Kanzaki, R. (2010) Progressive plasticity of auditory cortex during appetitive operant conditioning. BioSystems, 101, 37-41.
92. Teich, A.H., McCabe, P.M., Gentile, C.C., Schneiderman, L.S., Winters, R.W., Liskowsky, D.R. & Schneiderman, N. (1989) Auditory cortex lesions prevent the extinction of Pavlovian differential heart rate conditioning to tonal stimuli in rabbits. Brain Res., 480, 210-218.
93. Thomas, H., Tillein, J., Heil, P. & Scheich, H. (1993) Functional organization of auditory cortex in the mongolian gerbil (Meriones unguiculatus). I. Electrophysiological mapping of frequency representation and distinction of fields. Eur. J. Neurosci., 5, 882-897.
94. Thompson, B.M., Baratta, M.V., Biedenkapp, J.C., Rudy, J.W., Watkins, L.R. & Maier, S.F. (2010) Activation of the infralimbic cortex in a fear context enhances extinction learning. Learn. Mem., 17, 591-599.
95. Tsytsarev, V., Yamazaki, T., Ribot, J. & Tanaka, S. (2004) Sound frequency representation in cat auditory cortex. Neuroimage, 23, 1246-1255.
96. Villa, A.E., Tetko, I.V., Hyland, B. & Najem, A. (1999) Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. Proc. Natl. Acad. Sci. USA, 96, 1106-1111.
97. Wagner, A. (1981) SOP: a model of automatic memory processing in animal behavior. In Spear, N.E. & Miller, R.R. (eds), Information Processing in Animals: Memory Mechanisms. Erlbaum, Hillsdale, NJ, pp. 5-47.
98. Wang, X., Lu, T., Snider, R.K. & Liang, L. (2005) Sustained firing in auditory cortex evoked by preferred stimuli. Nature, 435, 341-346.
99. Watanabe, M. (1990) Prefrontal unit activity during associative learning in the monkey. Exp. Brain Res., 80, 296-309.
100. Weinberger, N.M. (2007) Auditory associative memory and representational plasticity in the primary auditory cortex. Hear. Res., 229, 54-68.
101. Weinberger, N.M. (2011). Reconceptualizing the primary auditory cortex: learning, memory and specific plasticity. In Winer, J.A. & Schreiner, C.E. (eds), The Auditory Cortex. Springer, New York, pp. 465-491.
102. Weinberger, N.M. & Diamond, D.M. (1987) Physiological plasticity in auditory cortex: rapid induction by learning. Prog. Neurobiol., 29, 1-55.
103. Weinberger, N.M., Miasnikov, A.A. & Chen, J.C. (2006) The level of cholinergic nucleus basalis activation controls the specificity of auditory associative memory. Neurobiol. Learn. Mem., 86, 270-285.
104. Westenberg, I.S. & Weinberger, N.M. (1976) Evoked potential decrements in auditory cortex. II. Critical test for habituation. Electroencephalogr. Clin. Neurophysiol., 40, 356-369.
105. Wetzel, W., Wagner, T., Ohl, F.W. & Scheich, H. (1998) Categorical discrimination of direction in frequency-modulated tones by Mongolian gerbils. Behav. Brain Res., 91, 29-39.
106. Williams, S.B. (1938) Resistance to extinction as a function of the number of reinforcements. J. Exp. Psychol., 23, 506-522.
107. Yang, W.W., Zhou, X.M., Zhang, J.P. & Sun, X.D. (2007) Modulation of frequency receptive field plasticity in rat auditory cortical neurons by electrical stimulation of medial prefrontal cortex. Acta Physiol. Sinica, 59, 784-790.
108. Zellner, M.R. & Ranaldi, R. (2010) How conditioned stimuli acquire the ability to activate VTA dopamine cells: a proposed neurobiological component of reward-related learning. Neurosci. Biobehav. Rev., 34, 769-780.
109. Zhou, X. & Merzenich, M.M. (2007) Intensive training in adults refines A1 representations degraded in an early postnatal critical period. Proc. Natl. Acad. Sci. USA, 104, 15935-15940.
110. Zhou, X., de Villers-Sidani, E., Panizzutti, R. & Merzenich, M.M. (2010) Successive-signal biasing for a learned sound sequence. Proc. Natl. Acad. Sci. USA, 107, 14839-14844.