Erasing the engram: The unlearning of procedural skills

Journal of Experimental Psychology: General

Volumn 142, Issue 3, 2013, Pages 710-741

  Crossley, Matthew J ^a   Ashby, F Gregory ^a   Maddox, W Todd ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Categorization; Procedural learning; Striatum; Tonically active neurons; Unlearning

Indexed keywords

ARTICLE; BIOLOGICAL MODEL; CORPUS STRIATUM; HUMAN; LEARNING; NERVE CELL; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REWARD;

CORPUS STRIATUM; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURONS; PSYCHOMOTOR PERFORMANCE; REWARD;

EID: 84888031491     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030059     Document Type: Article

References (102)

1. Ashby, F. G. (1992). Multidimensional models of categorization. In F. G. Ashby (Ed.), Multidimensional models of perception and cognition (pp. 449-483). Hillsdale, NJ: Erlbaum.
2. Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U.,&Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442-481.
3. Ashby, F. G., Boynton, G.,&Lee, W. (1994). Categorization response time with multidimensional stimuli. Perception&Psychophysics, 55, 11-27.
4. Ashby, F. G.,&Crossley, M. J. (2010). Interactions between declarative and procedural-learning categorization systems. Neurobiology of Learning and Memory, 94, 1-12.
5. Ashby, F. G.,&Crossley, M. J. (2011). A computational model of how cholinergic interneurons protect striatal-dependent learning. Journal of Cognitive Neuroscience, 23, 1549-1566.
6. Ashby, F. G., Ell, S.,&Waldron, E. (2003). Procedural learning in perceptual categorization. Memory&Cognition, 31, 1114-1125.
7. Ashby, F. G.,&Ennis, J. M. (2006). The role of the basal ganglia in category learning. Psychology of Learning and Motivation, 46, 1-36.
8. Ashby, F. G., Ennis, J. M.,&Spiering, B. J. (2007). A neurobiological theory of automaticity in perceptual categorization. Psychological Review, 114, 632-656.
9. Ashby, F. G.,&Gott, R. E. (1988). Decision rules in the perception and categorization of multidimensional stimuli. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 33-53.
10. Ashby, F. G.,&Maddox, W. T. (2005). Human category learning. Annual Review of Psychology, 56, 149-178.
11. Ashby, F. G., Maddox, W. T.,&Bohil, C. J. (2002). Observational versus feedback training in rule-based and information-integration category learning. Memory&Cognition, 30, 666-677.
12. Ashby, F. G.,&O'Brien, J. (2005). Category learning and multiple memory systems. Trends in Cognitive Sciences, 9, 83-89.
13. Ashby, F. G.,&Waldron, E. M. (1999). On the nature of implicit categorization. Psychonomic Bulletin&Review, 6, 363-378.
14. Ashby, F. G., Waldron, E. M., Lee, W. W.,&Berkman, A. (2001). Suboptimality in human categorization and identification. Journal of Experimental Psychology: General, 130, 77-96.
15. Balleine, B. W.,&Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419.
16. Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z.,&Graybiel, A. M. (2005, October 20). Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature, 437, 1158-1161.
17. Bayer, H. M.,&Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141.
18. Bienenstock, E. L., Cooper, L. N.,&Munro, P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience, 2, 32-48.
19. Boakes, R. A. (1973). Response decrements produced by extinction and by response-independent reinforcement. Journal of the Experimental Analysis of Behavior, 19, 293-302.
20. Bouton, M. E. (2002). Context, ambiguity, and unlearning: Sources of relapse after behavioral extinction. Biological Psychiatry, 52, 976-986.
21. Bouton, M. E. (2004). Context and behavioral processes in extinction. Learning&Memory, 11, 485-494.
22. Bouton, M. E.,&Bolles, R. C. (1979). Contextual control of the extinction of conditioned fear. Learning and Motivation, 10, 445-466.
23. Bouton, M. E.,&King, D. A. (1983). Contextual control of the extinction of conditioned fear: Tests for the associative value of the context. Journal of Experimental Psychology: Animal Behavior Processes, 9, 248-265.
24. Bouton, M. E., Westbrook, R. F., Corcoran, K. A.,&Maren, S. (2006). Contextual and temporal modulation of extinction: Behavioral and biological mechanisms. Biological Psychiatry, 60, 352-360.
25. Brooks, D. C.,&Bouton, M. E. (1993). A retrieval cue for extinction attenuates spontaneous recovery. Journal of Experimental Psychology: Animal Behavior Processes, 19, 77-89.
26. Brooks, D. C.,&Bouton, M. E. (1994). A retrieval cue for extinction attenuates response recovery (renewal) caused by a return to the conditioning context. Journal of Experimental Psychology: Animal Behavior Processes, 20, 366-379.
27. Brooks, L. (1978). Nonanalytic concept formation and memory for instances. In E. Rosch&B. B. Lloyd (Eds.), Cognition and categorization (pp. 169-211). Hillsdale, NJ: Erlbaum.
28. Brown, J., Bullock, D.,&Grossberg, S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. Journal of Neuroscience, 19, 10502-10511.
29. Budney, A. J., Higgins, S. T., Delaney, D. D., Kent, L.,&Bickel, W. K. (1991). Contingent reinforcement of abstinence with individuals abusing cocaine and marijuana. Journal of Applied Behavior Analysis, 24, 657-665.
30. Bullock, D. H.,&Smith, W. C. (1953). An effect of repeated conditioningextinction upon operant strength. Journal of Experimental Psychology, 46, 349-352.
31. Burešová, O., Bureš, J., Bohdaneckỳ, Z.,&Weiss, T. (1964). Effect of atropine on learning, extinction, retention and retrieval in rats. Psychopharmacology, 5, 255-263.
32. Bush, R. R.,&Mosteller, F. (1951). A mathematical model for simple learning. Psychological Review, 58, 313-323.
33. Caan, W., Perrett, D.,&Rolls, E. (1984). Responses of striatal neurons in the behaving monkey: 2. Visual processing in the caudal neostriatum. Brain Research, 290, 53-65.
34. Calabresi, P., Pisani, A., Mercuri, N.,&Bernardi, G. (1996). The corticostriatal projection: From synaptic plasticity to dysfunctions of the basal ganglia. Trends in Neurosciences, 19, 19-24.
35. Casale, M. B., Roeder, J. L.,&Ashby, F. G. (2012). Analogical transfer in perceptual categorization. Memory&Cognition, 40, 434-449.
36. Divac, I., Rosvold, H. E.,&Szwarcbart, M. K. (1967). Behavioral effects of selective ablation of the caudate nucleus. Journal of Comparative and Physiological Psychology, 63, 184-190.
37. Er, M., Wu, S., Lu, J.,&Toh, H. (2002). Face recognition with radial basis function (rbf) neural networks. IEEE Transactions on Neural Networks, 13, 697-710.
38. Erickson, M. A.,&Kruschke, J. K. (1998). Rules and exemplars in category learning. Journal of Experimental Psychology: General, 127, 107-140.
39. Ermentrout, B. (1996). Type I membranes, phase resetting curves, and synchrony. Neural Computation, 8, 979-1001.
40. Estes, W. K. (1955). Statistical theory of spontaneous recovery and regression. Psychological Review, 62, 145-154.
41. Estes, W. K. (1986). Array models for category learning. Cognitive Psychology, 18, 500-549.
42. Estes, W. K. (1994). Classification and cognition. New York, NY: Oxford University Press.
43. Filoteo, J. V., Maddox, W. T., Salmon, D. P.,&Song, D. D. (2005). Information-integration category learning in patients with striatal dysfunction. Neuropsychology, 19, 212-222.
44. Gershman, S. J., Blei, D. M.,&Niv, Y. (2010). Context, learning, and extinction. Psychological Review, 117, 197-209.
45. Gibbons, R. D., Hedeker, D. R.,&Davis, J. M. (1993). Estimation of effect size from a series of experiments involving paired comparisons. Journal of Educational Statistics, 18, 271-279.
46. Gunther, L. M., Denniston, J. C.,&Miller, R. R. (1998). Conducting exposure treatment in multiple contexts can prevent relapse. Behaviour Research and Therapy, 36, 75-91.
47. Haruno, M.,&Kawato, M. (2006). Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. Journal of Neurophysiology, 95, 948-959.
48. Higgins, S. T., Budney, A. J.,&Bickel, W. K. (1995). Outpatient behavioral treatment for cocaine dependence: One-year outcome. Experimental and Clinical Psychopharmacology, 3, 205-212.
49. Hintzman, D. L. (1986). Schema abstraction in a multiple-trace memory model. Psychological Review, 93, 411-428.
50. Izhikevich, E. (2007). Dynamical systems in neuroscience: The geometry of excitability and bursting. Cambridge, MA: MIT press.
51. Kirkwood, A., Rioult, M. G.,&Bear, M. F. (1996, June 6). Experiencedependent modification of synaptic plasticity in visual cortex. Nature, 381, 526-528.
52. Knowlton, B. J., Mangels, J. A.,&Squire, L. R. (1996, September 6). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
53. Konorski, J. (1948). Conditioned reflexes and neuron organization. Cambridge, England: Cambridge University Press.
54. Konorski, J. (1967). Integrative activity of the brain. Chicago, IL: University of Chicago Press.
55. Kruschke, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review, 99, 22-44.
56. Kruschke, J. K. (2011). Models of attentional learning. In E. M. Pothos & A. J. Wills (Eds.), Formal approaches in categorization (pp. 120-152). Cambridge, England: Cambridge University Press.
57. Lamberts, K. (2000). Information-accumulation theory of speeded categorization. Psychological Review, 107, 227-260.
58. Lewandowsky, S.,&Kirsner, K. (2000). Expert knowledge is not always integrated: A case of cognitive partition. Memory&Cognition, 28, 295-305.
59. Maddox, W. T.,&Ashby, F. G. (1993). Comparing decision bound and exemplar models of categorization. Perception&Psychophysics, 53, 49-70.
60. Maddox, W. T., Ashby, F. G.,&Bohil, C. J. (2003). Delayed feedback effects on rule-based and information-integration category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 650-662.
61. Maddox, W. T., Ashby, F., Ing, A.,&Pickering, A. (2004). Disrupting feedback processing interferes with rule-based but not informationintegration category learning. Memory&Cognition, 32, 582-591.
62. Maddox, W. T., Bohil, C.,&Ing, A. (2004). Evidence for a procedurallearning based system in perceptual category learning. Psychonomic Bulletin&Review, 11, 945-952.
63. Maddox, W. T.,&Filoteo, J. V. (2011). Stimulus range and discontinuity effects on information-integration category learning and generalization. Attention, Perception,&Psychophysics, 73, 1279-1295.
64. Maddox, W. T., Glass, B. D., O'Brien, J. B., Filoteo, J. V.,&Ashby, F. G. (2010). Category label and response location shifts in category learning. Psychological Research, 74, 219-236.
65. Maddox, W. T.,&Ing, A. D. (2005). Delayed feedback disrupts the procedural-learning system but not the hypothesis testing system in perceptual category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 100-107.
66. Maddox, W. T., Love, B. C., Glass, B. D.,&Filoteo, J. V. (2008). When more is less: Feedback effects in perceptual category learning. Cognition, 108, 578-589.
67. Maddox, W. T., Molis, M. R.,&Diehl, R. L. (2002). Generalizing a neuropsychological model of visual categorization to auditory categorization of vowels. Perception&Psychophysics, 64, 584-597.
68. Maddox, W. T., Pacheco, J., Reeves, M., Zhu, B.,&Schnyer, D. M. (2010). Rule-based and information-integration category learning in normal aging. Neuropsychologia, 48, 2998-3008.
69. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. New York, NY: Freeman.
70. Matsumoto, N., Minamimoto, T., Graybiel, A.,&Kimura, M. (2001). Neurons in the thalamic CM-Pf complex supply striatal neurons with information about behaviorally significant sensory events. Journal of Neurophysiology, 85, 960-976.
71. Medin, D. L.,&Schaffer, M. M. (1978). Context theory of classification learning. Psychological Review, 85, 207-238.
72. Nakajima, S., Tanaka, S., Urshihara, K.,&Imada, H. (2000). Renewal of extinguished lever-press responses upon return to the training context. Learning and Motivation, 31, 416-431.
73. Nakajima, S., Urushihara, K.,&Masaki, T. (2002). Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context. Learning and Motivation, 33, 510-525.
74. Nomura, E. M., Maddox, W. T., Filoteo, J. V., Ing, A. D., Gitelman, D. R., Parrish, T. B., . . . Reber, P. J. (2007). Neural correlates of rule-based and information-integration visual category learning. Cerebral Cortex, 17, 37-43.
75. Nosofsky, R. M. (1986). Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General, 115, 39-57.
76. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K.,&Dolan, R. J. (2004, April 16). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454.
77. Oglesby, J.,&Mason, J. S. (1991). Radial basis function networks for speaker recognition. International Conference on Acoustics, Speech, and Signal Processing, 91, 393-396.
78. O'Reilly, R. C.,&Munakata, Y. (2000). Computational explorations in cognitive neuroscience. Cambridge, MA: MIT Press.
79. Pavlov, I. P. (1927). Conditioned reflexes. Oxford, England: Oxford University Press.
80. Pearce, J. M.,&Hall, G. (1980). A model for Pavlovian conditioning: Variations in the effectiveness of conditioned but not unconditioned stimuli. Psychological Review, 87, 532-552.
81. Petry, N. M. (2000). Drug and alcohol dependence: A comprehensive guide to the application of contingency management procedures in clinical settings. Drug and Alcohol Dependence, 58, 9-25.
82. Rall, W. (1967). Distinguishing theoretical synaptic potentials computed for different soma-dendritic distributions of synaptic input. Journal of Neurophysiology, 30, 1138-1168.
83. Redish, A. D., Jensen, S., Johnson, A.,&Kurth-Nelson, Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addition, relapse, and problem gambling. Psychological Review, 114, 784-805.
84. Rescorla, R. A. (2001). Experimental extinction. In R. R. Mowrer&S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 119-154). Mahwah, NJ: Erlbaum.
85. Rescorla, R. A.,&Skucy, J. C. (1969). Effect of response-independent reinforcers during extinction. Journal of Comparative and Physiological Psychology, 67, 381-389.
86. Riesenhuber, M.,&Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2, 1019-1025.
87. Rosenblum, M., Yacoob, Y.,&Davis, L. (1996). Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks, 7, 1121-1138.
88. Sanborn, A. N., Griffiths, T. L.,&Navarro, D. J. (2010). Rational approximations to rational models: Alternative algorithms for category learning. Psychological Review, 117, 1144-1167.
89. Schnyer, D. M., Maddox, W. T., Ell, S., Davis, S., Pacheco, J.,&Verfaellie, M. (2009). Prefrontal contributions to rule-based and informationintegration category learning. Neuropsychologia, 47, 2995-3006.
90. Schultz, W., Dayan, P.,&Montague, P. (1997, March 14). A neural substrate of prediction and reward. Science, 275, 1593-1599.
91. Seger, C. A.,&Cincotta, C. M. (2005). The roles of the caudate nucleus in human classification learning. Journal of Neuroscience, 25, 2941-2951.
92. Shadlen, M.,&Newsome, W. (2001). Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology, 86, 1916-1936.
93. Shoptaw, S., Jarvik, M. E., Ling, W.,&Rawson, R. A. (1996). Contingency management for tobacco smoking in methadone-maintained opiate addicts. Addictive Behaviors, 21, 409-412.
94. Tobler, P., Dickinson, A.,&Schultz, W. (2003). Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. Journal of Neuroscience, 23, 10402-10410.
95. Usher, M.,&McClelland, J. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108, 550-592.
96. Waldron, E. M.,&Ashby, F. G. (2001). The effects of concurrent task interference on category learning: Evidence for multiple category learning systems. Psychonomic Bulletin&Review, 8, 168-176.
97. Waldschmidt, J. G.,&Ashby, F. G. (2011). Cortical and striatal contributions to automaticity in information-integration categorization. Neuro-Image, 56, 1791-1802.
98. Wood, W.,&Neal, D. T. (2007). A new look at habits and the habit-goal interface. Psychological Review, 114, 843-863.
99. Woods, A. M.,&Bouton, M. E. (2007). Occasional reinforced responses during extinction can slow the rate of reacquisition of an operant response. Learning and Motivation, 38, 56-74.
100. Yang, L.-X.,&Lewandowsky, S. (2004). Knowledge partitioning in categorization: Constraints on exemplar models. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 1045-1064.
101. Yin, H. H., Ostlund, S. B., Knowlton, B. J.,&Balleine, B. W. (2005). The role of the dorsomedial striatum in instrumental conditioning. European Journal of Neuroscience, 22, 513-523.
102. Zeithamova, D.,&Maddox, W. (2006). Dual-task interference in perceptual category learning. Memory&Cognition, 34, 387-398.