Striatal and hippocampal entropy and recognition signals in category learning: Simultaneous processes revealed by model-based fMRI

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 38, Issue 4, 2012, Pages 821-839

  Davis, Tyler ^a   Love, Bradley C ^a,b   Preston, Alison R ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Category learning; Entropy; Medial temporal lobe; Model based imaging; Recognition

Indexed keywords

ADULT; ARTICLE; BIOLOGICAL MODEL; BRAIN MAPPING; CORPUS STRIATUM; ENTROPY; FEMALE; HIPPOCAMPUS; HUMAN; LEARNING; MALE; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; RECOGNITION;

ADULT; BRAIN MAPPING; CORPUS STRIATUM; ENTROPY; FEMALE; HIPPOCAMPUS; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEUROPSYCHOLOGICAL TESTS; RECOGNITION (PSYCHOLOGY);

EID: 84871704445     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0027865     Document Type: Article

References (82)

1. Aizenstein, H. J., MacDonald, A. W., Stenger, V. A., Nebes, R. D., Larson, J. K., Ursu, S., & Carter, C. S. (2000). Complementary category learning systems identified using event-related functional MRI. Journal of Cog-nitive Neuroscience, 12, 977-987. doi:10.1162/08989290051137512
2. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organi-zation of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357-381. doi:10.1146/annurev.ne.09.030186.002041
3. Anderson, J. R. (1991). The adaptive nature of human categorization. Psychological Review, 98, 409-429. doi:10.1037/0033-295X.98.3.409
4. Aron, A. R., Shohamy, D., Clark, J., Myers, C., Gluck, M. A., & Poldrack, R. A. (2004). Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. Journal of Neurophysiology, 92, 1144-1152. doi:10.1152/jn.01209.2003
5. Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442-481. doi:10.1037/0033-295X.105.3.442
6. Ashby, F. G., & Maddox, W. T. (1993). Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology, 37, 372-400. doi:10.1006/jmps.1993.1023
7. Ashby, F. G., & Maddox, W. T. (2005). Human category learning. Annual Review of Psychology, 56, 149-178. doi:10.1146/annurev.psych.56 .091103.070217
8. Ashby, F. G., & O'Brien, J. B. (2005). Category learning and multiple memory systems. Trends in Cognitive Sciences, 9, 83-89. doi:10.1016/j.tics.2004.12.003
9. Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001). Predictability modulates human brain response to reward. The Journal of Neuroscience, 21, 2793-2798.
10. Bradley, M. M. (2009). Natural selective attention: Orienting and emotion. Psychophysiology, 46, 1-11. doi:10.1111/j.1469-8986.2008.00702.x
11. Canteras, N. S., & Swanson, L. W. (1992). Projections of the ventral subiculum to the amygdala, septum, and hypothalamus: A PHA-L an-terograde tracing study in the rat. Journal of Comparative Neurology, 324, 180-194. doi:10.1002/cne.903240204
12. Carr, V. A., Rissman, J., & Wagner, A. D. (2010). Imaging the human medial temporal lobe with high-resolution fMRI. Neuron, 65, 298-308. doi:10.1016/j.neuron.2009.12.022
13. Cavada, C., Company, T., Tejedor, J., Cruz-Rizzolo, R. J., & Reinoso-Suarez, F. (2000). The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cerebral Cortex, 10, 220-242. doi: 10.1093/cercor/10.3.220
14. Chua, E. F., Schacter, D. L., Rand-Giovannetti, E., & Sperling, R. A. (2007). Evidence for a specific role of the anterior hippocampal region in successful associative encoding. Hippocampus, 17, 1071-1080. doi: 10.1002/hipo.20340
15. Cincotta, C. M., & Seger, C. A. (2007). Dissociation between striatal regions while learning to categorize via feedback and via observation. Journal of Cognitive Neuroscience, 19, 249-265. doi:10.1162/jocn.2007.19.2.249
16. Cohen, A. L., Sanborn, A. N., & Shiffrin, R. M. (2008). Model evaluation using grouped or individual data. Psychonomic Bulletin and Review, 15, 692-712.
17. Daniel, R., Wagner, G., Koch, K., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. (2011). Assessing the neural basis of uncertainty in perceptual category learning through varying levels of distortion. Jour-nal of Cognitive Neuroscience, 23, 1781-1793.
18. Daselaar, S. M., Fleck, M. S., & Cabeza, R. (2006). Triple dissociation in the medial temporal lobes: Recollection, familiarity, and novelty. Jour-nal of Neurophysiology, 96, 1902-1911. doi:10.1152/jn.01029.2005
19. Davis, T., Love, B. C., & Maddox, T. (2009). Anticipatory emotions in decision tasks: Covert markers of value or attentional processes? Cog-nition, 112, 195-200. doi:10.1016/j.cognition.2009.04.002
20. Davis, T., Love, B. C., & Preston, A. R. (2011). Learning the exception to the rule: Model-based fMRI reveals specialized representations for sur-prising category members. Cerebral Cortex, 22, 260-273. doi:10.1093/cercor/bhr036
21. Daw, N. D. (2011). Trial-by-trial data analysis using computational mod-els. In M. R. Delgado, E. A. Phelps, & T. W. Robbins (Eds.), Decision making, affect, and learning: Attention and performance XXIII (Vol. 23, pp. 3-38). Oxford, England: Oxford University Press.
22. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal predic-tion errors. Neuron, 69, 1204-1215. doi:10.1016/j.neuron.2011.02.027 Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879. doi:10.1038/nature04766
23. Dickerson, K. C., Li, J., & Delgado, M. R. (2011). Parallel contributions of distinct human memory systems during probabilistic learning. Neuro-Image, 55, 266-276. doi:10.1016/j.neuroimage.2010.10.080
24. Eichenbaum, H., Yonelinas, A. P., & Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annual Review of Neuroscience, 30, 123-152. doi:10.1146/annurev.neuro.30.051606.094328
25. Fanselow, M. S., & Dong, H. W. (2010). Are the dorsal and ventral hippocampus functionally distinct structures? Neuron, 65, 7-19. doi: 10.1016/j.neuron.2009.11.031
26. Glass, B. D., Chotibut, T., Pacheco, J., Schnyer, D. M., & Maddox, W. T. (2012). Normal aging and the dissociable prototype learning systems. Psychology and Aging, 27, 120-128.
27. Grinband, J., Hirsch, J., & Ferrera, V. P. (2006). A neural representation of categorization uncertainty in the human brain. Neuron, 49, 757-763. doi:10.1016/j.neuron.2006.01.032
28. Henson, R. N. A., Cansino, S., Herron, J. E., Robb, W. G. K., & Rugg, M. D. (2003). A familiarity signal in human anterior medial temporal cortex? Hippocampus, 13, 301-304.
29. Jones, M., & Love, B. C. (2011). Bayesian fundamentalism or enlighten-ment? On the explanatory status and theoretical contributions of Bayes-ian models of cognition. Behavioral and Brain Sciences, 34, 169-231.
30. Kircher, T., Weis, S., Leube, D., Freymann, K., Erb, M., Jessen, F., . . . Krach, S. (2008). Anterior hippocampus orchestrates successful encod-ing and retrieval of non-relational memory: An event-related fMRI study. European Archives of Psychiatry and Clinical Neuroscience, 258, 363-372. doi:10.1007/s00406-008-0805-z
31. Kirwan, C. B., Jones, C. K., Miller, M. I., & Stark, C. E. (2007). High-resolution fMRI investigation of the medial temporal lobe. Human Brain Mapping, 28, 959-966. doi:10.1002/hbm.20331
32. Krebs, R. M., Schott, B. H., Schutze, H., & Duzel, E. (2009). The novelty exploration bonus and its attentional modulation. Neuropsychologia, 47, 2272-2281. doi:10.1016/j.neuropsychologia.2009.01.015
33. Lisman, J. E., & Grace, A. A. (2005). The hippocampal-VTA loop: Controlling the entry of information into long-term memory. Neuron, 46, 703-713.
34. Love, B. C., & Gureckis, T. M. (2007). Models in search of a brain. Cognitive, Affective, & Behavioral Neuroscience, 7, 90-108. doi: 10.3758/CABN.7.2.90
35. Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: A network model of category learning. Psychological Review, 111, 309-332. doi:10.1037/0033-295X.111.2.309
36. Maddox, W. T., & Ashby, F. G. (2004). Dissociating explicit and procedural-learning based systems of perceptual category learning. Be-havioural Processes, 66, 309-332. doi:10.1016/j.beproc.2004.03.011
37. Mattfeld, A. T., & Stark, C. E. (2011). Striatal and medial temporal lobe functional interactions during visuomotor associative learning. Cerebral Cortex, 21, 647-658. doi:10.1093/cercor/bhq144
38. Meeter, M., Radics, G., Myers, C., Gluck, M., & Hopkins, R. (2008). Probabilistic categorization: How do normal participants and amnesic patients do it? Neuroscience & Biobehavioral Reviews, 32, 237-248. doi:10.1016/j.neubiorev.2007.11.001
39. Moser, M. B., & Moser, E. I. (1998). Functional differentiation in the hippocampus. Hippocampus, 8, 608-619. doi:10.1002/(SICI)1098-1063(1998)8:6<608::AID-HIPO3>3.0.CO;2-7
40. Mumford, J. A., Turner, B. O., Ashby, F. G., & Poldrack, R. A. (2012). Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses. NeuroImage, 59, 2636-2643. doi: 10.1016/j.neuroimage.2011.08.076
41. Nomura, E. M., Maddox, W. T., Filoteo, J. V., Ing, A. D., Gitelman, D. R., Parrish, T. B., . . . Reber, P. J. (2007). Neural correlates of rule-based and information-integration visual category learning. Cerebral Cortex, 17, 37-43. doi:10.1093/cercor/bhj122
42. Nosofsky, R. M., Gluck, M. A., Palmeri, T. J., & McKinley, S. C. (1994). Comparing models of rule-based classification learning: A replication and extension of Shepard, Hovland, and Jenkins (1961). Memory & Cognition, 22, 352-369. doi:10.3758/BF03200862
43. O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-337. doi:10.1016/S0896-6273(03)00169-7
44. O'Doherty, J. P., Hampton, A., & Kim, H. (2007). Model-based fMRI and its application to reward learning and decision making. Annals of the New York Academy of Sciences, 1104, 35-53. doi:10.1196/annals.1390.022
45. Palmeri, T. J., & Flanery, M. A. (2002). Memory systems and perceptual categorization: Psychology of learning and motivation (Vol. 41, pp. 141-189). New York, NY: Academic Press. Retrieved from http://www.sciencedirect.com/science/article/pii/S0079742102800068
46. Palmeri, T. J., & Nosofsky, R. M. (1995). Recognition memory for excep-tions to the category rule. Journal of Experimental Psychology: Learn-ing, Memory, and Cognition, 21, 548-568. doi:10.1037/0278-7393.21.3.548
47. Pickering, A. D. (1997). New approaches to the study of amnesic patients: What can a neurofunctional philosophy and neural network methods offer? Memory, 5, 255-300. doi:10.1080/741941146
48. Poldrack, R. A. (2006). Can cognitive processes be inferred from neuro-imaging data? Trends in Cognitive Sciences, 10, 59-63. doi:10.1016/j.tics.2005.12.004
49. Poldrack, R. A., & Packard, M. G. (2003). Competition among multiple memory systems: Converging evidence from animal and human brain studies. Neuropsychologia, 41, 245-251. doi:10.1016/S0028-3932(02)00157-4
50. Preston, A. R., & Wagner, A. D. (2007). The medial temporal lobe and memory. In R. P. Kesner & J. L. Martinez (Eds.), Neurobiology of learning and memory (pp. 305-337). Burlington, MA: Academic Press. doi:10.1016/B978-012372540-0/50010-8
51. Prince, S. E., Daselaar, S. M., & Cabeza, R. (2005). Neural correlates of relational memory: Successful encoding and retrieval of semantic and perceptual associations. The Journal of Neuroscience, 25, 1203-1210. doi:10.1523/JNEUROSCI.2540-04.2005
52. Reber, P. J., Gitelman, D. R., Parish, T. B., & Mesulam, M. M. (2003). Dissociating explicit and implicit category knowledge with fMRI. Jour-nal of Cognitive Neuroscience, 15, 574-583. doi:10.1162/089892903321662958
53. Rissman, J., Gazzaley, A., & D'Esposito, M. (2004). Measuring functional connectivity during distinct stages of a cognitive task. NeuroImage, 23, 752-763. doi:10.1016/j.neuroimage.2004.06.035
54. Sadeh, T., Shohamy, D., Levy, D. R., Reggev, N., & Maril, A. (2011). Cooperation between the hippocampus and the striatum during episodic encoding. Journal of Cognitive Neuroscience, 23, 1597-1608.
55. Sakamoto, Y., & Love, B. C. (2004). Schematic influences on category learning and recognition memory. Journal of Experimental Psychology: General, 133, 534-553. doi:10.1037/0096-3445.133.4.534
56. Sakamoto, Y., & Love, B. C. (2006). Vancouver, Toronto, Montreal, Austin: Enhanced oddball memory through differentiation, not isolation. Psychonomic Bulletin & Review, 13, 474-479. doi:10.3758/BF03193872
57. Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010). Rational approx-imations to rational models: Alternative algorithms for category learn-ing. Psychological Review, 117, 1144. doi:10.1037/a0020511
58. Schott, B. H., Sellner, D. B., Lauer, C. J., Habib, R., Frey, J. U., Guderian, S., . . . Düzel, E. (2004). Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learning & Memory, 11, 383-387. doi:10.1101/lm.75004
59. Schultz, W., Dayan, P., & Montague, P. R. (1997, March 14). A neural substrate of prediction and reward. Science, 275, 1593-1599. doi: 10.1126/science.275.5306.1593
60. Seger, C. A. (2008). How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feed-back. Neuroscience & Biobehavioral Reviews, 32, 265-278. doi:16/j.neubiorev.2007.07.010
61. Seger, C. A., & Cincotta, C. M. (2005). The roles of the caudate nucleus in human classification learning. The Journal of Neuroscience, 25, 2941. doi:10.1523/JNEUROSCI.3401-04.2005
62. Seger, C. A., & Cincotta, C. M. (2006). Dynamics of frontal, striatal, and hippocampal systems during rule learning. Cerebral Cortex, 16, 1546-1555. doi:10.1093/cercor/bhj092
63. Seger, C. A., Dennison, C. M., Lopez-Paniagua, D., Peterson, E. J., & Roark, A. A. (2011). Dissociating hippocampal and basal ganglia con-tributions to category learning using stimulus novelty and subjective judgments. NeuroImage, 55, 1739-1753.
64. Seger, C. A., & Miller, E. K. (2010). Category learning in the brain. Annual Review of Neuroscience, 33, 203-219. doi:10.1146/annurev .neuro.051508.135546
65. Seger, C. A., Peterson, E. J., Cincotta, C. M., Lopez-Paniagua, D., & Anderson, C. W. (2010). Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. NeuroImage, 50, 644-656. doi:10.1016/j.neuroimage.2009.11.083
66. Shohamy, D., Myers, C., Kalanithi, J., & Gluck, M. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neuro-science & Biobehavioral Reviews, 32, 219-236. doi:10.1016/ j.neubiorev.2007.07.008
67. Smith, E. E., & Grossman, M. (2008). Multiple systems of category learning. Neuroscience and Biobehavioral Reviews, 32, 249-264. doi: 10.1016/j.neubiorev.2007.07.009
68. Sokolov, E. N. (1966). Orienting reflex as information regulator. In A. Leontyev, A. Luria, & A. Smirnov (Eds.), Psychological research in the USSR (pp. 334-360). Moscow, Russia: Progress.
69. Sokolov, E. N., Spinks, J. A., Naatanen, R., & Lyytinen, H. (2002). The orienting response in information processing. London, England: Erl-baum.
70. Squire, L. R. (1992). Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans. Psychological Review, 99, 195-231.
71. Stark, C. E. L., & Squire, L. R. (2001). When zero is not zero: The problem of ambiguous baseline conditions in fMRI. Proceedings of the National Academy of Sciences, USA, 98, 12760-12766. doi:10.1073/pnas.221462998
72. Strange, B. A., Duggins, A., Penny, W., Dolan, R., & Friston, K. (2005). Information theory, novelty and hippocampal responses: Unpredicted or unpredictable? Neural Networks, 18, 225-230. doi:10.1016/j .neunet.2004.12.004
73. Strange, B. A., & Dolan, R. J. (2006). Anterior medial temporal lobe in human cognition: Memory for fear and the unexpected. Cognitive Neu-ropsychiatry, 11, 198-218. doi:10.1080/13546800500305096
74. Strange, B. A., Fletcher, P. C., Henson, R. N. A., Friston, K. J., & Dolan, R. J. (1999). Segregating the functions of human hippocampus. Pro-ceedings of the National Academy of Sciences, USA, 96, 4034-4039. doi:10.1073/pnas.96.7.4034
75. Strange, B. A., Hurlemann, R., Duggins, A., Heinze, H. J., & Dolan, R. J. (2005). Dissociating intentional learning from relative novelty responses in the medial temporal lobe. NeuroImage, 25, 51-62. doi:10.1016/j.neuroimage.2004.12.014
76. Vercauteren, T., Pennec, X., Perchant, A., & Ayache, N. (2009). Diffeo-morphic demons: Efficient non-parametric image registration. NeuroIm-age, 45(1, Suppl. 1), S61-S72. doi:10.1016/j.neuroimage.2008.10.040
77. Witter, M. P., Wouterlood, F. G., Naber, P. A., & Van Haeften, T. (2006). Anatomical organization of the parahippocampal-hippocampal network. Annals of the New York Academy of Sciences, 911, 1-24. doi:10.1111/j.1749-6632.2000.tb06716.x
78. Wittmann, B. C., Bunzeck, N., Dolan, R. J., & Duzel, E. (2007). Antici-pation of novelty recruits reward system and hippocampus while pro-moting recollection. NeuroImage, 38, 194-202. doi:10.1016/j.neuroimage.2007.06.038
79. Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008). Striatal activity underlies novelty-based choice in humans. Neuron, 58, 967-973. doi:10.1016/j.neuron.2008.04.027
80. Yassa, M. A., & Stark, C. E. (2009). A quantitative evaluation of cross-participant registration techniques for MRI studies of the me-dial temporal lobe. NeuroImage, 44, 319-327. doi:10.1016/j.neuroimage.2008.09.016
81. Zeineh, M. M., Engel, S. A., Thompson, P. M., & Bookheimer, S. Y. (2003). Dynamics of the hippocampus during encoding and retrieval of face-name pairs. Science, 299, 577. doi:10.1126/science.1077775
82. Zeithamova, D., Maddox, W. T., & Schnyer, D. M. (2008). Dissociable prototype learning systems: Evidence from brain imaging and behavior. The Journal of Neuroscience, 28, 13194-13201. doi:10.1523/JNEUROSCI.2915-08.2008