Categorization=decision making+generalization

Neuroscience and Biobehavioral Reviews

Volumn 37, Issue 7, 2013, Pages 1187-1200

  Seger, Carol A ^a   Peterson, Erik J ^a  

^a Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

Basal ganglia; Category learning; Decision making; Hippocampus; Reinforcement learning

Indexed keywords

AMBIGUITY; BASAL GANGLION; CATEGORIZATION; COGNITION; DECISION MAKING; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GENERALIZATION; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; NEUROIMAGING; PERCEPTION; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; REWARD; STIMULUS RESPONSE; THINKING; UNCERTAINTY; PHYSIOLOGY; STIMULUS GENERALIZATION; VISION;

BASAL GANGLIA; DECISION MAKING; GENERALIZATION, STIMULUS; HUMANS; LEARNING; REINFORCEMENT (PSYCHOLOGY); VISUAL PERCEPTION;

EID: 84878826601     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2013.03.015     Document Type: Review

References (266)

1. Anderson J.R. The adaptive nature of human categorization. Psychological Review 1991, 98:409-429.
2. Aron A.R., Shohamy D., Clark J., Myers C., Gluck M.A., Poldrack R.A. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. Journal of Neurophysiology 2004, 92:1144-1152.
3. Ashby F.G., Alfonso-Reese L.A. Categorization as probability density estimation. Journal of Mathematical Psychology 1995, 39:216-233.
4. Ashby F.G., Alfonso-Reese L.A., Turken A.U., Waldron E.M. A neuropsychological theory of multiple systems in category learning. Psychological Review 1998, 105:442-481.
5. Ashby F.G., Crossley M.J. Interactions between declarative and procedural-learning categorization systems. Neurobiology of Learning and Memory 2010, 94:1-12.
6. Ashby F.G., Ell S.W., Waldron E.M. Procedural learning in perceptual categorization. Memory and Cognition 2003, 31:1114-1125.
7. Ashby F.G., Maddox W.T. Human category learning. Annual Review of Psychology 2005, 56:149-178.
8. Ashby F.G., Paul E.J., Maddox W.T. COVIS. Formal Approaches in Categorization 2011, Cambridge University Press, New York. E.M. Pothos, A.J. Wills (Eds.).
9. Ashby F.G., Townsend J.T. Varieties of perceptual independence. Psychological Review 1986, 93:154-179.
10. Audley R.J., Pike A.R. Some stochastic models of choice. British Journal of Mathematical and Statistical Psychology 1965, 18:207-225.
11. Bach D.R., Dolan R.J. Knowing how much you don't know: a neural organization of uncertainty estimates. Nature Review Neuroscience 2012, 13:572-586.
12. Bach D.R., Hulme O., Penny W.D., Dolan R.J. The known unknowns: neural representation of second-order uncertainty, and ambiguity. Journal of Neuroscience 2011, 31:4811-4820.
13. Bach D.R., Seymour B., Dolan R.J. Neural activity associated with the passive prediction of ambiguity and risk for aversive events. Journal of Neuroscience 2009, 29:1648-1656.
14. Banich M.T., Mackiewicz K.L., Depue B.E., Whitmer A.J., Miller G.A., Heller W. Cognitive control mechanisms, emotion and memory: a neural perspective with implications for psychopathology. Neuroscience and Biobehavioral Reviews 2009, 33:613-630.
15. Bechara A., Damasio A.R. The somatic marker hypothesis: a neural theory of economic decision. Games and Economic Behavior 2005, 52:336-372.
16. Bechara A., Damasio H., Tranel D., Damasio A.R. Deciding advantageously before knowing the advantageous strategy. Science 1997, 275:1293-1295.
17. Becker S., Macqueen G., Wojtowicz J.M. Computational modeling and empirical studies of hippocampal neurogenesis-dependent memory: effects of interference, stress and depression. Brain Research 2009, 1299:45-54.
18. Beer J.S., Stallen M., Lombardo M.V., Gonsalkorale K., Cunningham W.A., Sherman J.W. The Quadruple Process model approach to examining the neural underpinnings of prejudice. Neuroimage 2008, 43:775-783.
19. Bellebaum C., Jokisch D., Gizewski E.R., Forsting M., Daum I. The neural coding of expected and unexpected monetary performance outcomes: dissociations between active and observational learning. Behavioral Brain Research 2011.
20. Bernoulli D. Exposition of a new theory on the measurement of risk. Econometrica 1954, 22:23-36. (Original work published 1738).
21. Berns G.S., Bell E. Striatal topography of probability and magnitude information for decisions under uncertainty. Neuroimage 2012, 59:3166-3172.
22. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 191:391-431.
23. Bickel W.K., Pitcock J.A., Yi R., Angtuaco E.J. Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses. Journal of Neuroscience 2009, 29:8839-8846.
24. Blatter K., Schultz W. Rewarding properties of visual stimuli. Experimental Brain Research 2006, 168:541-546.
25. Bledowski C., Kaiser J., Rahm B. Basic operations in working memory: contributions from functional imaging studies. Behavioral Brain Research 2010, 214:172-179.
26. Bogacz R., Wagenmakers E.J., Forstmann B.U., Nieuwenhuis S. The neural basis of the speed-accuracy tradeoff. Trends in Neurosciences 2009.
27. Bott L., Hoffman A.B., Murphy G.L. Blocking in category learning. Journal of Experimental Psychology General 2007, 136:685-699.
28. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
29. Brooks L.R., Hannah S.D. Instantiated features and the use of "rules.". Journal of Experimental Psychology General 2006, 135:133-151.
30. Brooks S.J., Savov V., Allzén E., Benedict C., Fredriksson R., Schiöth H.B. Exposure to subliminal arousing stimuli induces robust activation in the amygdala, hippocampus, anterior cingulate, insular cortex and primary visual cortex: a systematic meta-analysis of fMRI studies. Neuroimage 2012, 59:2962-2973.
31. Bunzeck N., Doeller C.F., Dolan R.J., Duzel E. Contextual interaction between novelty and reward processing within the mesolimbic system. Human Brain Mapping 2012, 33:1309-1324.
32. Calabresi P., Picconi B., Tozzi A., Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in Neurosciences 2007, 30:211-219.
33. Camille N., Griffiths C.A., Vo K., Fellows L.K., Kable J.W. Ventromedial frontal lobe damage disrupts value maximization in humans. Journal of Neuroscience 2011, 31:7527-7532.
34. Camille N., Tsuchida A., Fellows L.K. Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. Journal of Neuroscience 2011, 31:15048-15052.
35. Casale M.B., Roeder J.L., Ashby F.G. Analogical transfer in perceptual categorization. Memory and Cognition 2012, 40:434-449.
36. Chib V.S., Rangel A., Shimojo S., O'Doherty J.P. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. Journal of Neuroscience 2009, 29:12315-12320.
37. Chua H.F., Gonzalez R., Taylor S.F., Welsh R.C., Liberzon I. Decision-related loss: regret and disappointment. Neuroimage 2009, 47:2031-2040.
38. Churchland A.K., Kiani R., Chaudhuri R., Wang X.J., Pouget A., Shadlen M.N. Variance as a signature of neural computations during decision making. Neuron 2011, 69:818-831.
39. Connolly P.M., Bennur S., Gold J.I. Correlates of perceptual learning in an oculomotor decision variable. Journal of Neuroscience 2009, 29:2136-2150.
40. Corrado, G.S., Sugrue, L.P., Brown, J.R., Newsome, W.T., 2008. The trouble with choice: studying decision variables in the brain. In: Neuroeconomics: Decision Making and the Brain.
41. Cromer J.A., Roy J.E., Miller E.K. Representation of multiple, independent categories in the primate prefrontal cortex. Neuron 2010, 66:796-807.
42. Croxson P.L., Walton M.E., O'Reilly J.X., Behrens T.E., Rushworth M.F. Effort-based cost-benefit valuation and the human brain. Journal of Neuroscience 2009, 29:4531-4541.
43. Damasio, A.J., 1994. Descartes' Error: Emotion, Reason, and the Human Brain.
44. Daniel R., Pollmann S. Striatal activations signal prediction errors on confidence in the absence of external feedback. Neuroimage 2012, 59:3457-3467.
45. Daniel R., Wagner G., Koch K., Reichenbach J.R., Sauer H., Schlösser R.G. Assessing the neural basis of uncertainty in perceptual category learning through varying levels of distortion. Journal of Cognitive Neuroscience 2011, 23:1781-1793.
46. Davis T., Love B.C., Preston A.R. Learning the exception to the rule: model-based FMRI reveals specialized representations for surprising category members. Cerebral Cortex 2012, 22:260-273.
47. Davis T., Love B.C., Preston A.R. Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI. Journal of Experimental Psychology Learning Memory and Cognition 2012, 38:821-839.
48. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
49. Dayan P., Niv Y. Reinforcement learning: the good, the bad and the ugly. Current Opinion in Neurobiology 2008, 18:185-196.
50. den Ouden H.E., Daunizeau J., Roiser J., Friston K.J., Stephan K.E. Striatal prediction error modulates cortical coupling. Journal of Neuroscience 2010, 30:3210-3219.
51. Denkinger B., Koutstaal W. Perceive-decide-act, perceive-decide-act: how abstract is repetition-related decision learning?. Journal of Experimental Psychology Learning Memory and Cognition 2009, 35:742-756.
52. Dickerson K.C., Li J., Delgado M.R. Parallel contributions of distinct human memory systems during probabilistic learning. Neuroimage 2011, 55:266-276.
53. Doeller C.F., King J.A., Burgess N. Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory. Proceedings of the National Academy of Sciences United States of America 2008, 105:5915-5920.
54. Domenech P., Dreher J.C. Decision threshold modulation in the human brain. Journal of Neuroscience 2010, 30:14305-14317.
55. Ellsberg D. Risk, ambiguity and the Savage axioms. Quarterly Journal of Economics 1961, 75:643-669.
56. Erickson M.A., Kruschke J.K. Rules and exemplars in category learning. Journal of Experimental Psychology: General 1998, 127:107-140.
57. Ernst M., Paulus M.P. Neurobiology of decision making: a selective review from a neurocognitive and clinical perspective. Biological Psychiatry 2005, 58:597-604.
58. Estes W.K. Traps in the route to models of memory and decision. Psychonomic Bulletin and Review 2002, 9:3-25.
59. Figner B., Knoch D., Johnson E.J., Krosch A.R., Lisanby S.H., Fehr E., Weber E.U. Lateral prefrontal cortex and self-control in intertemporal choice. Nature Neuroscience 2010, 13:538-539.
60. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
61. FitzGerald T.H., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. Journal of Neuroscience 2009, 29:8388-8395.
62. Foerde K., Knowlton B.J., Poldrack R.A. Modulation of competing memory systems by distraction. Proceedings of the National Academy of Sciences United States of America 2006, 103:11778-11783.
63. Foerde K., Shohamy D. Feedback timing modulates brain systems for learning in humans. Journal of Neuroscience 2011, 31:13157-13167.
64. Fox C.R., Tversky A. Ambiguity aversion and comparative ignorance. The Quarterly Journal of Economics 1995, 110:585-603.
65. Folstein J.R., Gauthier I., Palmeri T.J. Mere exposure alters category learning of novel objects. Frontiers in Psychology 2010, 1:1-6.
66. Folstein J.R., Gauthier I., Palmeri T.J. How category learning affects object representations: not all morphspaces stretch alike. Journal of Experimental Psychology Learning Memory and Cognition 2012, 38:807-820.
67. Forstmann B.U., Anwander A., Schäfer A., Neumann J., Brown S., Wagenmakers E.J., Bogacz R., Turner R. Cortico-striatal connections predict control over speed and accuracy in perceptual decision making. Proceedings of the National Academy of Sciences United States of America 2010, 107:15916-15920.
68. Frank M.J. Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonism. Journal of Cognitive Neuroscience 2005, 17:51-72.
69. Frank M.J. Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Networks 2006, 19:1120-1136.
70. Frankó E., Seitz A.R., Vogels R. Dissociable neural effects of long-term stimulus-reward pairing in macaque visual cortex. Journal of Cognitive Neuroscience 2010, 22:1425-1439.
71. Freedman D.J., Assad J.A. Experience-dependent representation of visual categories in parietal cortex. Nature 2006, 443:85.
72. Freedman D.J., Assad J.A. Distinct encoding of spatial and nonspatial visual information in parietal cortex. Journal of Neuroscience 2009, 29:5671-5680.
73. Freedman D.J., Assad J.A. A proposed common neural mechanism for categorization and perceptual decisions. Nature Neuroscience 2011, 14:143-146.
74. Freedman D.J., Riesenhuber M., Poggio T., Miller E.K. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. Journal of Neuroscience 2003, 23:5235-5246.
75. Furman M., Wang X.J. Similarity effect and optimal control of multiple-choice decision making. Neuron 2008, 60:1153-1168.
76. Gardiner J.M., Ramponi C., Richardson-Klavehn A. Recognition memory and decision processes: a meta-analysis of remember, know, and guess responses. Memory 2002, 10:83-98.
77. Gershman S.J., Blei D.M., Niv Y. Context, learning, and extinction. Psychological Review 2010, 117:197-209.
78. Giovanello K.S., Schnyer D., Verfaellie M. Distinct hippocampal regions make unique contributions to relational memory. Hippocampus 2009, 19:111-117.
79. Gläscher J., Adolphs R., Damasio H., Bechara A., Rudrauf D., Calamia M., Paul L.K., Tranel D. Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex. Proceedings of the National Academy of Sciences United States of America 2012, 109:14681-14686.
80. Gläscher J., Büchel C. Formal learning theory dissociates brain regions with different temporal integration. Neuron 2005, 47:295-306.
81. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
82. Gold J.I., Law C.T., Connolly P., Bennur S. Relationships between the threshold and slope of psychometric and neurometric functions during perceptual learning: implications for neuronal pooling. Journal of Neurophysiology 2010, 103:140-154.
83. Gold J.I., Shadlen M.N. The neural basis of decision making. Annual Review of Neuroscience 2007, 30:535-574.
84. Graham K.S., Scahill V.L., Hornberger M., Barense M.D., Lee A.C., Bussey T.J., Saksida L.M. Abnormal categorization and perceptual learning in patients with hippocampal damage. Journal of Neuroscience 2006, 26:7547-7554.
85. Grinband J., Hirsch J., Ferrera V.P. A neural representation of categorization uncertainty in the human brain. Neuron 2006, 49:757-763.
86. Gureckis T.M., Love B.C. Short-term gains, long-term pains: how cues about state aid learning in dynamic environments. Cognition 2009, 113:293-313.
87. Hahn U., Prat-Sala M., Pothos E.M., Brumby D.P. Exemplar similarity and rule application. Cognition 2010, 114:1-18.
88. Hannula D.E., Tranel D., Cohen N.J. The long and the short of it: relational memory impairments in amnesia, even at short lags. Journal of Neuroscience 2006, 26:8352-8359.
89. Hare T.A., Schultz W., Camerer C.F., O'Doherty J.P., Rangel A. Transformation of stimulus value signals into motor commands during simple choice. Proceedings of the National Academy of Sciences United States of America 2011, 108:18120-18125.
90. Haruno M., Kawato M. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Networks 2006, 19:1242-1254.
91. Hedden T., Gabrieli J.D. Shared and selective neural correlates of inhibition, facilitation, and shifting processes during executive control. Neuroimage 2010, 51:421-431.
92. Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431:859-862.
93. Ho T.C., Brown S., Serences J.T. Domain general mechanisms of perceptual decision making in human cortex. Journal of Neuroscience 2009, 29:8675-8687.
94. Hoffman A.B., Murphy G.L. Category dimensionality and feature knowledge: when more features are learned as easily as fewer. Journal of Experimental Psychology Learning Memory and Cognition 2006, 32:301-315.
95. Hoke K.L., Ryan M.J., Wilczynski W. Candidate neural locus for sex differences in reproductive decisions. Biology Letters 2008, 4:518-521.
96. Hopkins R.O., Myers C.E., Shohamy D., Grossman S., Gluck M. Impaired probabilistic category learning in hypoxic subjects with hippocampal damage. Neuropsychologia 2004, 42:524-535.
97. Horner A.J., Henson R.N. Bindings between stimuli and multiple response codes dominate long-lag repetition priming in speeded classification tasks. Journal of Experimental Psychology Learning Memory and Cognition 2009, 35:757-779.
98. Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 2005, 310:1680-1683.
99. Huettel S.A., Song A.W., McCarthy G. Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. Journal of Neuroscience 2005, 25:3304-3311.
100. Huettel S.A., Stowe C.J., Gordon E.M., Warner B.T., Platt M.L. Neural signatures of economic preferences for risk and ambiguity. Neuron 2006, 49:765-775.
101. Humphries M.D., Stewart R.D., Gurney K.N. A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. Journal of Neuroscience 2006, 26:12921-12942.
102. Ito T.A., Bartholow B.D. The neural correlates of race. Trends in Cognitive Sciences 2009.
103. Izuma K., Saito D.N., Sadato N. Processing of social and monetary rewards in the human striatum. Neuron 2008, 58:284-294.
104. Jäkel F., Schölkopf B., Wichmann F.A. Does cognitive science need kernels?. Trends in Cognitive Sciences 2009.
105. Johnson A., van der Meer M.A., Redish A.D. Integrating hippocampus and striatum in decision-making. Current Opinion in Neurobiology 2007, 17:692-697.
106. Kable J.W., Glimcher P.W. The neurobiology of decision: consensus and controversy. Neuron 2009, 63:733-745.
107. Kable J.W., Glimcher P.W. An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. Journal of Neurophysiology 2010, 103:2513-2531.
108. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47:263-292.
109. Kahnt T., Grueschow M., Speck O., Haynes J.D. Perceptual learning and decision-making in human medial frontal cortex. Neuron 2011, 70:549-559.
110. Kahnt T., Heinzle J., Park S.Q., Haynes J.D. Decoding different roles for vmPFC and dlPFC in multi-attribute decision making. Neuroimage 2010, 56:709-715.
111. Kahnt T., Park S.Q., Cohen M.X., Beck A., Heinz A., Wrase J. Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. Journal of Cognitive Neuroscience 2009, 21:1332-1345.
112. Kakade S., Dayan P. Dopamine: generalization and bonuses. Neural Networks 2002, 15:549-559.
113. Kalenscher T., Pennartz C.M. Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Progress in Neurobiology 2008, 84:284-315.
114. Kalish C.W., Rogers T.T., Lang J., Zhu X. Can semi-supervised learning explain incorrect beliefs about categories?. Cognition 2011, 120:106-118.
115. Kayser A.S., Buchsbaum B.R., Erickson D.T., D'Esposito M. The functional anatomy of a perceptual decision in the human brain. Journal of Neurophysiology 2010, 103:1179-1194.
116. Kayser A.S., Erickson D.T., Buchsbaum B.R., D'Esposito M. Neural representations of relevant and irrelevant features in perceptual decision making. Journal of Neuroscience 2010, 30:15778-15789.
117. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nature Neuroscience 2011, 14:1581-1589.
118. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
119. Kim H., Shimojo S., O'Doherty J.P. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cerebral Cortex 2011, 21:769-776.
120. Kim S., Murphy G.L. Ideals and category typicality. Journal of Experimental Psychology Learning Memory and Cognition 2011, 37:1092-1112.
121. Kincaid A.E., Zheng T., Wilson C.J. Connectivity and convergence of single corticostriatal axons. Journal of Neuroscience 1998, 18:4722-4731.
122. Knight F.H. Risk, Uncertainty and Profit 1921, Houghton Mifflin, New York.
123. Knowlton B.J., Squire L.R. The learning of categories: parallel brain systems for item memory and category knowledge. Science 1993, 262:1747-1749.
124. Knowlton B.J., Squire L.R., Gluck M.A. Probabilistic classification learning in amnesia. Learning and Memory 1994, 1:106-120.
125. Knutson B., Taylor J., Kaufman M., Peterson R., Glover G. Distributed neural representation of expected value. Journal of Neuroscience 2005, 25:4806-4812.
126. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. Journal of Neuroscience 2010, 30:534-544.
127. Koenigs M., Young L., Adolphs R., Tranel D., Cushman F., Hauser M., Damasio A. Damage to the prefrontal cortex increases utilitarian moral judgements. Nature 2007, 446:908-911.
128. Kumaran D., Maguire E.A. Novelty signals: a window into hippocampal information processing. Trends in Cognitive Sciences 2009, 13:47-53.
129. Kumaran D., McClelland J.L. Generalization through the recurrent interaction of episodic memories: a model of the hippocampal system. Psychological Review 2012, 119:573-616.
130. Kumaran D., Summerfield J.J., Hassabis D., Maguire E.A. Tracking the emergence of conceptual knowledge during human decision making. Neuron 2009, 63:889-901.
131. Kurtz K.J. The divergent autoencoder (DIVA) model of category learning. Psychonomic Bulletin and Review 2007, 14:560-576.
132. Kühn S., Schmiedek F., Schott B., Ratcliff R., Heinze H.J., Düzel E., Lindenberger U., Lövden M. Brain areas consistently linked to individual differences in perceptual decision-making in younger as well as older adults before and after training. Journal of Cognitive Neuroscience 2010, 23:2147-2158.
133. Lambon Ralph M.A., Sage K., Jones R.W., Mayberry E.J. Coherent concepts are computed in the anterior temporal lobes. Proceedings of the National Academy of Sciences United States of America 2010, 107:2717-2722.
134. de Lange F.P., van Gaal S., Lamme V.A., Dehaene S. How awareness changes the relative weights of evidence during human decision-making. PLoS Biology 2011, 9:e1001203.
135. Lau B., Glimcher P.W. Value representations in the primate striatum during matching behavior. Neuron 2008, 58:451-463.
136. Lawrence A.D., Sahakian B.J., Robbins T.W. Cognitive functions and corticostriatal circuits: insights from Huntington's disease. Trends in Cognitive Sciences 1998, 2:379-388.
137. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Current Opinion in Neurobiology 2012.
138. Levy I., Snell J., Nelson A.J., Rustichini A., Glimcher P.W. Neural representation of subjective value under risk and ambiguity. Journal of Neurophysiology 2010, 103:1036-1047.
139. Li N., DiCarlo J.J. Unsupervised natural visual experience rapidly reshapes size-invariant object representation in inferior temporal cortex. Neuron 2010, 67:1062-1075.
140. Li S., Mayhew S.D., Kourtzi Z. Learning shapes the representation of behavioral choice in the human brain. Neuron 2009, 62:441-452.
141. Li S., Ostwald D., Giese M., Kourtzi Z. Flexible coding for categorical decisions in the human brain. Journal of Neuroscience 2007, 27:12321-12330.
142. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
143. Little D.M., Shin S.S., Sisco S.M., Thulborn K.R. Event-related fMRI of category learning: differences in classification and feedback networks. Brain and Cognition 2006, 60:244-252.
144. Liu T., Pleskac T.J. Neural correlates of evidence accumulation in a perceptual decision task. Journal of Neurophysiology 2011.
145. Lo C.C., Wang X.J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience 2006, 9:956-963.
146. Loewenstein G., Rick S., Cohen J.D. Neuroeconomics. Annual Review of Psychology 2008, 59:647-672.
147. Lohrenz T., McCabe K., Camerer C.F., Montague P.R. Neural signature of fictive learning signals in a sequential investment task. Proceedings of the National Academy of Sciences United States of America 2007, 104:9493-9498.
148. Lopez-Paniagua, D., Seger, C.A. Coding of level of ambiguity within neural systems mediating choice, submitted for publication.
149. Love B.C., Medin D.L., Gureckis T.M. SUSTAIN: a network model of category learning. Psychological Review 2004, 111:309-332.
150. Luhmann C.C., Ahn W.K., Palmeri T.J. Theory-based categorization under speeded conditions. Memory and Cognition 2006, 34:1102-1111.
151. Luhmann C.C., Chun M.M., Yi D.J., Lee D., Wang X.J. Neural dissociation of delay and uncertainty in intertemporal choice. Journal of Neuroscience 2008, 28:14459-14466.
152. Luo S., Ainslie G., Pollini D., Giragosian L., Monterosso J.R. Moderators of the association between brain activation and farsighted choice. Neuroimage 2012, 59:1469-1477.
153. Maddox W.T., Baldwin G.C., Markman A.B. A test of the regulatory fit hypothesis in perceptual classification learning. Memory and Cognition 2006, 34:1377-1397.
154. Maddox W.T., Glass B.D., O'Brien J.B., Filoteo J.V., Ashby F.G. Category label and response location shifts in category learning. Psychological Research 2010, 74:219-236.
155. Maddox W.T., Markman A.B. The motivation-cognition interface in learning and decision-making. Current Directions in Psychological Science 2010, 19:106-110.
156. Martin V.C., Schacter D.L., Corballis M.C., Addis D.R. A role for the hippocampus in encoding simulations of future events. Proceedings of the National Academy of Sciences United States of America 2011, 108:13858-13863.
157. McCormick C., Moscovitch M., Protzner A.B., Huber C.G., McAndrews M.P. Hippocampal-neocortical networks differ during encoding and retrieval of relational memory: functional and effective connectivity analyses. Neuropsychologia 2010, 48:3272-3281.
158. McGuire J.T., Kable J.W. Decision makers calibrate behavioral persistence on the basis of time-interval experience. Cognition 2012, 124:216-226.
159. McMahon D.B., Olson C.R. Repetition suppression in monkey inferotemporal cortex: relation to behavioral priming. Journal of Neurophysiology 2007, 97:3532-3543.
160. McNab F., Klingberg T. Prefrontal cortex and basal ganglia control access to working memory. Nature Neuroscience 2008, 11:103-107.
161. Medin D.L., Goldstone R.L., Markman A.B. Comparison and choice: relations between similarity processes and decision processes. Psychonomic Bulletin and Review 1995, 2:1-19.
162. Meeter M., Radics G., Myers C.E., Gluck M.A., Hopkins R.O. Probabilistic categorization: how do normal participants and amnesic patients do it?. Neuroscience and Biobehavioral Reviews 2008, 32:237-248.
163. Montague P.R., King-Casas B., Cohen J.D. Imaging valuation models in human choice. Annual Review of Neuroscience 2006, 29:417-448.
164. Morita K., Morishima M., Sakai K., Kawaguchi Y. Reinforcement learning: computing the temporal difference of values via distinct corticostriatal pathways. Trends in Neurosciences 2012, 35:457-467.
165. Morris G., Nevet A., Arkadir D., Vaadia E., Bergman H. Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience 2006, 9:1057-1063.
166. Murphy G.L., Ross B.H. The two faces of typicality in category-based induction. Cognition 2005, 95:175-200.
167. Noonan M.P., Mars R.B., Rushworth M.F. Distinct roles of three frontal cortical areas in reward-guided behavior. Journal of Neuroscience 2011, 31:14399-14412.
168. Norman K.A., O'Reilly R.C. Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. Psychological Review 2003, 110:611-646.
169. Nosofsky R.M., Little D.R., James T.W. Activation in the neural network responsible for categorization and recognition reflects parameter changes. Proceedings of the National Academy of Sciences United States of America 2012, 109:333-338.
170. Nosofsky R.M., Palmeri T.J. An exemplar-based random walk model of speeded classification. Psychological Review 1997, 104:266-300.
171. Nosofsky R.M., Palmeri T.J., McKinley S.C. Rule-plus-exception model of classification learning. Psychological Review 1994, 101:53-79.
172. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
173. O'Reilly R.C., Frank M.J. Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation 2006, 18:283-328.
174. O'Reilly R.C., Norman K.A. Hippocampal and neocortical contributions to memory: advances in the complementary learning systems framework. Trends in Cognitive Sciences 2002, 6:505-510.
175. Oosterhof N.N., Todorov A. The functional basis of face evaluation. Proceedings of the National Academy of Sciences United States of America 2008, 105:11087-11092.
176. Op de Beeck H.P., Haushofer J., Kanwisher N.G. Interpreting fMRI data: maps, modules and dimensions. Nature Review Neuroscience 2008, 9:123-135.
177. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. Journal of Neuroscience 2009, 29:14004-14014.
178. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annual Review of Neuroscience 2011, 34:333-359.
179. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
180. Park S.Q., Kahnt T., Rieskamp J., Heekeren H.R. Neurobiology of value integration: when value impacts valuation. Journal of Neuroscience 2011, 31:9307-9314.
181. Pascal B. Pensees (A. J. Krailsheimer Trans.) 1966, Penguin, New York, (Original work published).
182. Paulus M.P., Yu A.J. Emotion and decision-making: affect-driven belief systems in anxiety and depression. Trends in Cognitive Sciences 2012, 16:476-483.
183. Pennartz C.M., Ito R., Verschure P.F., Battaglia F.P., Robbins T.W. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends in Neurosciences 2011, 34:548-559.
184. Pessiglione M., Petrovic P., Daunizeau J., Palminteri S., Dolan R.J., Frith C.D. Subliminal instrumental conditioning demonstrated in the human brain. Neuron 2008, 59:561-567.
185. Phan K.L., Sripada C.S., Angstadt M., McCabe K. Reputation for reciprocity engages the brain reward center. Proceedings of the National Academy of Sciences United States of America 2010, 107:13099-13104.
186. Philiastides M.G., Biele G., Heekeren H.R. A mechanistic account of value computation in the human brain. Proceedings of the National Academy of Sciences United States of America 2010, 107:9430-9435.
187. Plassmann H., O'Doherty J.P., Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. Journal of Neuroscience 2010, 30:10799-10808.
188. Platt M.L., Huettel S.A. Risky business: the neuroeconomics of decision making under uncertainty. Nature Neuroscience 2008, 11:398-403.
189. Ploran E.J., Nelson S.M., Velanova K., Donaldson D.I., Petersen S.E., Wheeler M.E. Evidence accumulation and the moment of recognition: dissociating perceptual recognition processes using fMRI. Journal of Neuroscience 2007, 27:11912-11924.
190. Ploran E.J., Tremel J.J., Nelson S.M., Wheeler M.E. High quality but limited quantity perceptual evidence produces neural accumulation in frontal and parietal cortex. Cerebral Cortex 2011, 21:2650-2662.
191. Poldrack R.A., Clark J., Pare-Blagoev E.J., Shohamy D., Creso M.J., Myers C., Gluck M.A. Interactive memory systems in the human brain. Nature 2001, 414:546-550.
192. Poldrack R.A., Prabhakaran V., Seger C.A., Gabrieli J.D.E. Striatal activation during acquisition of a cognitive skill. Neuropsychology 1999, 13:564-574.
193. Popescu A.T., Popa D., Paré D. Coherent gamma oscillations couple the amygdala and striatum during learning. Nature Neuroscience 2009.
194. Poppenk J., McIntosh A.R., Craik F.I., Moscovitch M. Past experience modulates the neural mechanisms of episodic memory formation. Journal of Neuroscience 2010, 30:4707-4716.
195. Preston A.R., Bornstein A.M., Hutchinson J.B., Gaare M.E., Glover G.H., Wagner A.D. High-resolution fMRI of content-sensitive subsequent memory responses in human medial temporal lobe. Journal of Cognitive Neuroscience 2010, 22:156-173.
196. Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51:381-390.
197. Quartz S.R. Reason, emotion and decision-making: risk and reward computation with feeling. Trends in Cognitive Sciences 2009, 13:209-213.
198. Rahman S., Sahakian B.J., Cardinal R.H., Rogers R.D., Robbins T.W. Decision making and neuropsychiatry. Trends in Cognitive Sciences 2001, 5:271-277.
199. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nature Review Neuroscience 2008, 9:545-556.
200. Rangel A., Hare T. Neural computations associated with goal-directed choice. Current Opinion in Neurobiology 2010.
201. Ratcliff R. A theory of memory retrieval. Psychological Review 1978, 85:59-108.
202. Reber T.P., Luechinger R., Boesiger P., Henke K. Unconscious relational inference recruits the hippocampus. Journal of Neuroscience 2012, 32:6138-6148.
203. Redish A.D., Jensen S., Johnson A., Kurth-Nelson Z. Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychological Review 2007, 114:784-805.
204. Rehder B., Kim S. How causal knowledge affects classification: a generative theory of categorization. Journal of Experimental Psychology Learning Memory and Cognition 2006, 32:659-683.
205. Roelfsema P.R., van Ooyen A., Watanabe T. Perceptual learning rules based on reinforcers and attention. Trends in Cognitive Sciences 2010, 14:64-71.
206. Rogers T.T., McClelland J.L. Semantics without categorization. Formal Approaches in Categorization 2011, 88-119. Cambridge University Press, New York. E.M. Pothos, A.J. Wills (Eds.).
207. Rolls E.T., Grabenhorst F. The orbitofrontal cortex and beyond: from affect to decision-making. Progress in Neurobiology 2008, 86:216-244.
208. Roy M., Shohamy D., Wager T.D. Ventromedial prefrontal-subcortical systems and the generation of affective meaning. Trends in Cognitive Sciences 2012.
209. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., Rushworth M.F. Frontal cortex subregions play distinct roles in choices between actions and stimuli. Journal of Neuroscience 2008, 28:13775-13785.
210. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
211. Samejima K., Ueda Y., Doya K., Kimura M. Representation of action-specific reward values in the striatum. Science 2005, 310:1337-1340.
212. Sanborn A.N., Griffiths T.L., Navarro D.J. Rational approximations to rational models: alternative algorithms for category learning. Psychological Review 2010, 117:1144-1167.
213. Seger C.A. How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback. Neuroscience and Biobehavioral Reviews 2008, 32:265-278.
214. Seger C.A., Cincotta C.M. The roles of the caudate nucleus in human classification learning. Journal of Neuroscience 2005, 25:2941-2951.
215. Seger C.A., Dennison C.S., Lopez-Paniagua D., Peterson E.J., Roark A.A. Dissociating hippocampal and basal ganglia contributions to category learning using stimulus novelty and subjective judgments. Neuroimage 2011, 55:1739-1753.
216. Seger C.A., Miller E.K. Category learning in the brain. Annual Review of Neuroscience 2010, 33:203-219.
217. Seger C.A., Peterson E.J., Cincotta C.M., Lopez-Paniagua D., Anderson C.W. Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. Neuroimage 2010, 50:644-656.
218. Seger C.A. The involvement of corticostriatal loops in learning across tasks, species, and methodologies. The Basal Ganglia IX 2009, 25-39. Springer-Verlag, New York. H. Groenewegen (Ed.).
219. Serre T., Oliva A., Poggio T. A feedforward architecture accounts for rapid categorization. Proceedings of the National Academy of Sciences United States of America 2007, 104:6424-6429.
220. Sescousse G., Redouté J., Dreher J.C. The architecture of reward value coding in the human orbitofrontal cortex. Journal of Neuroscience 2010, 30:13095-13104.
221. Seymour B., McClure S.M. Anchors, scales and the relative coding of value in the brain. Current Opinion in Neurobiology 2008, 18:173-178.
222. Shabel S.J., Proulx C.D., Trias A., Murphy R.T., Malinow R. Input to the lateral habenula from the Basal Ganglia is excitatory, aversive, and suppressed by serotonin. Neuron 2012, 74:475-481.
223. Shadlen M.N., Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology 2001, 86:1916-1936.
224. Shepard R.N. Toward a universal law of generalization for psychological science. Science 1987, 437:1317-1323.
225. Sheth S.A., Abuelem T., Gale J.T., Eskandar E.N. Basal ganglia neurons dynamically facilitate exploration during associative learning. Journal of Neuroscience 2011, 31:4878-4885.
226. Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends in Cognitive Sciences 2010, 14:464-472.
227. Shohamy D., Myers C.E., Hopkins R.O., Sage J., Gluck M.A. Distinct hippocampal and Basal Ganglia contributions to probabilistic learning and reversal. Journal of Cognitive Neuroscience 2009, 21:1821-1833.
228. Shohamy D., Wagner A.D. Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 2008, 60:378-389.
229. Shuler M.G., Bear M.F. Reward timing in the primary visual cortex. Science 2006, 311:1606-1609.
230. Sigala N., Logothetis N.K. Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 2002, 415:318-320.
231. Smaldino P.E., Richerson P.J. The origins of options. Frontiers in Neuroscience 2012, 6:50.
232. Smith P.L., Ratcliff R. Psychology and neurobiology of simple decisions. Trends in Neurosciences 2004, 27:161-168.
233. Snyder H.R., Munakata Y. Becoming self-directed: abstract representations support endogenous flexibility in children. Cognition 2010, 116:155-167.
234. Soto F.A., Wasserman E.A. Missing the forest for the trees: object-discrimination learning blocks categorization learning. Psychological Science 2010, 21:1510-1517.
235. Spiering B.J., Ashby F.G. Response processes in information-integration category learning. Neurobiology of Learning and Memory 2008, 90:330-338.
236. Sripada C.S., Gonzalez R., Luan Phan K., Liberzon I. The neural correlates of intertemporal decision-making: contributions of subjective value, stimulus type, and trait impulsivity. Human Brain Mapping 2011, 32:1637-1648.
237. Stewart T.C., Bekolay T., Eliasmith C. Learning to select actions with spiking neurons in the Basal Ganglia. Frontiers in Neuroscience 2012, 6:2.
238. Strnad L., Anzellotti S., Caramazza A. Formal models of categorization: insights from cognitive neuroscience. Formal Approaches in Categorization 2011, 313-324. Cambridge University Press, New York. E.M. Pothos, A.J. Wills (Eds.).
239. Sugrue L.P., Corrado G.S., Newsome W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. Nature Review Neuroscience 2005, 6:363-375.
240. Summerfield C., Behrens T.E., Koechlin E. Perceptual classification in a rapidly changing environment. Neuron 2011, 71:725-736.
241. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press.
242. Swaminathan S.K., Freedman D.J. Preferential encoding of visual categories in parietal cortex compared with prefrontal cortex. Nature Neuroscience 2012, 15:315-320.
243. Thibaut J.P., Gelaes S. Exemplar effects in the context of a categorization rule: featural and holistic influences. Journal of Experimental Psychology Learning Memory and Cognition 2006, 32:1403-1415.
244. Tobler P.N., O'Doherty J.P., Dolan R.J., Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. Journal of Neurophysiology 2007, 97:1621-1632.
245. Townsend J.T., Ashby F.G. Stochastic Modeling of Elementary Psychological Processes 1983, Cambridge University Press, Cambridge, UK.
246. Tricomi E., Fiez J.A. Feedback signals in the caudate reflect goal achievement on a declarative memory task. Neuroimage 2008, 41:1154-1167.
247. Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of Caudate Activity by Action Contingency. Neuron 2004, 41:281-292.
248. Tsao D.Y., Moeller S., Freiwald W.A. Comparing face patch systems in macaques and humans. Proceedings of the National Academy of Sciences United States of America 2008, 105:19514-19519.
249. Tversky A. Features of similarity. Psychological Review 1977, 84:327-352.
250. Verdejo-García A., Bechara A. A somatic marker theory of addiction. Neuropharmacology 2009, 56(Suppl. 1):48-62.
251. Vlaev I., Chater N., Stewart N., Brown G.D. Does the brain calculate value?. Trends in Cognitive Sciences 2011, 15:546-554.
252. von Neuman J., Morgenstern O. Theory of Games and Economic Behavior 1944, Wiley, New York.
253. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412:43-48.
254. Wager T.D., Jonides J., Smith E.E., Nichols T.E. Toward a taxonomy of attention shifting: individual differences in fMRI during multiple shift types. Cognitive, Affective & Behavioral Neuroscience 2005, 5:127-143.
255. Wendelken C., Bunge S.A. Transitive inference: distinct contributions of rostrolateral prefrontal cortex and the hippocampus. Journal of Cognitive Neuroscience 2010, 22:837-847.
256. Wenzlaff H., Bauer M., Maess B., Heekeren H.R. Neural characterization of the speed-accuracy tradeoff in a perceptual decision-making task. Journal of Neuroscience 2011, 31:1254-1266.
257. Willmore B.D., Prenger R.J., Gallant J.L. Neural representation of natural images in visual area V2. Journal of Neuroscience 2010, 30:2102-2114.
258. Wimmer G.E., Shohamy D. Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 2012, 338:270-273.
259. Worthy D.A., Markman A.B., Maddox W.T. Choking and excelling under pressure in experienced classifiers. Attention Perception and Psychophysics 2009, 71:924-935.
260. Yamashita W., Wang G., Tanaka K. View-invariant object recognition ability develops after discrimination, not mere exposure, at several viewing angles. European Journal of Neuroscience 2010, 31:327-335.
261. Yamauchi T., Love B.C., Markman A.B. Learning nonlinearly separable categories by inference and classification. Learning and Memory 2002, 28:585-593.
262. Yoshida W., Funakoshi H., Ishii S. Hierarchical rule switching in prefrontal cortex. Neuroimage 2009.
263. Zeithamova D., Maddox W.T., Schnyer D.M. Dissociable prototype learning systems: evidence from brain imaging and behavior. Journal of Neuroscience 2008, 28:13194-13201.
264. Zeithamova D., Preston A.R. Flexible memories: differential roles for medial temporal lobe and prefrontal cortex in cross-episode binding. Journal of Neuroscience 2010, 30:14676-14684.
265. Zheng T., Wilson C.J. Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. Journal of Neurophysiology 2002, 87:1007-1017.
266. Zink C.F., Pagnoni G., Martin M.E., Dhamala M., Berns G.S. Human striatal response to salient nonrewarding stimuli. Journal of Neuroscience 2003, 23:8092-8097.