Conceptual representations in goal-directed decision making

Cognitive, Affective and Behavioral Neuroscience

Volumn 8, Issue 4, 2008, Pages 418-428

  Shea, Nicholas ^a   Krug, Kristine ^a   Tobler, Philippe N ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE DEVELOPMENT; CONCEPTUAL FRAMEWORK; DECISION MAKING; ELECTROPHYSIOLOGY; GOAL ATTAINMENT; HABIT; HUMAN; LEARNING; NEUROPHYSIOLOGY; NEUROSCIENCE; PSYCHOLOGY; REVIEW; SEMANTICS; ANIMAL; CONCEPT FORMATION; MOTIVATION; PSYCHOLOGICAL MODEL; RAT;

ANIMALS; CONCEPT FORMATION; DECISION MAKING; GOALS; HABITS; HUMANS; MODELS, PSYCHOLOGICAL; RATS; SEMANTICS;

EID: 60749102502     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/CABN.8.4.418     Document Type: Review

References (85)

1. ADAMS, C. D., & DICKINSON A. (1981). Actions and habits: Variations in associative representations during instrumental learning. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 143-166). Hillsdale, NJ: Erlbaum.
2. ALLEN, C., & HAUSER, M. (1996). Concept attribution in nonhuman animals: Theoretical and methodological problems in ascribing complex mental processes. In M. Bekoff & D. Jamieson (Eds.), Readings in animal cognition (pp. 47-62). Cambridge, MA: MIT Press.
3. BALLEINE, B. W., & DICKINSON, A. (1998a). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419. (Pubitemid 28306930)
4. BALLEINE, B. W., & DICKINSON, A. (1998b). The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Animal Learning & Behavior, 26, 46-59. (Pubitemid 28124631)
5. BALLEINE, B. W., ESPINET, A., & GONZALEZ, F. (2005). Perceptual learning enhances retrospective revaluation of conditioned flavor preferences in rats. Journal of Experimental Psychology: Animal Behavior Processes, 31, 341-350. (Pubitemid 41151881)
6. BAXTER, M. G., PARKER, A., LINDNER, C. C., IZQUIERDO, A. D., & MURRAY, E. A. (2000). Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. Journal of Neuroscience, 20, 4311-4319. (Pubitemid 30365701)
7. BEHRENS, T. E., WOOLRICH, M. W., WALTON, M. E., & RUSHWORTH, M. F. S. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10, 1214-1221. (Pubitemid 47339952)
8. BERMÚDEZ, J. (2003). Thinking without words. Cambridge, MA: MIT Press.
9. BERMÚDEZ, J. (2006). Animal reasoning and proto-logic. In S. Hurley & M. Nudds (Eds.), Rational animals? (pp. 127-138). Oxford: Oxford University Press.
10. BERRIDGE, K. C. (2001). Reward learning: Reinforcement, incentives and expectations. In D. L. Medin (Ed.), The psychology of learning and motivation (Vol. 41, pp. 223-278). San Diego: Academic Press.
11. BIRRELL, J. M., & BROWN, V. J. (2000). Medial frontal cortex mediates perceptual attentional set shifting in the rat. Journal of Neuroscience, 20, 4320-4324. (Pubitemid 30365702)
12. BLODGETT, H. C. (1929). The effect of the introduction of reward upon the maze performance of rats. University of California Publications in Psychology, 4, 113-134.
13. CANTALUPO, C., & HOPKINS, W. D. (2001). Asymmetric Broca's area in great apes. Nature, 414, 505.
14. CHATER, N., & HEYES, C. (1994). Animal concepts: Content and discontent. Mind & Language, 9, 209-246.
15. CLAYTON, N. S., & DICKINSON, A. (1998). Episodic-like memory during cache recovery by scrub jays. Nature, 395, 272-274. (Pubitemid 28447550)
16. COUTUREAU, E., & KILLCROSS, S. (2003). Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behavioral & Brain Research, 146, 167-174. (Pubitemid 37476143)
17. CRITCHLEY, H. D., & ROLLS, E. T. (1996). Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. Journal of Neurophysiology, 75, 1673-1686. (Pubitemid 26114072)
18. DAW, N. D., NIV, Y., & DAYAN, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711. (Pubitemid 41683198)
19. DEVLIN, J. T., MATTHEWS, P. M., & RUSHWORTH, M. F. (2003). Semantic processing in the left inferior prefrontal cortex: A combined functional magnetic resonance imaging and transcranial magnetic stimulation study. Journal of Cognitive Neuroscience, 15, 71-84. (Pubitemid 36106264)
20. DEVLIN, J. T., RALEY, J., TUNBRIDGE, E., LANARY, K., FLOYER-LEA, A., NARAIN, C., ET AL. (2003). Functional asymmetry for auditory processing in human primary auditory cortex. Journal of Neuroscience, 23, 11516-11522. (Pubitemid 38021280)
21. DEVLIN, J. T., SILLERY, E. L., HALL, D. A., HOBDEN, P., BEHRENS, T. E., & NUNES, R. G. (2006). Reliable identification of the auditory thalamus using multi-modal structural analyses. NeuroImage, 30, 1112-1120.
22. DICKINSON, A. (1980). Contemporary animal learning theories. Cambridge: Cambridge University Press.
23. DICKINSON, A., & BALLEINE, B. (1994). Motivational control of goal-directed action. Animal Learning & Behavior, 22, 1-18. (Pubitemid 24054214)
24. DICKINSON, A., & BALLEINE, B. (2002). The role of learning in motivation. In C. R. Gallistel (Ed.), Learning, motivation, and emotion (pp. 497-533). New York: Wiley.
25. DICKINSON, A., BALLEINE, B., WATT, A., GONZALEZ, F., & BOAKES, R. A. (1995). Motivational control after extended instrumental training. Ani mal Learning & Behavior, 23, 197-206.
26. EMERY, N. J., & CLAYTON, N. S. (2001). Effects of experience and social context on prospective caching strategies by scrub jays. Nature, 414, 443-446. (Pubitemid 34173724)
27. EVANS, G. (1982). The varieties of reference. Oxford: Oxford University Press.
28. FREEDMAN, D. J., & ASSAD, J. A. (2006). Experience-dependent representation of visual categories in parietal cortex. Nature, 443, 85-88. (Pubitemid 44344052)
29. FREEDMAN, D. J., RIESENHUBER, M., POGGIO, T., & MILLER, E. K. (2001). Categorical representation of visual stimuli in the primate prefrontal cortex. Science, 291, 260-263. (Pubitemid 32096318)
30. FUSTER, J. M. (2000). Executive frontal functions. Experimental Brain Research, 133, 66-70. (Pubitemid 30411658)
31. GENTNER, T. Q., FENN, K. M., MARGOLIASH, D., & NUSBAUM, H. C. (2006). Recursive syntactic pattern learning by songbirds. Nature, 440, 1204-1207.
32. GOTTFRIED, J. A., O'DOHERTY, J., & DOLAN, R. J. (2003). Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science, 301, 1104-1107. (Pubitemid 37022314)
33. HARE, B., CALL, J., AGNETTA, B., & TOMASELLO, M. (2000). Chimpan zees know what conspecifics do and do not see. Animal Behavior, 59, 771-785. (Pubitemid 30675328)
34. HARE, B., CALL, J., & TOMASELLO, M. (2001). Do chimpanzees know what conspecifics know? Animal Behavior, 61, 139-151.
35. HOLLAND, P. C., & GALLAGHER, M. (2004). Amygdala-frontal interactions and reward expectancy. Current Opinion in Neurobiology, 14, 148-155. (Pubitemid 38479930)
36. HOUK, J. C., ADAMS, J. L., & BARTO, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 249-270). Boston: MIT Press.
37. HURLEY, S., & NUDDS, M. (EDS.). (2006). Rational animals? Oxford: Oxford University Press.
38. JOG, M. S., KUBOTA, Y., CONNOLLY, C. I., HILLEGAART, V., & GRAYBIEL, A. M. (1999). Building neural representations of habits. Science, 286, 1745-1749. (Pubitemid 129515883)
39. JOHNSON, A., & REDISH, A. D. (2007). Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. Journal of Neuroscience, 27, 12176-12189. (Pubitemid 350085471)
40. KENNERLEY, S. W., WALTON, M. E., BEHRENS, T. E. J., BUCKLEY, M. J., & RUSHWORTH, M. F. S. (2006). Optimal decision making and the anterior cingulate cortex. Nature Neurosicence, 9, 940-947. (Pubitemid 43980509)
41. KENWARD, B., WEIR, A. A., RUTZ, C., & KACELNIK, A. (2005). Behavioural ecology: Tool manufacture by naive juvenile crows. Nature, 433, 121.
42. KILLCROSS, S., & COUTUREAU, E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral Cortex, 13, 400-408. (Pubitemid 36373685)
43. KOECHLIN, E., & JUBAULT, T. (2006). Broca's area and the hierarchical organization of human behavior. Neuron, 50, 963-974. (Pubitemid 43850692)
44. KOECHLIN, E., ODY, C., & KOUNELHER, F. (2003). The architecture of cognitive control in the human prefrontal cortex. Science, 302, 1181-1185. (Pubitemid 37421016)
45. LAU, B., & GLIMCHER, P. W. (2007). Action and outcome encoding in the primate caudate nucleus. Journal of Neuroscience, 27, 14502-14514.
46. MCCLURE, S. M., LAIBSON, D. I., LOEWENSTEIN, G., & COHEN, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 502-507. (Pubitemid 39372453)
47. MCGAUGHY J., ROSS, R. S., & EICHENBAUM, H. (2008). Noradrenergic, but not cholinergic, deafferentation of prefrontal cortex impairs attentional set-shifting. Neuroscience, 153, 63-71.
48. MCLAREN, I. P. L., & MACKINTOSH, N. J. (2002). Associative learning and elemental representation: II. Generalization and discrimination. Animal Learning & Behavior, 30, 177-200.
49. MILLIKAN, R. G. (2000). On clear and confused ideas. Cambridge: Cambridge University Press.
50. MONTAGUE, P. R., DAYAN, P., & SEJNOWSKI, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16, 1936-1947. (Pubitemid 26145969)
51. MURPHY, G. L. (2004). The big book of concepts. Cambridge, MA: MIT Press.
52. NEWSOME, W. T., BRITTEN, K. H., & MOVSHON, J. A. (1989). Neuronal correlates of a perceptual decision. Nature, 341, 52-54. (Pubitemid 19220654)
53. O'DOHERTY, J., DAYAN, P., FRISTON, K. J., CRITCHLEY, H., & DOLAN, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 150-152. (Pubitemid 36555657)
54. O'DOHERTY, J., DAYAN, P., SCHULTZ, J., DEICHMANN, R., FRISTON, K., & DOLAN, R. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454. (Pubitemid 38495943)
55. OTTONI, E. B., DE RESENDE, B. D., & IZAR, P. (2005). Watching the best nutcrackers: What capuchin monkeys (Cebus apella) know about others' tool-using skills. Animal Cognition, 8, 215-219. (Pubitemid 41456239)
56. PACKARD, M. G., & KNOWLTON, B. J. (2002). Learning and memory functions of the basal ganglia. Annual Review of Neuroscience, 25, 563-593. (Pubitemid 34748029)
57. PADOA-SCHIOPPA, C., & ASSAD, J. A. (2008). The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience, 11, 95-102.
58. PASUPATHY, A., & MILLER, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature, 433, 873-876. (Pubitemid 40314896)
59. PEACOCKE, C. (1992). A study of concepts. Cambridge, MA: MIT Press.
60. PREUSS, T. M. (1995). Do rats have prefrontal cortex? The Rose-Woolsey- Akert program reconsidered. Journal of Cognitive Neuroscience, 7, 1-24.
61. PRICE, J. L. (2007). Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. In G. Schoenbaum, J. A. Gottfried, E. A. Murray, & S. J. Ramus (Eds.), Linking affect to action: Critical contributions of the orbitofrontal cortex (Annals of the New York Academy of Sciences, Vol. 1121, pp. 54-71). New York: New York Academy of Sciences.
62. RAMIREZ, D. R., & SAVAGE, L. M. (2007). Differential involvement of the basolateral amygdala, orbitofrontal cortex, and nucleus accumbens core in the acquisition and use of reward expectancies. Behavioral Neuroscience, 121, 896-906. (Pubitemid 350051293)
63. ROLLS, E. T., SIENKIEWICZ, Z. J., & YAXLEY, S. (1989). Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. European Journal of Neuroscience, 1, 53-60. (Pubitemid 19142029)
64. RUSHWORTH, M. F., BEHRENS, T. E., RUDEBECK, P. H., & WALTON, M. E. (2007). Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behavior. Trends in Cognitive Sciences, 11, 168-176. (Pubitemid 46467492)
65. RUSTICHINI, A. (2008). Dual or unitary system? Two alternative models of decision making. Cognitive, Affective, & Behavioral Neuroscience, 8, 355-362.
66. SAITO, N., MUSHIAKE, H., SAKAMOTO, K., ITOYAMA, Y., & TANJI, J. (2005). Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cereberal Cortex, 15, 1535-1546. (Pubitemid 41344503)
67. SCHULTZ, W., DAYAN, P., & MONTAGUE, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599. (Pubitemid 27120526)
68. SEYMOUR, B., O'DOHERTY, J., DAYAN, P., KOLTZENBURG, M., JONES, A. K., DOLAN, R. J., ET AL. (2004). Temporal difference models describe higher-order learning in humans. Nature, 429, 664-667. (Pubitemid 38812318)
69. SHIMA, K., ISODA, M., MUSHIAKE, H., & TANJI, J. (2007). Categorization of behavioral sequences in the prefrontal cortex. Nature, 445, 315-318. (Pubitemid 46122818)
70. SHIPLEY, B. E., & COLWILL, R. M. (1996). Direct effects on instrumental performance of outcome revaluation by drive shifts. Animal Learning & Behavior, 24, 57-67. (Pubitemid 26061191)
71. STICH, S. P. (1978). Do animals have beliefs? Australasian Journal of Philosophy, 57, 15-28.
72. SUGRUE, L. P., CORRADO, G. S., & NEWSOME, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782-1787. (Pubitemid 38787891)
73. SUGRUE, L. P., CORRADO, G. S., & NEWSOME, W. T. (2005). Choosing the greater of two goods: Neural currencies for valuation and decision making. Nature Reviews Neuroscience, 6, 1-13.
74. TANAKA, S. C., BALLEINE, B. W., & O'DOHERTY, J. P. (2008). Calculating consequences: Brain systems that encode the causal effects of actions. Journal of Neuroscience, 28, 6750-6755.
75. TANJI, J., SHIMA, K., & MUSHIAKE, H. (2007). Concept-based behavioral planning and the lateral preforontal cortex. Trends in Cognitive Sciences, 17, 528-534. (Pubitemid 350181569)
76. TOBLER, P. N., O'DOHERTY, J. P., DOLAN, R. J., & SCHULTZ, W. (2007). Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. Journal of Neurophysiology, 97, 1621-1632. (Pubitemid 46239533)
77. TORO, J. M., TROBALON, J. B., & SEBASTIÁN-GALLÉS, N. (2005). Effects of backward speech and speaker variability in language discrimination by rats. Journal of Experimental Psychology: Animal Behavior Processes, 31, 95-100. (Pubitemid 40176541)
78. TREMBLAY, L., & SCHULTZ, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704-708. (Pubitemid 29197648)
79. VALENTIN, V. V., DICKINSON, A., & O'DOHERTY, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. Journal of Neuroscience, 27, 4019-4026. (Pubitemid 46597159)
80. WALTON, M., RUDEBECK, P. H., BANNERMAN, D., & RUSHWORTH, M. (2007). Calculating the cost of acting in prefrontal cortex. In B. W. Balleine, K. Doya, J. O'Doherty, & M. Sakagami (Eds.), Reward and decision making in corticobasal ganglia networks (Annals of the New York Academy of Sciences, Vol. 1104, pp. 340-356). New York: New York Academy of Sciences.
81. WHITEN A., SPITERI A., HORNER V., BONNIE K. E., LAMBETH, S. P., SCHAPIRO, S. J., & DE WAAL, F. B. (2007). Transmission of multiple traditions within and between chimpanzee groups. Current Biology, 17, 1038-1043. (Pubitemid 46899534)
82. WRIGHT, A. A., & KATZ, J. S. (2007). Generalization hypothesis of abstract-concept learning: Learning strategies and related issues in Macaca mulatta, Cebus apella, and Columba livia. Journal of Comparative Psychology, 121, 387-397.
83. YANG, T., & SHADLEN, M. N. (2007). Probabilistic reasoning by neurons. Nature, 447, 1075-1080. (Pubitemid 47014423)
84. YIN, H. H., KNOWLTON, B. J., & BALLEINE, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience, 19, 181-189. (Pubitemid 38122084)
85. YIN, H. H., KNOWLTON, B. J., & BALLEINE, B. W. (2005). Blockade of NMDA receptors in the dorsomedial striatum prevents action- outcome learning in instrumental conditioning. European Journal of Neuroscience, 22, 505-512. (Pubitemid 41097623)