The drive to strive: Goal generation based on current needs

Frontiers in Neuroscience

Volumn , Issue 7 JUN, 2013, Pages

  Murray, Elisabeth A ^a   Rudebeck, Peter H ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Amygdala; Anthropoid primates; Macaque; Orbitofrontal cortex; Prefrontal cortex; Reinforcer devaluation; Reward; Selective satiation

Indexed keywords

AMYGDALOID NUCLEUS; DECISION MAKING; DRIVE; HUMAN; MACACA; MOTIVATION; NONHUMAN; ORBITAL CORTEX; REVIEW; SATIETY; THALAMUS DORSOMEDIAL NUCLEUS;

EID: 84899797680     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00112     Document Type: Review

References (105)

1. Agetsuma, N. (1999). Simulation of patch use by monkeys using operant conditioning. J. Ethol. 16, 49-55. doi: 10.1007/BF02769282
2. Aggleton, J. P., and Passingham, R. E. (1981). Syndrome produced by lesions of the amygdala in monkeys (Macaca mulatta). J. Comp. Physiol. Psychol. 95, 961-977. doi: 10.1037/h0077848
3. Agustín-Pavón, C., Parkinson, J., Man, M. S., and Roberts, A. C. (2011). Contribution of the amygdala, but not orbitofrontal or medial prefrontal cortices, to the expression of flavour preferences in marmoset monkeys. Eur. J. Neurosci. 34, 1006-1017. doi: 10.1111/j.1460-9568.2011.07813.x
4. Amemori, K., and Graybiel, A. M. (2012). Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat. Neurosci. 15, 776-785. doi: 10.1038/nn.3088
5. Amiez, C., Joseph, J. P., and Procyk, E. (2006). Reward encoding in the monkey anterior cingulate cortex. Cereb. Cortex 16, 1040-1055. doi: 10.1093/cercor/bhj046
6. Avendano, C., Price, J. L., and Amaral, D. G. (1983). Evidence for an amygdaloid projection to premotor cortex but not to motor cortex in the monkey. Brain Res. 264, 111-117. doi: 10.1016/0006-8993(83)91126-5
7. Balleine, B., Ball, J., and Dickinson, A. (1994). Benzodiazepine-induced outcome revaluation and the motivational control of instrumental action in rats. Behav. Neurosci. 108, 573-589. doi: 10.1037/0735-7044.108.3.573
8. Balleine, B. W., and Dickinson, A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407-419. doi: 10.1016/S0028-3908(98)00033-1
9. Barbas, H. (1993). Organization of cortical afferent input to orbitofrontal areas in the rhesus monkey. Neuroscience 56, 841-864. doi: 10.1016/0306-4522(93)90132-Y
10. Barbas, H., and Pandya, D. N. (1989). Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 286, 353-375. doi: 10.1002/cne.902860306
11. Baxter, M. G., Gaffan, D., Kyriazis, D. A., and Mitchell, A. S. (2008). Dorsolateral prefrontal lesions do not impair tests of scene learning and decision-making that require frontal-temporal interaction. Eur. J. Neurosci. 28, 491-499. doi: 10.1111/j.1460-9568.2008.06353.x
12. Baxter, M. G., Gaffan, D., Kyriazis, D. A., and Mitchell, A. S. (2009). Ventrolateral prefrontal cortex is required for performance of a strategy implementation task but not reinforcer devaluation effects in rhesus monkeys. Eur. J. Neurosci. 29, 2049-2059. doi: 10.1111/j.1460-9568.2009.06740.x
13. Baxter, M. G., Parker, A., Lindner, C. C., Izquierdo, A. D., and Murray, E. A. (2000). Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20, 4311-4319.
14. Bouret, S., and Richmond, B. J. (2010). Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J. Neurosci. 30, 8591-8601. doi: 10.1523/JNEUROSCI.0049-10.2010
15. Carmichael, S. T., Clugnet, M. C., and Price, J. L. (1994). Central olfactory connections in the macaque monkey. J. Comp. Neurol. 346, 403-434. doi: 10.1002/cne.903460306
16. Carmichael, S. T., and Price, J. L. (1994). Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. J. Comp. Neurol. 346, 366-402. doi: 10.1002/cne.903460305
17. Carmichael, S. T., and Price, J. L. (1995a). Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615-641. doi: 10.1002/cne.903630408
18. Carmichael, S. T., and Price, J. L. (1995b). Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 363, 642-664. doi: 10.1002/cne.903630409
19. Carmichael, S. T., and Price, J. L. (1996). Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 371, 179-207.
20. Cavada, C., Company, T., Tejedor, J., Cruz-Rizzolo, R. J., and Reinoso-Suarez, F. (2000). The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10, 220-242. doi: 10.1093/cercor/10.3.220
21. Charnov, E. L. (1976). Optimal foraging, the marginal value theorem. Theo. Popul. Biol. 9, 129-136. doi: 10.1016/0040-5809(76)90040-X
22. Chudasama, Y., Daniels, T. E., Gorrin, D. P., Rhodes, S. E., Rudebeck, P. H., and Murray, E. A. (2012). The role of the anterior cingulate cortex in choices based on reward value and reward contingency. Cereb. Cortex. doi: 10.1093/cercor/bhs266. [Epub ahead of print].
23. Chudasama, Y., Wright, K. S., and Murray, E. A. (2008). Hippocampal lesions in rhesus monkeys disrupt emotional responses but not reinforcer devaluation effects. Biol Psychiatry 63, 1084-1091. doi: 10.1016/j.biopsych.2007.11.012
24. Colwill, R. M., and Rescorla, R. A. (1985). Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 11, 120-132. doi: 10.1037/0097-7403.11.1.120
25. Critchley, H. D., and Rolls, E. T. (1996). Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J. Neurophysiol. 75, 1673-1686.
26. Dickinson, A., and Balleine, B. (1994). Motivational control of goal directed action. Learn. Behav. 22, 1-18. doi: 10.3758/BF03199951
27. Ghashghaei, H. T., Hilgetag, C. C., and Barbas, H. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34, 905-923. doi: 10.1016/j.neuroimage.2006.09.046
28. Goldman-Rakic, P. S., and Porrino, L. J. (1985). The primate mediodorsal (MD) nucleus and its projection to the frontal lobe. J. Comp. Neurol. 242, 535-560. doi: 10.1002/cne.902420406
29. Gottfried, J. A., O'Doherty, J., and Dolan, R. J. (2003). Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301, 1104-1107. doi: 10.1126/science.1087919
30. Haber, S. N., Kim, K. S., Mailly, P., and Calzavara, R. (2006). Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J. Neurosci. 26, 8368-8376. doi: 10.1523/JNEUROSCI.0271-06.2006
31. Hadland, K. A., Rushworth, M. F., Gaffan, D., and Passingham, R. E. (2003). The anterior cingulate and reward-guided selection of actions. J. Neurophysiol. 89, 1161-1164. doi: 10.1152/jn.00634.2002
32. Hammond, L. J. (1980). The effect of contingency upon the appetitive conditioning of free-operant behavior. J. Exp. Anal. Behav. 34, 297-304. doi: 10.1901/jeab.1980.34-297
33. Hatfield, T., Han, J. S., Conley, M., Gallagher, M., and Holland, P. (1996). Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J. Neurosci. 16, 5256-5265.
34. Hayden, B. Y., Pearson, J. M., and Platt, M. L. (2011). Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 14, 933-939. doi: 10.1038/nn.2856
35. Hayden, B. Y., and Platt, M. L. (2007). Temporal discounting predicts risk sensitivity in rhesus macaques. Curr. Biol. 17, 49-53. doi: 10.1016/j.cub.2006.10.055
36. Howland, E. J., Turchi, J., and Murray, E. A. (2011). "Devaluation of a reinforcer is differentially processed by discrete subregions of orbital prefrontal cortex in rhesus monkeys," in Society for Neuroscience Abstracts, Program No. 405.04, 2011 Neuroscience Meeting Planner (Washington, DC: Society for Neuroscience). [Online].
37. Izquierdo, A., and Murray, E. A. (2007). Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J. Neurosci. 27, 1054-1062. doi: 10.1523/JNEUROSCI.3616-06.2007
38. Izquierdo, A., and Murray, E. A. (2010). Functional interaction of medial mediodorsal thalamic nucleus but not nucleus accumbens with amygdala and orbital prefrontal cortex is essential for adaptive response selection after reinforcer devaluation. J. Neurosci. 30, 661-669. doi: 10.1523/JNEUROSCI.3795-09.2010
39. Izquierdo, A., Suda, R. K., and Murray, E. A. (2004). Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24, 7540-7548. doi: 10.1523/JNEUROSCI.1921-04.2004
40. Johnson, A. W., Gallagher, M., and Holland, P. C. (2009). The basolateral amygdala is critical to the expression of pavlovian and instrumental outcome-specific reinforcer devaluation effects. J. Neurosci. 29, 696-704. doi: 10.1523/JNEUROSCI.3758-08.2009
41. Jones, J. L., Esber, G. R., McDannald, M. A., Gruber, A. J., Hernandez, A., Mirenzi, A., et al. (2012). Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338, 953-956. doi: 10.1126/science.1227489
42. Kennerley, S. W., Dahmubed, A. F., Lara, A. H., and Wallis, J. D. (2009). Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21, 1162-1178. doi: 10.1162/jocn.2009.21100
43. Kennerley, S. W., and Wallis, J. D. (2009). Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J. Neurophysiol. 102, 3352-3364. doi: 10.1152/jn.00273.2009
44. Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J., and Rushworth, M. F. (2006). Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9, 940-947. doi: 10.1038/nn1724
45. Kim, S., Hwang, J., and Lee, D. (2008). Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59, 161-172. doi: 10.1016/j.neuron.2008.05.010
46. Kringelbach, M. L., O'Doherty, J., Rolls, E. T., and Andrews, C. (2003). Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb. Cortex 13, 1064-1071. doi: 10.1093/cercor/13.10.1064
47. Leathers, M. L., and Olson, C. R. (2012). In monkeys making value-based decisions, LIP neurons encode cue salience and not action value. Science 338, 132-135. doi: 10.1126/science.1226405
48. Luk, C. H., and Wallis, J. D. (2013). Choice coding in frontal cortex during stimulus-guided or action-guided decision-making. J. Neurosci. 33, 1864-1871. doi: 10.1523/JNEUROSCI.4920-12.2013
49. Machado, C. J., and Bachevalier, J. (2007). The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates. Eur. J. Neurosci. 25, 2885-2904. doi: 10.1111/j.1460-9568.2007.05525.x
50. Malkova, L., Gaffan, D., and Murray, E. A. (1997). Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J. Neurosci. 17, 6011-6020.
51. McDannald, M. A., Lucantonio, F., Burke, K. A., Niv, Y., and Schoenbaum, G. (2011). Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. J. Neurosci. 31, 2700-2705. doi: 10.1523/JNEUROSCI.5499-10.2011
52. Mitchell, A. S., Browning, P. G., and Baxter, M. G. (2007). Neurotoxic lesions of the medial mediodorsal nucleus of the thalamus disrupt reinforcer devaluation effects in rhesus monkeys. J. Neurosci. 27, 11289-11295. doi: 10.1523/JNEUROSCI.1914-07.2007
53. Morecraft, R. J., Geula, C., and Mesulam, M. M. (1992). Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey. J. Comp. Neurol. 323, 341-358. doi: 10.1002/cne.903230304
54. Morecraft, R. J., McNeal, D. W., Stilwell-Morecraft, K. S., Gedney, M., Ge, J., Schroeder, C. M., et al. (2007). Amygdala interconnections with the cingulate motor cortex in the rhesus monkey. J. Comp. Neurol. 500, 134-165. doi: 10.1002/cne.21165
55. Morrison, S. E., and Salzman, C. D. (2009). The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29, 11471-11483. doi: 10.1523/JNEUROSCI.1815-09.2009
56. Morrison, S. E., and Salzman, C. D. (2011). Representations of appetitive and aversive information in the primate orbitofrontal cortex. Ann. N.Y. Acad. Sci. 1239, 59-70. doi: 10.1111/j.1749-6632.2011.06255.x
57. Murray, E. A., Gaffan, E. A., and Flint, R. W. Jr. (1996). Anterior rhinal cortex and amygdala: dissociation of their contributions to memory and food preference in rhesus monkeys. Behav. Neurosci. 110, 30-42. doi: 10.1037/0735-7044.110.1.30
58. Murray, E. A., and Wise, S. P. (2010). Interactions between orbital prefrontal cortex and amygdala: advanced cognition, learned responses and instinctive behaviors. Curr. Opin. Neurobiol. 20, 212-220. doi: 10.1016/j.conb.2010.02.001
59. Niki, H., and Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 171, 213-224. doi: 10.1016/0006-8993(79)90328-7
60. Noonan, M. P., Walton, M. E., Behrens, T. E., Sallet, J., Buckley, M. J., and Rushworth, M. F. (2010). Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 107, 20547-20552. doi: 10.1073/pnas.1012246107
61. O'Doherty, J., Rolls, E. T., Francis, S., Bowtell, R., McGlone, F., Kobal, G., et al. (2000). Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex. Neuroreport 11, 399-403. doi: 10.1097/00001756-200002070-00035
62. O'Leary, M. A., Bloch, J. I., Flynn, J. J., Gaudin, T. J., Giallombardo, A., Giannini, N. P., et al. (2013). The placental mammal ancestor and the post-K-Pg radiation of placentals. Science 339, 662-667. doi: 10.1126/science.1229237
63. O'Neill, M., and Schultz, W. (2010). Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68, 789-800. doi: 10.1016/j.neuron.2010.09.031
64. Ostlund, S. B., and Balleine, B. W. (2007). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci. 27, 4819-4825. doi: 10.1523/JNEUROSCI.5443-06.2007
65. Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226. doi: 10.1038/nature04676
66. Padoa-Schioppa, C., and Assad, J. A. (2008). The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11, 95-102. doi: 10.1038/nn2020
67. Passingham, R. E., and Wise, S. P. (2012). The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight. Oxford, UK: Oxford University Press.
68. Pastor-Bernier, A., and Cisek, P. (2011). Neural correlates of biased competition in premotor cortex. J. Neurosci. 31, 7083-7088. doi: 10.1523/JNEUROSCI.5681-10.2011
69. Paton, J. J., Belova, M. A., Morrison, S. E., and Salzman, C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865-870. doi: 10.1038/nature04490
70. Pearson, J. M., Hayden, B. Y., Raghavachari, S., and Platt, M. L. (2009). Neurons in posterior cingulate cortex signal exploratory decisions in a dynamic multioption choice task. Curr. Biol. 19, 1532-1537. doi: 10.1016/j.cub.2009.07.048
71. Porrino, L. J., Crane, A. M., and Goldman-Rakic, P. S. (1981). Direct and indirect pathways from the amygdala to the frontal lobe in rhesus monkeys. J. Comp. Neurol. 198, 121-136. doi: 10.1002/cne.901980111
72. Preuss, T. M., and Goldman-Rakic, P. S. (1987). Crossed corticothalamic and thalamocortical connections of macaque prefrontal cortex. J. Comp. Neurol. 257, 269-281. doi: 10.1002/cne.902570211
73. Preuss, T. M., and Goldman-Rakic, P. S. (1991). Myelo- and cytoarchitecture of the granular frontal cortex and surrounding regions in the strepsirhine primate Galago and the anthropoid primate Macaca. J. Comp. Neurol. 310, 429-474. doi: 10.1002/cne.903100402
74. Pritchard, T. C., Hamilton, R. B., Morse, J. R., and Norgren, R. (1986). Projections of thalamic gustatory and lingual areas in the monkey, Macaca fascicularis. J. Comp. Neurol. 244, 213-228. doi: 10.1002/cne.902440208
75. Ray, J. P., and Price, J. L. (1993). The organization of projections from the mediodorsal nucleus of the thalamus to orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 337, 1-31. doi: 10.1002/cne.903370102
76. Rhodes, S. E., Charles, D. P., Howland, E. J., and Murray, E. A. (2012). Amygdala lesions in rhesus monkeys fail to disrupt object choices based on internal context. Behav. Neurosci. 126, 270-278. doi: 10.1037/a0027229
77. Rhodes, S. E., and Murray, E. A. (2013). Differential effects of amygdala, orbital prefrontal cortex, and prelimbic cortex lesions on goal-directed behavior in rhesus macaques. J. Neurosci. 33, 3380-3389. doi: 10.1523/JNEUROSCI.4374-12.2013
78. Roesch, M. R., and Olson, C. R. (2004). Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304, 307-310. doi: 10.1126/science.1093223
79. Rolls, E. T., Murzi, E., Yaxley, S., Thorpe, S. J., and Simpson, S. J. (1986). Sensory-specific satiety: food-specific reduction in responsiveness of ventral forebrain neurons after feeding in the monkey. Brain Res. 368, 79-86. doi: 10.1016/0006-8993(86)91044-9
80. Rolls, E. T., Sienkiewicz, Z. J., and Yaxley, S. (1989). Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Eur. J. Neurosci. 1, 53-60. doi: 10.1111/j.1460-9568.1989.tb00774.x
81. Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., et al. (2008). Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci. 28, 13775-13785. doi: 10.1523/JNEUROSCI.3541-08.2008
82. Rudebeck, P. H., and Murray, E. A. (2011). Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J. Neurosci. 31, 10569-10578. doi: 10.1523/JNEUROSCI.0091-11.2011
83. Rushworth, M. F., Noonan, M. P., Boorman, E. D., Walton, M. E., and Behrens, T. E. (2011). Frontal cortex and reward-guided learning and decision-making. Neuron 70, 1054-1069. doi: 10.1016/j.neuron.2011.05.014
84. Russchen, F. T., Amaral, D. G., and Price, J. L. (1987). The afferent input to the magnocellular division of the mediodorsal thalamic nucleus in the monkey, Macaca fascicularis. J. Comp. Neurol. 256, 175-210. doi: 10.1002/cne.902560202
85. Russchen, F. T., Bakst, I., Amaral, D. G., and Price, J. L. (1985). The amygdalostriatal projections in the monkey. An anterograde tracing study. Brain Res. 329, 241-257. doi: 10.1016/0006-8993(85)90530-X
86. Saleem, K. S., Kondo, H., and Price, J. L. (2008). Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J. Comp. Neurol. 506, 659-693. doi: 10.1002/cne.21577
87. Sanghera, M. K., Rolls, E. T., and Roper-Hall, A. (1979). Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp. Neurol. 63, 610-626. doi: 10.1016/0014-4886(79)90175-4
88. Seo, H., and Lee, D. (2009). Behavioral and neural changes after gains and losses of conditioned reinforcers. J. Neurosci. 29, 3627-3641. doi: 10.1523/JNEUROSCI.4726-08.2009
89. Small, D. M., Zatorre, R. J., Dagher, A., Evans, A. C., and Jones-Gotman, M. (2001). Changes in brain activity related to eating chocolate: from pleasure to aversion. Brain 124, 1720-1733. doi: 10.1093/brain/124.9.1720
90. Sugase-Miyamoto, Y., and Richmond, B. J. (2005). Neuronal signals in the monkey basolateral amygdala during reward schedules. J. Neurosci. 25, 11071-11083. doi: 10.1523/JNEUROSCI.1796-05.2005
91. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787. doi: 10.1126/science.1094765
92. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
93. Tachibana, Y., and Hikosaka, O. (2012). The primate ventral pallidum encodes expected reward value and regulates motor action. Neuron 76, 826-837. doi: 10.1016/j.neuron.2012.09.030
94. Takahara, D., Inoue, K., Hirata, Y., Miyachi, S., Nambu, A., Takada, M., et al. (2012). Multisynaptic projections from the ventrolateral prefrontal cortex to the dorsal premotor cortex in macaques - anatomical substrate for conditional visuomotor behavior. Eur. J. Neurosci. 36, 3365-3375. doi: 10.1111/j.1460-9568.2012.08251.x
95. Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., et al. (2009). The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62, 269-280. doi: 10.1016/j.neuron.2009.03.005
96. Thorpe, S. J., Rolls, E. T., and Maddison, S. (1983). The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49, 93-115. doi: 10.1007/BF00235545
97. Tremblay, L., and Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708. doi: 10.1038/19525
98. Van Hoesen, G. W., Morecraft, B. A., and Vogt, B. A. (1993). "Connections of the monkey cingulate cortex," in Neurobiology of the Cingulate Cortex and Limbic Thalamus, eds B. A. Vogt and M. Gabriel (Boston, MA: Birkhauser), 249-284.
99. Wallis, J. D., and Miller, E. K. (2003). Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18, 2069-2081. doi: 10.1046/j.1460-9568.2003.02922.x
100. Walton, M. E., Behrens, T. E., Buckley, M. J., Rudebeck, P. H., and Rushworth, M. F. (2010). Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927-939. doi: 10.1016/j.neuron.2010.02.027
101. Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P., and Rushworth, M. F. (2006). Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw. 19, 1302-1314. doi: 10.1016/j.neunet.2006.03.005
102. Wellman, L. L., Gale, K., and Malkova, L. (2005). GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. J. Neurosci. 25, 4577-4586. doi: 10.1523/JNEUROSCI.2257-04.2005
103. West, E. A., Desjardin, J. T., Gale, K., and Malkova, L. (2011). Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques. J. Neurosci. 31, 15128-15135. doi: 10.1523/JNEUROSCI.3295-11.2011
104. Yang, T., and Shadlen, M. N. (2007). Probabilistic reasoning by neurons. Nature 447, 1075-1080. doi: 10.1038/nature05852
105. Yeterian, E. H., and Van Hoesen, G. W. (1978). Cortico-striate projections in the rhesus monkey: the organization of certain cortico-caudate connections. Brain Res. 139, 43-63. doi: 10.1016/0006-8993(78)90059-8