The orbitofrontal cortex, predicted value, and choice

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 43-50

  Balleine, Bernard W ^a   Leung, Beatrice K ^a   Ostlund, Sean B ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Basal ganglia; Decision making; Reward

Indexed keywords

AMYGDALOID NUCLEUS; ARTICLE; BRAIN DEPTH STIMULATION; CORPUS STRIATUM; DECISION MAKING; LEARNING; NONHUMAN; ORBITAL CORTEX; PAVLOVIAN STIMULUS; PREDICTION; REWARD;

EID: 83155184723     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06270.x     Document Type: Article

References (54)

1. Balleine, B.W. & A. Dickinson. 1998. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
2. Walton, M.E., S.W. Kennerley, D.M. Bannerman, et al. 2006. Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw. 19: 1302-1314.
3. Cardinal, R.N., D.R. Pennicott, C.L. Sugathapala, et al. 2001. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292: 2499-2501.
4. Dickinson, A. & B.W. Balleine. 1994. Motivational control of goal-directed action. Anim. Learn. Behav. 22: 1-18.
5. Dickinson, A. & B.W. Balleine. 2002. In Learning, Motivation & Emotion. Vol. 3 of Steven's Handbook of Experimental Psychology, Third Ed. C.R. Gallistel, Ed.: 497-533. John Wiley & Sons. New York.
6. Balleine, B.W., N.D. Daw & J. O'Doherty. 2008. In Neuroeconomics: Decision making and the brain. P. Glimcher, C. Camerer, E. Fehr, & R. Poldrack, Eds.: Ch. 24, 367-387. Academic Press. New York.
7. Bolles, R.C. 1972. Reinforcement, expectancy, and learning. Psychol. Rev. 79: 394-409.
8. Bindra, D. 1968. A neuropsychological interpretation of the effects of drive and incentive motivation on general activity and instrumental behavior. Psychol. Rev. 75: 1-22.
9. Rescorla, R.A. & R.L. Solomon. 1967. Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol. Rev. 74: 151-182.
10. Trapold, M.A. & J.B. Overmier. 1972. In Classical Conditioning: II. Current Research and Theory. A.A. Black & W.F. Prokasy, Eds.: 427-452. Appleton-Century-Crofts. New York.
11. Balleine, B.W. 2001. In Handbook of Contemporary Learning Theories. R. Mowrer & S. Klein, Eds.: 307-366. LEA. Georgia.
12. Bindra, D. 1974. A motivational view of learning, performance, and behavior modification. Psych. Rev. 81: 199-213.
13. Bindra, D. 1969. A unified interpretation of emotion and motivation. Ann. N.Y. Acad. Sci. 159: 1071-1083.
14. Glickman, S.E. & B.B. Schiff. 1967. A biological theory of reinforcement. Psychol. Rev. 74: 81-109.
15. Balleine, B.W., A.S. Killcross & A. Dickinson. 2003. The effect of lesions of the basolateral amygdala on instrumental conditioning. J. Neurosci. 23: 666-675.
16. Corbit, L.H. & B.W. Balleine. 2005. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25: 962-970.
17. Sah, P., E.S. Faber, M. Lopez De Armentia & J. Power. 2003. The amygdaloid complex: anatomy and physiology. Physiol. Rev. 83: 803-834.
18. Hatfield, T., J.S. Han, M. Conley, et al. 1996. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J. Neurosci. 16: 5256-5265.
19. Blundell, P., G. Hall & S. Killcross. 2001. Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. J Neurosci. 21: 9018-9026.
20. Balleine, B.W. & S. Killcross. 2006. Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci. 29: 272-279.
21. Corbit, L.H. & B.W. Balleine. 2003. The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res. 146: 145-157.
22. Rudebeck, P. H. et al. 2008. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci. 28: 13775-13785.
23. Rushworth, M.F., M.P. Noonan, E.D. Boorman, et al. 2011. Frontal cortex and reward-guided learning and decision-making. Neuron 70: 1054-1069.
24. Mar, A.C., A.L. Walker, D.E. Theobald, et al. 2011. Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J. Neurosci. 31: 6398-6404.
25. Gourley, S.L. et al. 2010. Dissociable regulation of instrumental action within mouse prefrontal cortex. Eur. J. Neurosci.32: 1726-1734.
26. Ongür, D. & J.L. Price. 2000. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex 10: 206-219.
27. Schoenbaum, G., M.R. Roesch, T.A. Stalnaker & Y.K. Takahashi. 2009. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10: 885-892.
28. Schoenbaum, G., A.A. Chiba & M. Gallagher. 1998. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1: 155-159.
29. Gallagher, M., R.W. McMahan & G. Schoenbaum. 1999. Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci. 19: 6610-6614.
30. Ostlund, S. & B.W. Balleine. 2007. The contribution of orbitofrontal cortex to action selection. Ann. N.Y. Acad. Sci. 1121: 174-192.
31. Ostlund, S.B. & B.W. Balleine. 2007. Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci. 27: 4819-4825.
32. Rescorla, R.A. 1994. Transfer of instrumental control mediated by a devalued outcome. Anim. Learn. Behav. 22: 27-33.
33. Corbit, L.H. & B.W. Balleine. 2003. Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain. J. Exp. Psychol. Anim. Behav. Process 29: 99-106.
34. Holland, P.C. 2004. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process 30: 104-117.
35. Ostlund, S.B. & B.W. Balleine. 2007. Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn. Behav. 35: 43-52.
36. Corbit, L.H., J.L. Muir & B.W. Balleine. 2001. The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci. 21: 3251-3260.
37. Alheid, G.F. 2003. Extended amygdala and basal forebrain. Ann. N.Y. Acad. Sci. 985: 185-205.
38. Shiflett, M.W. & B.W. Balleine. 2010. At the limbic-motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation. Eur. J. Neurosci. 32: 1735-1743.
39. Krettek, J.E. & J.L. Price. 1977. Projections from the amygdaloid complex to the cerebral cortex and thalamus in the rat and cat. J. Compar. Neurol. 172: 687-722.
40. McDonald, A.J. 1991. Organization of amygdaloid projections to the prefrontal cortex and associated striatum in the rat. Neurosci. 44: 1-14.
41. Pickens, C.L., M.P. Saddoris, M. Gallagher & P. C. Holland. 2005. Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav.Neurosci.119: 317-322.
42. Schoenbaum, G., B. Setlow, S.L. Nugent, et al. 2003. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn. Memory 10: 129-140.
43. Burke, K.A., T.M. Franz, D.N. Miller & G. Schoenbaum. 2008. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454: 340-344.
44. van Duuren, E. et al. 2009. Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J. Neurosci. 29: 8965-8976.
45. Padoa-Schioppa, C. 2009. Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29: 14004-14014.
46. Schoenbaum, G., A.A. Chiba & M. Gallagher. 2000. Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training. J. Neurosci. 20: 5179-5189.
47. Rolls, E.T. 2000. The orbitofrontal cortex and reward. Cerebral Cortex 10: 284-294.
48. Chudasama, Y. & T.W. Robbins. 2003. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci. 23: 8771-8780.
49. Ostlund, S.B. & B.W. Balleine. 2008. Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J. Neurosci. 28: 4398-4405.
50. Paton, J.J., M.A. Belova, S.E. Morrison & C.D. Salzman. 2006. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870.
51. Stalnaker, T.A., M.R. Roesch, T.M. Franz, et al. 2006. Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making. Eur.J. Neurosci. 24: 2643-2653.
52. Schoenbaum, G., B. Setlow, M.P. Saddoris & M. Gallagher. 2003. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39: 855-867
53. Stalnaker, T.A., T.M. Franz, T. Singh & G. Schoenbaum. 2007. Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54: 51-58.
54. Paxinos, G. & C. Watson. 1998. The Rat Brain in Stereotaxic Coordinates. Academic Press. New York.