Double dissociation of value computations in orbitofrontal and anterior cingulate neurons

Nature Neuroscience

Volumn 14, Issue 12, 2011, Pages 1581-1589

  Kennerley, Steven W ^a,b   Behrens, Timothy E J ^a,c   Wallis, Jonathan D ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL ERROR; ANTERIOR CINGULATE; ARTICLE; CELL POPULATION; DECISION MAKING; DISSOCIATION; FRONTAL CORTEX; MATHEMATICAL COMPUTING; NERVE CELL; ORBITAL CORTEX; PRIORITY JOURNAL;

ANIMALS; BRAIN MAPPING; COMPUTER SIMULATION; DECISION MAKING; GYRUS CINGULI; MACACA MULATTA; MALE; MODELS, NEUROLOGICAL; NEURONS; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; PREFRONTAL CORTEX; PROBABILITY; REACTION TIME; REWARD;

EID: 82255179150     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.2961     Document Type: Article

References (50)

1. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J. & Rushworth, M.F. Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9, 940-947 (2006). (Pubitemid 43980509)
2. Rudebeck, P.H. et al. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci. 28, 13775-13785 (2008).
3. Walton, M.E., Behrens, T.E., Buckley, M.J., Rudebeck, P.H. & Rushworth, M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927-939 (2010).
4. Buckley, M.J. et al. Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science 325, 52-58 (2009).
5. Noonan, M.P. et al. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 107, 20547-20552 (2010).
6. Fellows, L.K. Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain 129, 944-952 (2006).
7. Williams, Z.M., Bush, G., Rauch, S.L., Cosgrove, G.R. & Eskandar, E.N. Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat. Neurosci. 7, 1370-1375 (2004). (Pubitemid 41057760)
8. Bechara, A., Damasio, A.R., Damasio, H. & Anderson, S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7-15 (1994).
9. Walton, M.E., Devlin, J.T. & Rushworth, M.F. Interactions between decision making and performance monitoring within prefrontal cortex. Nat. Neurosci. 7, 1259-1265 (2004). (Pubitemid 39426246)
10. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B. & Dolan, R.J. Cortical substrates for exploratory decisions in humans. Nature 441, 876-879 (2006).
11. Prévost, C., Pessiglione, M., Metereau, E., Clery-Melin, M.L. & Dreher, J.C. Separate valuation subsystems for delay and effort decision costs. J. Neurosci. 30, 14080-14090 (2010).
12. Rushworth, M.F. & Behrens, T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11, 389-397 (2008). (Pubitemid 351441881)
13. Padoa-Schioppa, C. & Assad, J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226 (2006).
14. Tremblay, L. & Schultz, W. Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708 (1999). (Pubitemid 29197648)
15. Kennerley, S.W., Dahmubed, A.F., Lara, A.H. & Wallis, J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21, 1162-1178 (2009).
16. Roesch, M.R. & Olson, C.R. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. J. Neurophysiol. 90, 1766-1789 (2003). (Pubitemid 37129385)
17. O'Neill, M. & Schultz, W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68, 789-800 (2010).
18. Seo, H. & Lee, D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J. Neurosci. 29, 3627-3641 (2009).
19. Seo, H. & Lee, D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci. 27, 8366-8377 (2007). (Pubitemid 47219624)
20. Wallis, J.D. & Miller, E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18, 2069-2081 (2003). (Pubitemid 37372389)
21. Kennerley, S.W. & Wallis, J.D. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J. Neurophysiol. 102, 3352-3364 (2009).
22. Kim, S., Hwang, J. & Lee, D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59, 161-172 (2008). (Pubitemid 351905851)
23. Morrison, S.E. & Salzman, C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29, 11471-11483 (2009).
24. Sallet, J. et al. Expectations, gains, and losses in the anterior cingulate cortex. Cogn. Affect. Behav. Neurosci. 7, 327-336 (2007).
25. Kennerley, S.W. & Wallis, J.D. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci. 29, 2061-2073 (2009).
26. Takahashi, Y.K. et al. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62, 269-280 (2009).
27. Wallis, J.D. & Kennerley, S.W. Heterogeneous reward signals in prefrontal cortex. Curr. Opin. Neurobiol. 20, 191-198 (2010).
28. Rangel, A., Camerer, C. & Montague, P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556 (2008). (Pubitemid 351873461)
29. Padoa-Schioppa, C. Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29, 14004-14014 (2009).
30. Kobayashi, S., Pinto de Carvalho, O. & Schultz, W. Adaptation of reward sensitivity in orbitofrontal neurons. J. Neurosci. 30, 534-544 (2010).
31. Machens, C.K., Romo, R. & Brody, C.D. Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science 307, 1121-1124 (2005). (Pubitemid 40262120)
32. Fiorillo, C.D., Tobler, P.N. & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902 (2003). (Pubitemid 36356659)
33. Matsumoto, M. & Hikosaka, O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841 (2009).
34. Tobler, P.N., Fiorillo, C.D. & Schultz, W. Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645 (2005). (Pubitemid 40354749)
35. Cai, X., Kim, S. & Lee, D. Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69, 170-182 (2011).
36. Holroyd, C.B. & Coles, M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709 (2002).
37. Debener, S. et al. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 25, 11730-11737 (2005). (Pubitemid 43098465)
38. Platt, M.L. & Glimcher, P.W. Neural correlates of decision variables in parietal cortex. Nature 400, 233-238 (1999). (Pubitemid 29334132)
39. Shuler, M.G. & Bear, M.F. Reward timing in the primary visual cortex. Science 311, 1606-1609 (2006).
40. Matsumoto, M., Matsumoto, K., Abe, H. & Tanaka, K. Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci. 10, 647-656 (2007). (Pubitemid 46652446)
41. Amiez, C., Joseph, J.P. & Procyk, E. Anterior cingulate error-related activity is modulated by predicted reward. Eur. J. Neurosci. 21, 3447-3452 (2005). (Pubitemid 40961439)
42. Sul, J.H., Kim, H., Huh, N., Lee, D. & Jung, M.W. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66, 449-460 (2010).
43. Bayer, H.M. & Glimcher, P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141 (2005). (Pubitemid 40922855)
44. Oliveira, F.T., McDonald, J.J. & Goodman, D. Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J. Cogn. Neurosci. 19, 1994-2004 (2007). (Pubitemid 350220511)
45. Jessup, R.K., Busemeyer, J.R. & Brown, J.W. Error effects in anterior cingulate cortex reverse when error likelihood is high. J. Neurosci. 30, 3467-3472 (2010).
46. Jocham, G., Neumann, J., Klein, T.A., Danielmeier, C. & Ullsperger, M. Adaptive coding of action values in the human rostral cingulate zone. J. Neurosci. 29, 7489-7496 (2009).
47. Behrens, T.E., Woolrich, M.W., Walton, M.E. & Rushworth, M.F. Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221 (2007). (Pubitemid 47339952)
48. Montague, P.R. & Berns, G.S. Neural economics and the biological substrates of valuation. Neuron 36, 265-284 (2002). (Pubitemid 35217891)
49. Bernacchia, A., Seo, H., Lee, D. & Wang, X.J. A reservoir of time constants for memory traces in cortical neurons. Nat. Neurosci. 14, 366-372 (2011).
50. Padoa-Schioppa, C. & Assad, J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11, 95-102 (2008).