Evaluating choices by single neurons in the frontal lobe: Outcome value encoded across multiple decision variables

European Journal of Neuroscience

Volumn 29, Issue 10, 2009, Pages 2061-2073

  Kennerley, Steven W ^a   Wallis, Jonathan D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Anterior cingulate cortex; Decision making; Orbitofrontal cortex; Prefrontal cortex; Reward

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; CINGULATE GYRUS; CONTROLLED STUDY; COST EFFECTIVENESS ANALYSIS; DECISION MAKING; FRONTAL CORTEX; NERVE CELL; NERVE CONDUCTION; NONHUMAN; ORBITAL CORTEX; OUTCOME ASSESSMENT; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROBABILITY; REWARD; TASK PERFORMANCE;

ANIMALS; CHOICE BEHAVIOR; ELECTRODES, IMPLANTED; FRONTAL LOBE; MACACA MULATTA; MICROELECTRODES; NEURONS; REWARD;

EID: 65749112745     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2009.06743.x     Document Type: Article

References (63)

1. Amiez, C., Joseph, J.P. Procyk, E. (2005) Anterior cingulate error-related activity is modulated by predicted reward. Eur. J. Neurosci., 21, 3447 3452. (Pubitemid 40961439)
2. Amiez, C., Joseph, J.P. Procyk, E. (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb. Cortex, 16, 1040 1055. (Pubitemid 43992453)
3. Bautista, L.M., Tinbergen, J. Kacelnik, A. (2001) To walk or to fly? How birds choose among foraging modes. Proc. Natl Acad. Sci. USA, 98, 1089 1094. (Pubitemid 32121191)
4. Bayer, H.M. Glimcher, P.W. (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129 141. (Pubitemid 40922855)
5. Bechara, A., Damasio, A.R., Damasio, H. Anderson, S.W. (1994) Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7 15.
6. Behrens, T.E., Woolrich, M.W., Walton, M.E. Rushworth, M.F. (2007) Learning the value of information in an uncertain world. Nat. Neurosci., 10, 1214 1221. (Pubitemid 47339952)
7. Carmichael, S.T. Price, J.L. (1995) Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol., 363, 642 664. (Pubitemid 26028726)
8. Debener, S., Ullsperger, M., Siegel, M., Fiehler, K., von Cramon, D.Y. Engel, A.K. (2005) Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci., 25, 11730 11737. (Pubitemid 43098465)
9. Dum, R.P. Strick, P.L. (1993) Cingulate Motor Areas. In Vogt, B.A. Gabriel, M. (Eds Neurobiology of Cingulate Cortex and Limbic Thalamus: A Comprehensive Handbook. Birkhaeuser, Cambridge, MA, pp. 415 441.
10. Falkenstein, M., Hohnsbein, J., Hoormann, J. Blanke, L. (1991) Effects of crossmodal divided attention on late ERP components II. Error processing in choice reaction tasks. Electroencephalogr. Clin. Neurophysiol., 78, 447 455.
11. Fellows, L.K. (2006) Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain, 129, 944 952.
12. Fiorillo, C.D., Tobler, P.N. Schultz, W. (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898 1902. (Pubitemid 36356659)
13. Gehring, W.J. Knight, R.T. (2000) Prefrontal-cingulate interactions in action monitoring. Nat. Neurosci., 3, 516 520. (Pubitemid 30495636)
14. Gehring, W.J., Goss, B., Coles, M.G. Meyer, D.E. (1993) A neural system for error detection and compensation. Psychol. Sci., 4, 385 390.
15. Hadland, K.A., Rushworth, M.F., Gaffan, D. Passingham, R.E. (2003) The anterior cingulate and reward-guided selection of actions. J. Neurophysiol., 89, 1161 1164. (Pubitemid 36206159)
16. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W. Rangel, A. (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci., 28, 5623 5630.
17. Hikosaka, K. Watanabe, M. (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb. Cortex, 10, 263 271. (Pubitemid 30159293)
18. Ito, S., Stuphorn, V., Brown, J.W. Schall, J.D. (2003) Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science, 302, 120 122. (Pubitemid 37210702)
19. Kahneman, D. Tversky, A. (1979) Prospect theory: an analysis of decision under risk. Econometrica, 47, 263 291.
20. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J. Rushworth, M.F. (2006) Optimal decision making and the anterior cingulate cortex. Nat. Neurosci., 9, 940 947. (Pubitemid 43980509)
21. Kennerley, S.W., Dahmubed, A.F., Lara, A.H. Wallis, J.D. (2009) Neurons in the frontal lobe encode the value of multiple decision vairables. J. Cogn. Neurosci., 21, 1162 1178.
22. Knutson, B., Taylor, J., Kaufman, M., Peterson, R. Glover, G. (2005) Distributed neural representation of expected value. J. Neurosci., 25, 4806 4812. (Pubitemid 40664129)
23. Matsumoto, K., Suzuki, W. Tanaka, K. (2003) Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science, 301, 229 232. (Pubitemid 36858478)
24. Matsumoto, M., Matsumoto, K., Abe, H. Tanaka, K. (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci., 10, 647 656. (Pubitemid 46652446)
25. McClure, S.M., Berns, G.S. Montague, P.R. (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron, 38, 339 346. (Pubitemid 36555658)
26. Mesulam, M.M. Mufson, E.J. (1982) Insula of the old world monkey III: efferent cortical output and comments on function. J. Comp. Neurol., 212, 38 52. (Pubitemid 13208308)
27. Montague, P.R., King-Casas, B. Cohen, J.D. (2006) Imaging valuation models in human choice. Annu. Rev. Neurosci., 29, 417 448. (Pubitemid 44476852)
28. Morris, G., Nevet, A., Arkadir, D., Vaadia, E. Bergman, H. (2006) Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci., 9, 1057 1063. (Pubitemid 44264919)
29. Murray, E.A., O'Doherty, J.P. Schoenbaum, G. (2007) What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J. Neurosci., 27, 8166 8169. (Pubitemid 47219598)
30. Niki, H. Watanabe, M. (1979) Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res., 171, 213 224. (Pubitemid 10246665)
31. O'Doherty, J., Kringelbach, M.L., Rolls, E.T., Hornak, J. Andrews, C. (2001) Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci., 4, 95 102. (Pubitemid 32095532)
32. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H. Dolan, R.J. (2003) Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329 337. (Pubitemid 36555657)
33. Padoa-Schioppa, C. Assad, J.A. (2006) Neurons in the orbitofrontal cortex encode economic value. Nature, 441, 223 226.
34. Petrides, M. Pandya, D.N. (1999) Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur. J. Neurosci., 11, 1011 1036. (Pubitemid 29106062)
35. Procyk, E., Tanaka, Y.L. Joseph, J.P. (2000) Anterior cingulate activity during routine and non-routine sequential behaviors in macaques. Nat. Neurosci., 3, 502 508. (Pubitemid 30495634)
36. Rangel, A., Camerer, C. Montague, P.R. (2008) A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci., 9, 545 556.
37. Roesch, M.R., Taylor, A.R. Schoenbaum, G. (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron, 51, 509 520. (Pubitemid 44189799)
38. Roesch, M.R., Calu, D.J. Schoenbaum, G. (2007) Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci., 10, 1615 1624. (Pubitemid 350175882)
39. Rolls, E.T. (2000) The orbitofrontal cortex and reward. Cereb. Cortex, 10, 284 294. (Pubitemid 30159295)
40. Rolls, E.T., McCabe, C. Redoute, J. (2008) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex, 18, 652 663.
41. Rudebeck, P.H., Buckley, M.J., Walton, M.E. Rushworth, M.F. (2006a) A role for the macaque anterior cingulate gyrus in social valuation. Science, 313, 1310 1312. (Pubitemid 44330959)
42. Rudebeck, P.H., Walton, M.E., Smyth, A.N., Bannerman, D.M. Rushworth, M.F. (2006b) Separate neural pathways process different decision costs. Nat. Neurosci., 9, 1161 1168. (Pubitemid 44306310)
43. Rudebeck, P.H., Behrens, T.E., Kennerley, S.W., Baxter, M.G., Buckley, M.J., Walton, M.E. Rushworth, M.F. (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci., 28, 13775 13785.
44. Rushworth, M.F. Behrens, T.E. (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci., 11, 389 397.
45. Rushworth, M.F., Walton, M.E., Kennerley, S.W. Bannerman, D.M. (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn. Sci., 8, 410 417. (Pubitemid 39179904)
46. Sallet, J., Quilodran, R., Rothe, M., Vezoli, J., Joseph, J.P. Procyk, E. (2007) Expectations, gains, and losses in the anterior cingulate cortex. Cogn. Affect. Behav. Neurosci., 7, 327 336.
47. Satoh, T., Nakai, S., Sato, T. Kimura, M. (2003) Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci., 23, 9913 9923. (Pubitemid 37371606)
48. Schultz, W. (1998) Predictive reward signal of dopamine neurons. J. Neurophysiol., 80, 1 27. (Pubitemid 28326237)
49. Seo, H. Lee, D. (2007) Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci., 27, 8366 8377. (Pubitemid 47219624)
50. Shidara, M. Richmond, B.J. (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science, 296, 1709 1711. (Pubitemid 34579174)
51. Shima, K. Tanji, J. (1998) Role for cingulate motor area cells in voluntary movement selection based on reward. Science, 282, 1335 1338. (Pubitemid 28524499)
52. Stephens, D.W. Krebs, J.R. (1986) Foraging Theory. Princeton University Press, Princeton.
53. Tobler, P.N., Fiorillo, C.D. Schultz, W. (2005) Adaptive coding of reward value by dopamine neurons. Science, 307, 1642 1645. (Pubitemid 40354749)
54. Tobler, P.N., O'Doherty J, P., Dolan, R.J. Schultz, W. (2006) Human neural learning depends on reward prediction errors in the blocking paradigm. J. Neurophysiol., 95, 301 310.
55. Tremblay, L. Schultz, W. (2000) Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol., 83, 1864 1876. (Pubitemid 30198643)
56. Turken, A.U. Swick, D. (2008) The effect of orbitofrontal lesions on the error-related negativity. Neurosci. Lett., 441, 7 10.
57. Ullsperger, M. von Cramon, D.Y. (2001) Subprocesses of performance monitoring: a dissociation of error processing and response competition revealed by event-related fMRI and ERPs. Neuroimage, 14, 1387 1401. (Pubitemid 33124186)
58. Ullsperger, M. von Cramon, D.Y. (2006) The role of intact frontostriatal circuits in error processing. J. Cogn. Neurosci., 18, 651 664. (Pubitemid 43763864)
59. Wallis, J.D. (2007) Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci., 30, 31 56. (Pubitemid 47218750)
60. Wallis, J.D. Miller, E.K. (2003) From rule to response: neuronal processes in the premotor and prefrontal cortex. J. Neurophysiol., 90, 1790 1806. (Pubitemid 37129386)
61. Walton, M.E., Devlin, J.T. Rushworth, M.F. (2004) Interactions between decision making and performance monitoring within prefrontal cortex. Nat. Neurosci., 7, 1259 1265. (Pubitemid 39426246)
62. Walton, M.E., Kennerley, S.W., Bannerman, D.M., Phillips, P.E. Rushworth, M.F. (2006) Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw., 19, 1302 1314. (Pubitemid 44466342)
63. Williams, S.M. Goldman-Rakic, P.S. (1993) Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb. Cortex, 3, 199 222. (Pubitemid 23184929)