Heterogeneous reward signals in prefrontal cortex

Current Opinion in Neurobiology

Volumn 20, Issue 2, 2010, Pages 191-198

  Wallis, Jonathan D ^a   Kennerley, Steven W ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTION; COGNITION; DECISION MAKING; FRONTAL CORTEX; HUMAN; LEARNING; NERVE CELL; NONHUMAN; ORBITAL CORTEX; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; SIGNAL TRANSDUCTION; STIMULUS RESPONSE;

ANIMALS; ATTENTION; COGNITION; DECISION MAKING; EXECUTIVE FUNCTION; HUMANS; LEARNING; NERVE NET; NEURONS; PREFRONTAL CORTEX; REWARD;

EID: 77952473081     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2010.02.009     Document Type: Review

References (65)

1. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res 1983, 49:93-115.
2. Eslinger P.J., Damasio A.R. Severe disturbance of higher cognition after bilateral frontal lobe ablation: patient EVR. Neurology 1985, 35:1731-1741.
3. Fellows L.K., Farah M.J. The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se?. Cereb Cortex 2007, 17:2669-2674.
4. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 1996, 382:629-632.
5. Matsumoto K., Suzuki W., Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 2003, 301:229-232.
6. Roesch M.R., Olson C.R. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. J Neurophysiol 2003, 90:1766-1789.
7. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
8. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 2008, 11:95-102.
9. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 2009, 29:14004-14014.
10. Wallis J.D. Orbitofrontal cortex and its contribution to decision-making. Annu Rev Neurosci 2007, 30:31-56.
11. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J Neurosci 2009, 29:11471-11483.
12. Roesch M.R., Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 2004, 304:307-310.
13. Roesch M.R., Olson C.R. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol 2005, 94:2457-2471.
14. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 2009, 21:1162-1178.
15. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
16. Burke K.A., Franz T.M., Miller D.N., Schoenbaum G. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 2008, 454:340-344.
17. Mainen Z.F., Kepecs A. Neural representation of behavioral outcomes in the orbitofrontal cortex. Curr Opin Neurobiol 2009, 19:84-91.
18. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res Brain Res Rev 1998, 28:309-369.
19. Kennerley S.W., Walton M.E., Behrens T.E., Buckley M.J., Rushworth M.F. Optimal decision making and the anterior cingulate cortex. Nat Neurosci 2006, 9:940-947.
20. Amiez C., Joseph J.P., Procyk E. Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 2006, 16:1040-1055.
21. Seo H., Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J Neurosci 2009, 29:3627-3641.
22. Quilodran R., Rothe M., Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 2008, 57:314-325.
23. Sallet J., Quilodran R., Rothe M., Vezoli J., Joseph J.P., Procyk E. Expectations, gains, and losses in the anterior cingulate cortex. Cogn Affect Behav Neurosci 2007, 7:327-336.
24. Luk C.H., Wallis J.D. Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. J Neurosci 2009, 29:7526-7539.
25. Fellows L.K. Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain 2006, 129:944-952.
26. Funahashi S., Bruce C.J., Goldman-Rakic P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 1989, 61:331-349.
27. Rao S.C., Rainer G., Miller E.K. Integration of what and where in the primate prefrontal cortex. Science 1997, 276:821-824.
28. Kennerley S.W., Wallis J.D. Reward-dependent modulation of working memory in lateral prefrontal cortex. J Neurosci 2009, 29:3259-3270.
29. Kennerley S.W., Wallis J.D. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J Neurophysiol 2009.
30. Pan X., Sawa K., Tsuda I., Tsukada M., Sakagami M. Reward prediction based on stimulus categorization in primate lateral prefrontal cortex. Nat Neurosci 2008, 11:703-712.
31. Hare T.A., Camerer C.F., Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 2009, 324:646-648.
32. Watanabe M. The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neurosci Lett 1989, 101:113-117.
33. Seo H., Barraclough D.J., Lee D. Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cereb Cortex 2007, 17(Suppl. 1):i110-i117.
34. Averbeck B.B., Lee D. Prefrontal neural correlates of memory for sequences. J Neurosci 2007, 27:2204-2211.
35. Histed M.H., Pasupathy A., Miller E.K. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 2009, 63:244-253.
36. Ongur D., An X., Price J.L. Prefrontal cortical projections to the hypothalamus in macaque monkeys. J Comp Neurol 1998, 401:480-505.
37. Carmichael S.T., Price J.L. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J Comp Neurol 1995, 363:615-641.
38. Williams S.M., Goldman-Rakic P.S. Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb Cortex 1993, 3:199-222.
39. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
40. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 1998, 80:1-27.
41. Carmichael S.T., Price J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 1995, 363:642-664.
42. Croxson P.L., Johansen-Berg H., Behrens T.E., Robson M.D., Pinsk M.A., Gross C.G., Richter W., Richter M.C., Kastner S., Rushworth M.F. Quantitative investigation of connections of the prefrontal cortex in the human and macaque using probabilistic diffusion tractography. J Neurosci 2005, 25:8854-8866.
43. Dum R.P., Strick P.L. Cingulate motor areas. Neurobiology of Cingulate Cortex and Limbic Thalamus: A Comprehensive Handbook 1993, 415-441. Birkhaeuser. B.A. Vogt, M. Gabriel (Eds.).
44. Cavada C., Company T., Tejedor J., Cruz-Rizzolo R.J., Reinoso-Suarez F. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb Cortex 2000, 10:220-242.
45. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 1998, 282:1335-1338.
46. Williams Z.M., Bush G., Rauch S.L., Cosgrove G.R., Eskandar E.N. Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat Neurosci 2004, 7:1370-1375.
47. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci 2003, 18:2069-2081.
48. Amiez C., Joseph J.P., Procyk E. Anterior cingulate error-related activity is modulated by predicted reward. Eur J Neurosci 2005, 21:3447-3452.
49. Seo H., Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci 2007, 27:8366-8377.
50. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nat Neurosci 2007, 10:1214-1221.
51. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
52. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., Rushworth M.F. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 2008, 28:13775-13785.
53. Walton M.E., Bannerman D.M., Rushworth M.F. The role of rat medial frontal cortex in effort-based decision making. J Neurosci 2002, 22:10996-11003.
54. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., Rushworth M.F. Separate neural pathways process different decision costs. Nat Neurosci 2006, 9:1161-1168.
55. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 2008, 9:545-556.
56. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 2008, 28:5623-5630.
57. Matsumoto M., Matsumoto K., Abe H., Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 2007, 10:647-656.
58. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat Neurosci 2007, 10:1625-1633.
59. Ballard K., Knutson B. Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 2009, 45:143-150.
60. Glascher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 2008.
61. FitzGerald T.H., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 2009, 29:8388-8395.
62. Tsujimoto S., Genovesio A., Wise S.P. Evaluating self-generated decision in frontal pole cortex of monkeys. Nat Neurosci. 2010, 13:120-126.
63. Carmichael S.T., Price J.L. Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. J Comp Neurol 1994, 346:366-402.
64. Ongur D., Ferry A.T., Price J.L. Architectonic subdivision of the human orbital and medial prefrontal cortex. J Comp Neurol 2003, 460:425-449.
65. Wise S.P. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci 2008, 31:599-608.