Distributed Coding of Actual and Hypothetical Outcomes in the Orbital and Dorsolateral Prefrontal Cortex

Neuron

Volumn 70, Issue 4, 2011, Pages 731-741

  Abe, Hiroshi ^a   Lee, Daeyeol ^a,b  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b YALE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; GAME; LEARNING; MALE; NERVE CELL; NONHUMAN; ORBITAL CORTEX; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; RHESUS MONKEY; SIMULATION; TASK PERFORMANCE;

ANIMALS; CHOICE BEHAVIOR; FRONTAL LOBE; MACACA MULATTA; MALE; PHOTIC STIMULATION; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE;

EID: 79956220050     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2011.03.026     Document Type: Article

References (67)

1. Baddeley A. The episodic buffer: a new component of working memory?. Trends Cogn. Sci. 2000, 4:417-423.
2. Barraclough D.J., Conroy M.L., Lee D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 2004, 7:404-410.
3. Behrens T.E.J., Hunt L.T., Rushworth M.F.S. The computation of social behavior. Science 2009, 324:1160-1164.
4. Bentall R.P., Baker G.A., Havers S. Reality monitoring and psychotic hallucinations. Br. J. Clin. Psychol. 1991, 30:213-222.
5. Burglen F., Marczewski P., Mitchell K.J., van der Linden M., Johnson M.K., Danion J.-M., Salamé P. Impaired performance in a working memory binding task in patients with schizophrenia. Psychiatry Res. 2004, 125:247-255.
6. Camerer C.F. Behavioral Game Theory: Experiments in Strategic Interaction 2003, Princeton Univ. Press, Princeton, NJ.
7. Camille N., Coricelli G., Sallet J., Pradat-Diehl P., Duhamel J.R., Sirigu A. The involvement of the orbitofrontal cortex in the experience of regret. Science 2004, 304:1167-1170.
8. Chandrasekhar P.V.S., Capra C.M., Moore S., Noussair C., Berns G.S. Neurobiological regret and rejoice functions for aversive outcomes. Neuroimage 2008, 39:1472-1484.
9. Coricelli G., Critchley H.D., Joffily M., O'Doherty J.P., Sirigu A., Dolan R.J. Regret and its avoidance: a neuroimaging study of choice behavior. Nat. Neurosci. 2005, 8:1255-1262.
10. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
11. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
12. Fiser J., Aslin R.N. Unsupervised statistical learning of higher-order spatial structures from visual scenes. Psychol. Sci. 2001, 12:499-504.
13. Fujiwara J., Tobler P.N., Taira M., Iijima T., Tsutsui K. A parametric relief signal in human ventrolateral prefrontal cortex. Neuroimage 2009, 44:1163-1170.
14. Gallagher H.L., Frith C.D. Functional imaging of 'theory of mind'. Trends Cogn. Sci. 2003, 7:77-83.
15. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
16. Golomb J.D., Chun M.M., Mazer J.A. The native coordinate system of spatial attention is retinotopic. J. Neurosci. 2008, 28:10654-10662.
17. Gomez Beldarrain M., Garcia-Monco J.C., Astigarraga E., Gonzalez A., Grafman J. Only spontaneous counterfactual thinking is impaired in patients with prefrontal cortex lesions. Brain Res. Cogn. Brain Res. 2005, 24:723-726.
18. Graybiel A.M. Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 2008, 31:359-387.
19. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
20. Hayden B.Y., Platt M.L. Neurons in anterior cingulate cortex multiplex information about reward and action. J. Neurosci. 2010, 30:3339-3346.
21. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J. Neurophysiol. 2006, 95:567-584.
22. Hooker C., Roese N.J., Park S. Impoverished counterfactual thinking is associated with schizophrenia. Psychiatry 2000, 63:326-335.
23. Hornak J., O'Doherty J., Bramham J., Rolls E.T., Morris R.G., Bullock P.R., Polkey C.E. Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 2004, 16:463-478.
24. Ichihara-Takeda S., Funahashi S. Activity of primate orbitofrontal and dorsolateral prefrontal neurons: effect of reward schedule on task-related activity. J. Cogn. Neurosci. 2008, 20:563-579.
25. Izquierdo A., Suda R.K., Murray E.A. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 2004, 24:7540-7548.
26. Janowsky J.S., Shimamura A.P., Squire L.R. Source memory impairment in patients with frontal lobe lesions. Neuropsychologia 1989, 27:1043-1056.
27. Kahneman D., Miller D.T. Norm theory: comparing reality to its alternatives. Psychol. Rev. 1986, 93:136-153.
28. Kennerley S.W., Wallis J.D. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci. 2009, 29:2061-2073.
29. Kim H., Sul J.H., Huh N., Lee D., Jung M.W. Role of striatum in updating values of chosen actions. J. Neurosci. 2009, 29:14701-14712.
30. Knight R.T., Grabowecky M. Escape from linear time: prefrontal cortex and conscious experience. The Cognitive Neuroscience 1995, 1357-1371. MIT Press, Cambridge, MA. M.S. Gazzaniga (Ed.).
31. Kutner M.H., Nachtsheim C.J., Neter J., Li W. Applied Linear Statistical Models 2005, Mcgraw-Hill, New York.
32. Lee D. Game theory and neural basis of social decision making. Nat. Neurosci. 2008, 11:404-409.
33. Lee D., Conroy M.L., Mcgreevy B.P., Barraclough D.J. Reinforcement learning and decision making in monkeys during a competitive game. Brain Res. Cogn. Brain Res. 2004, 22:45-58.
34. Lee D., Mcgreevy B.P., Barraclough D.J. Learning and decision making in monkeys during a rock-paper-scissors game. Brain Res. Cogn. Brain Res. 2005, 25:416-430.
35. Leon M.I., Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 1999, 24:415-425.
36. Lohrenz T., Mccabe K., Camerer C.F., Montague P.R. Neural signature of fictive learning signals in a sequential investment task. Proc. Natl. Acad. Sci. USA 2007, 104:9493-9498.
37. Matsumoto K., Suzuki W., Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 2003, 301:229-232.
38. Matsumoto M., Matsumoto K., Abe H., Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci. 2007, 10:647-656.
39. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 2001, 24:167-202.
40. Mitchell K.J., Johnson M.K. Source monitoring 15 years later: what have we learned from fMRI about the neural mechanisms of source memory?. Psychol. Bull. 2009, 135:638-677.
41. Nash J.F. Equilibrium points in n-person games. Proc. Natl. Acad. Sci. USA 1950, 36:48-49.
42. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
43. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
44. Pan X., Sawa K., Tsuda I., Tsukada M., Sakagami M. Reward prediction based on stimulus categorization in primate lateral prefrontal cortex. Nat. Neurosci. 2008, 11:703-712.
45. Prabhakaran V., Narayanan K., Zhao Z., Gabrieli J.D.E. Integration of diverse information in working memory within the frontal lobe. Nat. Neurosci. 2000, 3:85-90.
46. Rizzo L., Danion J.-M., van der Linden M., Grangé D. Patients with schizophrenia remember that an event has occurred, but not when. Br. J. Psychiatry 1996, 168:427-431.
47. Rizzo L., Danion J.-M., van der Linden M., Grangé D., Rohmer J.-G. Impairment of memory for spatial context in schizophrenia. Neuropsychology 1996, 10:376-384.
48. Roese N.J., Park S., Smallman R., Gibson C. Schizophrenia involves impairment in the activation of intentions by counterfactual thinking. Schizophr. Res. 2008, 103:343-344.
49. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
50. Seo H., Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J. Neurosci. 2009, 29:3627-3641.
51. Seo H., Barraclough D.J., Lee D. Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cereb. Cortex 2007, 17:i110-i117.
52. Sohn J.-W., Lee D. Order-dependent modulation of directional signals in the supplementary and presupplementary motor areas. J. Neurosci. 2007, 27:13655-13666.
53. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 1998, 282:1335-1338.
54. Sul J.H., Kim H., Huh N., Lee D., Jung M.W. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 2010, 66:449-460.
55. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge, MA.
56. Tanji J., Hoshi E. Behavioral planning in the prefrontal cortex. Curr. Opin. Neurobiol. 2001, 11:164-170.
57. Thorndike E.L. Animal Intelligence: Experimental Studies 1911, Macmillan, New York.
58. Tolman E.C. Cognitive maps in rats and men. Psychol. Rev. 1948, 55:189-208.
59. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
60. Tsuchida A., Doll B.B., Fellows L.K. Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J. Neurosci. 2010, 30:16868-16875.
61. Tsujimoto S., Sawaguchi T. Context-dependent representation of response-outcome in monkey prefrontal neurons. Cereb. Cortex 2005, 15:888-898.
62. Tsujimoto S., Genovesio A., Wise S.P. Monkey orbitofrontal cortex encodes response choices near feedback time. J. Neurosci. 2009, 29:2569-2574.
63. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 2003, 18:2069-2081.
64. Walton M.E., Behrens T.E.J., Buckley M.J., Rudebeck P.H., Rushworth M.F.S. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
65. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 1996, 382:629-632.
66. Waters F.A.V., Maybery M.T., Badcock J.C., Michie P.T. Context memory and binding in schizophrenia. Schizophr. Res. 2004, 68:119-125.
67. Wheeler M.A., Stuss D.T., Tulving E. Toward a theory of episodic memory: the frontal lobes and autonoetic consciousness. Psychol. Bull. 1997, 121:331-354.