Learning to Simulate Others' Decisions

Neuron

Volumn 74, Issue 6, 2012, Pages 1125-1137

  Suzuki, Shinsuke ^a   Harasawa, Norihiro ^a   Ueno, Kenichi ^a   Gardner, Justin L ^a   Ichinohe, Noritaka ^b   Haruno, Masahiko ^c   Cheng, Kang ^a   Nakahara, Hiroyuki ^a,d  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b NATIONAL INSTITUTE OF NEUROSCIENCE   (Japan)

^c NICT and Osaka University   (Japan)

^d TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CONTROLLED STUDY; DECISION MAKING; DORSOMEDIAL PREFRONTAL CORTEX; EYE TRACKING; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; MENTAL FUNCTION; MENTAL PERFORMANCE; NEUROPHYSIOLOGICAL RECRUITMENT; NORMAL HUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SOCIAL COGNITION; SOCIAL LEARNING; STIMULUS RESPONSE; VENTROMEDIAL PREFRONTAL CORTEX;

DECISION MAKING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; INTERPERSONAL RELATIONS; LEARNING; MAGNETIC RESONANCE IMAGING; MODELS, PSYCHOLOGICAL; PREFRONTAL CORTEX; SOCIAL BEHAVIOR; SOCIAL PERCEPTION;

EID: 84862673530     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2012.04.030     Document Type: Article

References (58)

1. Adolphs R. Conceptual challenges and directions for social neuroscience. Neuron 2010, 65:752-767.
2. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 2011, 14:1338-1344.
3. Amodio D.M., Frith C.D. Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 2006, 7:268-277.
4. Barraclough D.J., Conroy M.L., Lee D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 2004, 7:404-410.
5. Baumgartner T., Fischbacher U., Feierabend A., Lutz K., Fehr E. The neural circuitry of a broken promise. Neuron 2009, 64:756-770.
6. Beckmann M., Johansen-Berg H., Rushworth M.F. Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J. Neurosci. 2009, 29:1175-1190.
7. Behrens T.E.J., Woolrich M.W., Walton M.E., Rushworth M.F.S. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
8. Behrens T.E.J., Hunt L.T., Woolrich M.W., Rushworth M.F.S. Associative learning of social value. Nature 2008, 456:245-249.
9. Berns G., McClure S., Pagnoni G., Montague P. Predictability modulates human brain response to reward. J. Neurosci. 2001, 21:2793-2798.
10. Bhatt M.A., Lohrenz T., Camerer C.F., Montague P.R. Neural signatures of strategic types in a two-person bargaining game. Proc. Natl. Acad. Sci. USA 2010, 107:19720-19725.
11. Boorman E.D., Behrens T.E., Rushworth M.F. Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex. PLoS Biol. 2011, 9:e1001093.
12. Buckner R.L., Carroll D.C. Self-projection and the brain. Trends Cogn. Sci. (Regul. Ed.) 2007, 11:49-57.
13. Burke C.J., Tobler P.N., Baddeley M., Schultz W. Neural mechanisms of observational learning. Proc. Natl. Acad. Sci. USA 2010, 107:14431-14436.
14. *. Q. J. Econ. 2004, 119:861-898.
15. Cooper J.C., Kreps T.A., Wiebe T., Pirkl T., Knutson B. When giving is good: ventromedial prefrontal cortex activation for others' intentions. Neuron 2010, 67:511-521.
16. Cooper J.C., Dunne S., Furey T., O'Doherty J.P. Human dorsal striatum encodes prediction errors during observational learning of instrumental actions. J. Cogn. Neurosci. 2011, 24:106-118.
17. Coricelli G., Nagel R. Neural correlates of depth of strategic reasoning in medial prefrontal cortex. Proc. Natl. Acad. Sci. USA 2009, 106:9163-9168.
18. Dayan P., Niv Y. Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 2008, 18:185-196.
19. de Bruijn E.R.A., de Lange F.P., von Cramon D.Y., Ullsperger M. When errors are rewarding. J. Neurosci. 2009, 29:12183-12186.
20. Decety J., Sommerville J.A. Shared representations between self and other: a social cognitive neuroscience view. Trends Cogn. Sci. (Regul. Ed.) 2003, 7:527-533.
21. Delgado M.R., Frank R.H., Phelps E.A. Perceptions of moral character modulate the neural systems of reward during the trust game. Nat. Neurosci. 2005, 8:1611-1618.
22. Fehr E., Camerer C.F. Social neuroeconomics: the neural circuitry of social preferences. Trends Cogn. Sci. (Regul. Ed.) 2007, 11:419-427.
23. Fliessbach K., Weber B., Trautner P., Dohmen T., Sunde U., Elger C.E., Falk A. Social comparison affects reward-related brain activity in the human ventral striatum. Science 2007, 318:1305-1308.
24. Frith C.D., Frith U. Interacting minds-a biological basis. Science 1999, 286:1692-1695.
25. Gallagher H.L., Frith C.D. Functional imaging of 'theory of mind'. Trends Cogn. Sci. (Regul. Ed.) 2003, 7:77-83.
26. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
27. Glimcher P.W., Rustichini A. Neuroeconomics: the consilience of brain and decision. Science 2004, 306:447-452.
28. Hampton A.N., Bossaerts P., O'Doherty J.P. Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc. Natl. Acad. Sci. USA 2008, 105:6741-6746.
29. Haruno M., Kawato M. Activity in the superior temporal sulcus highlights learning competence in an interaction game. J. Neurosci. 2009, 29:4542-4547.
30. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
31. Hayden B.Y., Heilbronner S.R., Pearson J.M., Platt M.L. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J. Neurosci. 2011, 31:4178-4187.
32. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J. Neurophysiol. 2006, 95:567-584.
33. Huettel S.A., Stowe C.J., Gordon E.M., Warner B.T., Platt M.L. Neural signatures of economic preferences for risk and ambiguity. Neuron 2006, 49:765-775.
34. Izuma K., Saito D.N., Sadato N. Processing of social and monetary rewards in the human striatum. Neuron 2008, 58:284-294.
35. Keysers C., Gazzola V. Integrating simulation and theory of mind: from self to social cognition. Trends Cogn. Sci. (Regul. Ed.) 2007, 11:194-196.
36. Kriegeskorte N., Simmons W.K., Bellgowan P.S., Baker C.I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 2009, 12:535-540.
37. Li J., Delgado M.R., Phelps E.A. How instructed knowledge modulates the neural systems of reward learning. Proc. Natl. Acad. Sci. USA 2011, 108:55-60.
38. Lohrenz T., McCabe K., Camerer C.F., Montague P.R. Neural signature of fictive learning signals in a sequential investment task. Proc. Natl. Acad. Sci. USA 2007, 104:9493-9498.
39. Mackey S., Petrides M. Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur. J. Neurosci. 2010, 32:1940-1950.
40. Mitchell J.P. Inferences about mental states. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1309-1316.
41. Mitchell J.P., Macrae C.N., Banaji M.R. Dissociable medial prefrontal contributions to judgments of similar and dissimilar others. Neuron 2006, 50:655-663.
42. Mobbs D., Yu R., Meyer M., Passamonti L., Seymour B., Calder A.J., Schweizer S., Frith C.D., Dalgleish T. A key role for similarity in vicarious reward. Science 2009, 324:900.
43. Moll J., Krueger F., Zahn R., Pardini M., de Oliveira-Souza R., Grafman J. Human fronto-mesolimbic networks guide decisions about charitable donation. Proc. Natl. Acad. Sci. USA 2006, 103:15623-15628.
44. Montague P.R., King-Casas B., Cohen J.D. Imaging valuation models in human choice. Annu. Rev. Neurosci. 2006, 29:417-448.
45. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. N Y Acad. Sci. 2007, 1104:35-53.
46. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9:545-556.
47. Rilling J., Gutman D., Zeh T., Pagnoni G., Berns G., Kilts C. A neural basis for social cooperation. Neuron 2002, 35:395-405.
48. Rizzolatti G., Sinigaglia C. The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat. Rev. Neurosci. 2010, 11:264-274.
49. Rushworth M.F. Intention, choice, and the medial frontal cortex. Ann. N Y Acad. Sci. 2008, 1124:181-207.
50. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
51. Sanfey A.G. Social decision-making: insights from game theory and neuroscience. Science 2007, 318:598-602.
52. Saxe R. Against simulation: the argument from error. Trends Cogn. Sci. (Regul. Ed.) 2005, 9:174-179.
53. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
54. Singer T., Lamm C. The social neuroscience of empathy. Ann. N Y Acad. Sci. 2009, 1156:81-96.
55. Singer T., Seymour B., O'Doherty J., Kaube H., Dolan R.J., Frith C.D. Empathy for pain involves the affective but not sensory components of pain. Science 2004, 303:1157-1162.
56. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, The MIT Press, Cambridge, MA.
57. Yoshida W., Seymour B., Friston K.J., Dolan R.J. Neural mechanisms of belief inference during cooperative games. J. Neurosci. 2010, 30:10744-10751.
58. Yoshida K., Saito N., Iriki A., Isoda M. Representation of others' action by neurons in monkey medial frontal cortex. Curr. Biol. 2011, 21:249-253.