Imaging models of valuation during social interaction in humans

Biological Psychiatry

Volumn 72, Issue 2, 2012, Pages 93-100

  Kishida, Kenneth T ^a   Montague, P Read ^a,b,c  

^a VIRGINIA TECH CARILION SCHOOL OF MEDICINE   (United States)

^b VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Decision making; dopamine; fMRI; neuroeconomics; reinforcement learning; social cognition

Indexed keywords

DOPAMINE; NEUROTRANSMITTER;

BEHAVIORAL ECONOMICS; BOLD SIGNAL; CORPUS STRIATUM; DECISION MAKING; DOPAMINERGIC NERVE CELL; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MICROELECTRODE; MOTIVATION; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; SOCIAL COGNITION; SOCIAL INTERACTION; SPIKE WAVE; STATISTICAL MODEL; SUBSTANTIA NIGRA;

BRAIN; BRAIN MAPPING; CONDITIONING, OPERANT; DECISION MAKING; DOPAMINERGIC NEURONS; ECONOMICS, BEHAVIORAL; HUMANS; INTERPERSONAL RELATIONS; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; REWARD;

EID: 84862903712     PISSN: 00063223     EISSN: 18732402     Source Type: Journal    
DOI: 10.1016/j.biopsych.2012.02.037     Document Type: Review

References (46)

1. R.S. Sutton, A.G. Barto Reinforcement Learning: An Introduction 1998 Cambridge University Press Cambridge
2. P.R. Montague, P. Dayan, T.J. Sejnowski A framework for mesencephalic dopamine systems based on predictive Hebbian learning J Neurosci 16 1996 1936
3. W. Schultz, P. Dayan, P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593
4. J. Von Neumann, O. Morgenstern Theory of Games and Economic Behavior 1947 Princeton University Press Princeton
5. C. Camerer Behavioral Game Theory: Experiments in Strategic Interaction 2003 Russell Sage Foundation New York
6. P.W. Glimcher Making choices: The neurophysiology of visual-saccadic decision making Trends Neurosci 24 2001 654 659
7. P.R. Montague, G.S. Berns Neural economics and the biological substrates of valuation Neuron 36 2002 265 284
8. P.W. Glimcher, A. Rustichini Neuroeconomics: The consilience of brain and decision Science 306 2004 447
9. C.F. Camerer, E. Fehr When does "economic man" dominate social behavior? Science 311 2006 47
10. C.F. Camerer Neuroeconomics: Opening the gray box Neuron 60 2008 416 419
11. G. Loewenstein, S. Rick, J.D. Cohen Neuroeconomics Annu Rev Psychol 59 2008 647 672
12. K.T. Kishida, B. King-Casas, P.R. Montague Neuroeconomic approaches to mental disorders Neuron 67 2010 543 554
13. P.H. Chiu, M.A. Kayali, K.T. Kishida, D. Tomlin, L.G. Klinger, M.R. Klinger Self responses along cingulate cortex reveal quantitative neural phenotype for high-functioning autism Neuron 57 2008 463 473
14. B. King-Casas, C. Sharp, L. Lomax-Bream, T. Lohrenz, P. Fonagy, P.R. Montague The rupture and repair of cooperation in borderline personality disorder Science 321 2008 806
15. M. Koshelev, T. Lohrenz, M. Vannucci, P.R. Montague Biosensor approach to psychopathology classification PLoS Computational Biology 6 2010 e1000966
16. W. Yoshida, I. Dziobek, D. Kliemann, H.R. Heekeren, K.J. Friston, R.J. Dolan Cooperation and heterogeneity of the autistic mind J Neurosci 30 2010 8815
17. N.D. Daw ND Reinforcement learning models of the dopamine system and their behavioral implications [thesis] 2003 Carnegie Mellon University
18. P.R. Montague, B. King-Casas, J.D. Cohen Imaging valuation models in human choice Annu Rev Neurosci 29 2006 417 448
19. P.R. Montague, S.E. Hyman, J.D. Cohen Computational roles for dopamine in behavioural control Nature 431 2004 760 767
20. G. Pagnoni, C.F. Zink, P.R. Montague, G.S. Berns Activity in human ventral striatum locked to errors of reward prediction Nat Neurosci 5 2002 97 98
21. S.M. McClure, G.S. Berns, P.R. Montague Temporal prediction errors in a passive learning task activate human striatum Neuron 38 2003 339 346
22. J.P. O'Doherty, P. Dayan, K. Friston, H. Critchley, R.J. Dolan Temporal difference models and reward-related learning in the human brain Neuron 38 2003 329 337
23. B. Seymour, J.P. O'Doherty, P. Dayan, M. Koltzenburg, A.K. Jones, R.J. Dolan Temporal difference models describe higher-order learning in humans Nature 429 2004 664 667
24. B. King-Casas, D. Tomlin, C. Anen, C.F. Camerer, S.R. Quartz, P.R. Montague Getting to know you: Reputation and trust in a two-person economic exchange Science 308 2005 78 83
25. K. Fliessbach, B. Weber, P. Trautner, T. Dohmen, U. Sunde, C.E. Elger Social comparison affects reward-related brain activity in the human ventral striatum Science 318 2007 1305
26. T. Lohrenz, K. McCabe, C.F. Camerer, P.R. Montague Neural signature of fictive learning signals in a sequential investment task Proc Natl Acad Sci U S A 104 2007 9493 9498
27. T.E. Behrens, L.T. Hunt, M.W. Woolrich, M.F. Rushworth Associative learning of social value Nature 456 2008 245
28. P.H. Chiu, T.M. Lohrenz, P.R. Montague Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task Nat Neurosci 11 2008 514 520
29. K. Izuma, D.N. Saito, N. Sadato Processing of social and monetary rewards in the human striatum Neuron 58 2008 284 294
30. C.F. Zink, Y. Tong, Q. Chen, D.S. Bassett, J.L. Stein, A. Meyer-Lindenberg Know your place: Neural processing of social hierarchy in humans Neuron 58 2008 273 283
31. T.E. Behrens, L.T. Hunt, M.F. Rushworth The computation of social behavior Science 324 2009 1160
32. V. Klucharev, K. Hytönen, M. Rijpkema, A. Smidts, G. Fernández Reinforcement learning signal predicts social conformity Neuron 61 2009 140 151
33. K.T. Kishida, S.G. Sandberg, T. Lohrenz, Y.G. Comair, I. Sáez, P.E.M. Phillips Sub-second dopamine detection in human striatum PloS One 6 2011 e23291
34. K.T. Kishida, D. Yang, K. Quartz, S. Quartz, P.R. Montague Implicit signals in small group settings and their impact on the expression of cognitive capacity and associated brain responses Philos Trans R Soc Lond B Biol Sci 367 2012 704 716
35. D. Tomlin, M.A. Kayali, B. King-Casas, C. Anen, C.F. Camerer, S.R. Quartz Agent-specific responses in the cingulate cortex during economic exchanges Science 312 2006 1047 1050
36. P.R. Montague, G.S. Berns, J.D. Cohen, S.M. McClure, G. Pagnoni, M. Dhamala Hyperscanning: Simultaneous fMRI during linked social interactions Neuroimage 16 2002 1159 1164
37. G. Pagnoni, C.F. Zink, P.R. Montague, G.S. Berns Activity in human ventral striatum locked to errors of reward prediction Nat Neurosci 5 2002 97 98
38. M. Pessiglione, B. Seymour, G. Flandin, R.J. Dolan, C.D. Frith Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans Nature 442 2006 1042 1045
39. K. D'Ardenne, S.M. McClure, L.E. Nystrom, J.D. Cohen BOLD responses reflecting dopaminergic signals in the human ventral tegmental area Science 319 2008 1264 1267
40. J.J. Clark, S.G. Sandberg, M.J. Wanat, J.O. Gan, E.A. Horne, A.S. Hart Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals Nat Methods 7 2010 126 129
41. K.A. Zaghloul, J.A. Blanco, C.T. Weidemann, K. McGill, J.L. Jaggi, G.H. Baltuch Human substantia nigra neurons encode unexpected financial rewards Science 323 2009 1496 1499
42. L. Abbott Theoretical neuroscience rising Neuron 60 2008 489 495
43. C.D. Frith Interacting minds - a biological basis Science 286 1999 1692 1695
44. A.N. Hampton, P. Bossaerts, J.P. O'Doherty Neural correlates of mentalizing-related computations during strategic interactions in humans Proc Natl Acad Sci U S A 105 2008 6741 6746
45. W. Yoshida, R.J. Dolan, K.J. Friston Game theory of mind PLoS Comput Biol 4 2008 e1000254
46. W. Yoshida, B. Seymour, K.J. Friston, R.J. Dolan Neural mechanisms of belief inference during cooperative games J Neurosci 30 2010 10744