Neural correlates of reinforcement learning and social preferences in competitive bidding

Journal of Neuroscience

Volumn 33, Issue 5, 2013, Pages 2137-2146

  van den Bos, Wouter ^a   Talwar, Arjun ^a   McClure, Samuel M ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR INSULA; ARTICLE; BEHAVIOR; COMPUTER MODEL; CORPUS STRIATUM; DECISION MAKING; FEMALE; FINANCIAL MANAGEMENT; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NERVE CELL NETWORK; NORMAL HUMAN; PARIETAL LOBE; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SOCIAL BEHAVIOR; TEMPORAL LOBE; VENTROMEDIAL PREFRONTAL CORTEX;

ADULT; BRAIN; BRAIN MAPPING; COMPETITIVE BEHAVIOR; DECISION MAKING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; REINFORCEMENT (PSYCHOLOGY); SOCIAL BEHAVIOR;

EID: 84873035715     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3095-12.2013     Document Type: Article

References (53)

1. Andreoni J (1990) Impure altruism and donations to public goods: a theory of warm glow giving. Econ J 100:464-477. CrossRef
2. Azzi JoCB, Sirigu A, Duhamel JR (2012) Modulation of value representation by social context in the primate orbitofrontal cortex. Proc Natl Acad Sci U S A 109:2126-2131. CrossRef Medline
3. Benabou R, Tirole J (2006) Incentives and prosocial behavior. Am Econ Rev 96:1652-1678. CrossRef
4. Binmore K, Klemperer P (2002) The biggest auction ever: the sale of the British 3g telecom licenses. Econ J 112:74-96. CrossRef
5. Blecherman B, Camerer CF (1998) Is there a winner's curse in the market for baseball players? New York: Brooklyn Polytechnic University.
6. Camerer CF (2003) Behavioral game theory. Princeton, NJ: Princeton UP.
7. Camerer CF, Ho TH (1998) Experience-weighted attraction learning in coordination games: probability rules, heterogeneity, and time-variation. J Math Psychol 42:305-326. CrossRef
8. Capen EC, Clapp RV, Campbell WM (1971) Competitive bidding in high risk situations. J Petr Tech 2:641-653.
9. Chang LJ, Yarkoni T, Khaw MW, Sanfey AG (2012) Decoding the role of the insula in human cognition: functional parcellation and large-scale reverse inference. Cereb Cortex. Advance online publication. Retrieved March 20, 2012. doi:10.1093/cercor/bhs065. CrossRef Medline
10. Chiao JY, Harada T, Oby ER, Li Z, Parrish T, Bridge DJ (2009) Neural representations of social status hierarchy in human inferior parietal cortex. Neuropsychologia 47:354-363. CrossRef Medline
11. Cohen MX (2008) Neurocomputational mechanisms of reinforcement-guided learning in humans: a review. Cogn Affect Behav Neurosci 8:113-125. Medline
12. Cohen MX, Heller AS, Ranganath C (2005) Functional connectivity with anterior cingulate and orbitofrontal cortices during decision-making. Brain Res Cogn Brain Res 23:61-70. CrossRef Medline
13. Corbetta M, Patel G, Shulman GL (2008) The reorienting system of the human brain: from environment to theory of mind. Neuron 58:306-324. CrossRef Medline
14. Coricelli G, Nagel R (2009) Neural correlates of depth of strategic reasoning in medial prefrontal cortex. Proc Natl Acad Sci U S A 106:9163-9168. CrossRef Medline
15. Delgado MR, Schotter A, Ozbay EY, Phelps EA (2008) Understanding over- bidding: using the neural circuitry of reward to design economic auctions. Science 321:1849-1852. CrossRef Medline
16. Dessauer JP (1981) Book publishing. New York: Bowker.
17. Dosenbach NU, Visscher KM, Palmer ED, Miezin FM, Wenger KK, Kang HC, Burgund ED, Grimes AL, Schlaggar BL, Petersen SE (2006) A core system for the implementation of task sets. Neuron 50:799-812. CrossRef Medline
18. Dyer D, Kagel JH (1996) Bidding in common value auctions: how the commercial construction industry corrects for the winner's curse. Man Sci 42:1463-1475. CrossRef
19. Dyer D, Kagel JH, Levin D (1989) A comparison of naive and experienced bidders in common value offer auctions: a laboratory analysis. Econ J 99:108-115. CrossRef
20. Eyster E, Rabin M (2005) Cursed equilibrium. Econometrica 73:1623-1672. CrossRef
21. Fehr E, Camerer CF (2007) Social neuroeconomics, the neural circuitry of social preferences. Trends Cogn Sci 11:419-427. CrossRef Medline
22. Fehr E, Schmidt KM (1999) A theory of fairness, competition, and cooperation. Quart J Econ 114:817-868. CrossRef
23. Friston K (1994) Functional and effective connectivity in neuroimaging: a synthesis. Hum Brain Mapp 2:56-78. CrossRef
24. Garvin S, Kagel JH (1994) Learning in common value auctions: some initial observations. J Econ Behav Organ 25:351-372. CrossRef
25. Gneezy U (2005) Step-level reasoning and bidding in auctions. Management Sci 51:1633-1642. CrossRef
26. Hampton AN, Bossaerts P, O'Doherty JP (2008) Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc Natl Acad Sci U S A 105:6741-6746. CrossRef Medline
27. Hare TA, Camerer CF, Knoepfle DT, O'Doherty JP, Rangel A (2010) Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. J Neurosci 30:583-590. CrossRef Medline
28. Kagel JH, Levin D (2002) Common value auctions and the winner's curse. Princeton, NJ: Princeton UP.
29. Kagel JH, Levin D, Battalio RC, Meyer DJ (1989) First-price common value auctions: bidder behavior and the "winner's curse". Econ Inquiry 27:241-258. CrossRef
30. Kahnt T, Park SQ, Cohen MX, Beck A, Heinz A, Wrase J (2009) Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J Cogn Neurosci 21:1332-1345. CrossRef Medline
31. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, Montague PR. (2005) Getting to know you: reputation and trust in a two-person economic exchange. Science 308:78-83. CrossRef Medline
32. Ku G, Malhotra D, Murnighan JK (2005) Towards a competitive arousal model of decision-making: a study of auction fever in live and internet auctions. Organ Behav Hum Decis Proc 96:89-103. CrossRef
33. Li J, McClure SM, King-Casas B, Montague PR (2006) Policy adjustment in a dynamic economic game. PLoS One 1:e103. CrossRef Medline
34. Lind B, Plott CR (1991) The winner's curse: experiments with buyers and with sellers. Am Econ Rev 81:335-346.
35. Loewenstein GF, Thompson L, Bazerman MH (1989) Social utility and decision making in interpersonal contexts. J Pers Soc Psych 57:426-432. CrossRef
36. Malhotra D (2010) The desire to win: the effects of competitive arousal on motivation and behavior. Organ Behav Hum Decis Proc 111:139-146. CrossRef
37. McClure SM, van den Bos W (2011) The psychology of common value auctions. In: Attention and performance XXIII: decision making (Phelps E, Robbins T, Delgado M, eds.). Oxford: Oxford UP.
38. Messick DM, McClintock CG (1968) Motivational basis of choice in experimental games. J Exp Soc Psych 4:1-25. CrossRef
39. Mitchell JP (2007) Activity in right temporo-parietal junction is not selective for theory-of-mind. Cereb Cortex 18:262-271. CrossRef Medline
40. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesen-cephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947. Medline
41. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337. CrossRef Medline
42. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II (Black AH, Prokasy WF, eds) pp 64-99. New York: Appleton-Century-Crofts.
43. Rilling JK, Sanfey AG (2011) The neuroscience of social decision-making. Annu Rev Psychol 62:23-48. CrossRef Medline
44. Roll R (1986) The hubris hypothesis of corporate takeovers. J Busin 59:197-216. CrossRef
45. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD (2003) The neural basis of economic decision-making in the ultimatum game. Science 300:1755-1758. CrossRef Medline
46. Saxe R, Kanwisher N (2003) People thinking about thinking people: the role of the temporo-parietal junction in "theory of mind". Neuroimage 19: 1835-1842. CrossRef Medline
47. Seo H, Lee D (2012) Neural basis of learning and preference during social decision-making. Curr Op Neurobio 22:1-6. CrossRef
48. Sutton RS, Barto AG (1998) Reinforcement learning. Cambridge, MA: MIT.
49. Thaler RH (1994) The winner's curse: paradoxes and anomalies of economic life. Princeton, NJ: Princeton UP.
50. van den Bos W, Li J, Lau T, Maskin E, Cohen JD, McClure SM (2008) The value of victory, social origins of the winner's curse in common value auctions. Judg Decis Making 3:483-492.
51. Yoshida W, Seymour B, Friston KJ, Dolan RJ (2010) Neural mechanisms of belief inference during cooperative games. J Neurosci 30:10744-10751. CrossRef Medline
52. Zhu L, Mathewson KE, Hsu M (2012) Dissociable neural representations of reinforcement and belief prediction errors underlie strategic learning. Proc Natl Acad Sci U S A 109:1419-1424. CrossRef Medline
53. Zink CF, Tong Y, Chen Q, Bassett DS, Stein JL, Meyer-Lindenberg A (2008) Know your place: neural processing of social hierarchy in humans. Neuron 58:273-283. CrossRef Medline