Reciprocity and retaliation in social games with adaptive agents

IEEE Transactions on Autonomous Mental Development

Volumn 4, Issue 3, 2012, Pages 226-238

  Asher, Derrik E ^a   Zaldivar, Andrew ^a   Barton, Brian ^a   Brewer, Alyssa A ^a   Krichmar, Jeffrey L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Adaptive systems; cognition; cognitive robotics; human robot interaction; neurotransmitters

Indexed keywords

ACTION SELECTION; ADAPTIVE AGENTS; ADAPTIVE BEHAVIOR; CO-OPERATIVE BEHAVIORS; COGNITION; COGNITIVE ROBOTICS; COMPETITIVE BEHAVIOR; ENVIRONMENTAL CONDITIONS; NEUROMODULATION; NEUROTRANSMITTERS; PLAUSIBLE MODEL; RISK TAKING; RISKY BEHAVIORS; ROBOTIC AGENTS;

ADAPTIVE SYSTEMS; COMPUTER SIMULATION; DECISION MAKING; GAME THEORY; HUMAN ROBOT INTERACTION; ROBOTICS;

BEHAVIORAL RESEARCH;

EID: 84866495037     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2012.2202658     Document Type: Article

References (41)

1. D. Lee, "Game theory and neural basis of social decision making," Nat.Neurosci., vol. 11, pp. 404-409, Apr. 2008. (Pubitemid 351441880)
2. J. K. Rilling and A. G. Sanfey, "The neuroscience of social decisionmaking," Annu. Rev. Psychol., vol. 62, pp. 23-48, 2011.
3. J. Maynard Smith, Evolution and the Theory of Games. Cambridge, U.K.: Cambridge Univ. Press, 1982.
4. M. A. Nowak et al., "Fairness versus reason in the ultimatum game," Science, vol. 289, pp. 1773-1775, Sep. 8, 2000.
5. B. Skyrms and R. Pemantle, "A dynamic model of social network formation," Proc. Nat. Acad. Sci. USA, vol. 97, pp. 9340-9346, Aug. 1, 2000. (Pubitemid 30626720)
6. D. J. Barraclough et al., "Prefrontal cortex and decision making in a mixed-strategy game," Nat. Neurosci., vol. 7, pp. 404-410, Apr. 2004. (Pubitemid 38429181)
7. J. Rilling et al., "A neural basis for social cooperation," Neuron, vol. 35, pp. 395-405, Jul. 18, 2002. (Pubitemid 34876740)
8. T. Yamagishi et al., "The private rejection of unfair offers and emotional commitment," Proc. Nat. Acad. Sci. USA, vol. 106, pp. 11520-11523, Jul. 14, 2009.
9. L. A. Briand et al., "Modulators in concert for cognition: Modulator interactions in the prefrontal cortex," Prog. Neurobiol., vol. 83, pp. 69-91, Oct. 2007. (Pubitemid 47464694)
10. J. L. Krichmar, "The neuromodulatory system-A framework for survival and adaptive behavior in a challenging world," Adapt. Behav., vol. 16, pp. 385-399, 2008.
11. R. Cools et al., "Serotoninergic regulation of emotional and behavioural control processes," Trends Cogn. Sci., vol. 12, pp. 31-40, Jan. 2008. (Pubitemid 50012215)
12. M. J. Millan, "The neurobiology and control of anxious states," Prog. Neurobiol., vol. 70, pp. 83-244 Jun. 2003. (Pubitemid 37309295)
13. R. M.Wood et al., "Effects of tryptophan depletion on the performance of an iterated Prisoner's Dilemma game in healthy adults," Neuropsychopharmacology, vol. 31, pp. 1075-1084, May 2006.
14. M. J. Crockett et al., "Serotonin modulates behavioral reactions to unfairness," Science, vol. 320, p. 1739 Jun. 27, 2008. (Pubitemid 351931281)
15. M. J. Crockett et al., "Serotonin selectively influences moral judgment and behavior through effects on harm aversion," Proc. Nat. Acad. Sci. USA, vol. 107, pp. 17433-17438, Oct. 5, 2010.
16. C. Breazeal and B. Scassellati, "Robots that imitate humans," Trends Cogn. Sci., vol. 6, pp. 481-487, Nov. 1, 2002. (Pubitemid 35341852)
17. C. Kidd and C. Breazeal, E ect of a robot on user perceptions 2004, pp. 3559-3564.
18. J. L. Krichmar and G. M. Edelman, "Machine psychology: Autonomous behavior, perceptual categorization and conditioning iPrn a brain-based device," Cereb. Cortex, vol. 12, pp. 818-830, Aug. 2002. (Pubitemid 34803881)
19. J. L. Krichmar and G. M. Edelman, "Brain-based devices for the study of nervous systems and the development of intelligentmachines," Artif. Life, vol. 11, pp. 63-77, Winter-Spring, 2005. (Pubitemid 40394096)
20. D. E. Asher et al., "Effect of neuromodulation on performance in game playing: A modeling study," in Proc. IEEE 9th Int. Conf. Develop. Learn., Ann Arbor, MI, 2010, pp. 155-160.
21. A. Zaldivar et al., "Simulation of How Neuromodulation Influences Cooperative Behavior," in Simulation of Adaptive Behavior: From Animals to Animats, S. Doncieux, Ed. Berlin, Germany: Springer-Verlag Lecture Notes Artif. Intell. (LNAI 6226), 2010, pp. 649-660, et al..
22. W. Schultz, "Dopamine neurons and their role in reward mechanisms," Current Opinion Neurobiol., vol. 7, pp. 191-197, Apr. 1997. (Pubitemid 27219855)
23. W. Schultz et al., "A neural substrate of prediction and reward," Science, vol. 275, pp. 1593-1599, Mar. 14, 1997. (Pubitemid 27120526)
24. S. N. Young et al., "Tryptophan depletion causes a rapid lowering of mood in normal males," Psychopharmacology (Berl), vol. 87, pp. 173-177, 1985. (Pubitemid 16253342)
25. J. B.W.Williams andM.Gibbon, "The structured clinical interview for DSM-III-R (SCID) II. Multisite test-retest reliability," Archives General Psych., vol. 49, p. 630, 1992.
26. A. Oldman et al., "Biochemical and behavioural effects of acute tryptophan depletion in abstinent bulimic subjects: A pilot study," Psychol. Med., vol. 25, pp. 995-1001, Sep. 1995.
27. M. A. Ellenbogen et al., "Mood response to acute tryptophan depletion in healthy volunteers: Sex differences and temporal stability," Neuropsychopharmacology, vol. 15, pp. 465-474, Nov. 1996. (Pubitemid 26389870)
28. L. A. Jans et al., "Serotonergic vulnerability and depression: Assumptions, experimental evidence and implications," Mol. Psych., vol. 12, pp. 522-543 Jun. 2007. (Pubitemid 46816766)
29. G. Biggio et al., "Rapid depletion of serum tryptophan, brain tryptophan, serotonin and 5-hydroxyindoleacetic acid by a tryptophan-free diet," Life Sci., vol. 14, pp. 1321-1329, Apr. 1, 1974.
30. G. L. Gessa et al., "Effect of the oral administration of tryptophan-free amino acid mixtures on serum tryptophan, brain tryptophan and serotonin metabolism," J. Neurochem., vol. 22, pp. 869-870, May 1974.
31. C. J. Bell et al., "Acute tryptophan depletion. Part II: Clinical effects and implications," Aust N Z J. Psych., vol. 39, pp. 565-574, Jul. 2005. (Pubitemid 41613445)
32. S. D. Hood et al., "Acute tryptophan depletion. Part I: Rationale and methodology," Aust N Z J. Psych., vol. 39, pp. 558-564, Jul. 2005. (Pubitemid 41602540)
33. D. Watson et al., "Development and validation of brief measures of positive and negative affect: The PANAS scales," J. Personality Soc. Psychol., vol. 54, p. 1063, 1988.
34. B. R. Cox and J. L. Krichmar, "Neuromodulation as a robot controller: A brain inspired design strategy for controlling Autonomous robots," IEEE Robot. Autom. Mag., vol. 16, pp. 72-80, 2009.
35. M. J. Crockett et al., "Reconciling the role of serotonin in behavioral inhibition and aversion: Acute tryptophan depletion abolishes punishment-induced inhibition in humans," J. Neurosci., vol. 29, pp. 11993-11999, Sep. 23, 2009.
36. D. E. Asher et al., "Using bayesian graphical models to categorize subject variability during socioeconomic game playing," presented at the 34th Annu. Conf. Cogn. Sci. Soc. (CogSci 2012), Sapporo, Japan, 2012.
37. M. Nowak and K. Sigmund, "A strategy of win-stay, lose-shift that outperforms tit-for-tat in the prisoner's dilemma game," Nature, vol. 364, pp. 56-58, Jul. 1, 1993. (Pubitemid 23233453)
38. M. Solgi and J. Y. Weng, "Developmental stereo: Emergence of disparity preference in models of the visual cortex," IEEE Trans. Autonom. Mental Develop., vol. 1, no. 4, pp. 238-252, Dec. 2009.
39. J. Y. Weng and W. S. Hwang, "From neural networks to the brain: Autonomous mental development," IEEE Comput. Intell. Mag., vol. 1, pp. 15-31, Aug. 2006.
40. J. Y.Weng andM. Luciw, "Dually optimal neuronal layers: Lobe component analysis," IEEE Trans. Autonom. Mental Develop., vol. 1, no. 1, pp. 68-85, May 2009.
41. A. G. Sanfey et al., "The neural basis of economic decision-making in the ultimatum game," Science, vol. 300, pp. 1755-1758 Jun. 13, 2003. (Pubitemid 36712573)