Learning to cooperate without awareness in multiplayer minimal social situations

Cognitive Psychology

Volumn 61, Issue 3, 2010, Pages 201-227

  Colman, Andrew M ^a   Pulford, Briony D ^a   Omtzigt, David ^a   al Nowaihi, Ali ^b  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

Adaptive learning; Cooperation; Decisions from experience; Explorative sampler; Game theory; Minimal social situation; Monte Carlo simulation; Reinforcement learning; Value assessment model

Indexed keywords

ADAPTIVE BEHAVIOR; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ARTICLE; AWARENESS; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; COOPERATION; FEMALE; GAME; HUMAN; HUMAN RELATION; LEARNING; MALE; MONTE CARLO METHOD; PHYSIOLOGY; RANDOMIZED CONTROLLED TRIAL; REINFORCEMENT;

ADAPTATION, PSYCHOLOGICAL; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; AWARENESS; COOPERATIVE BEHAVIOR; FEMALE; GAME THEORY; HUMANS; INTERPERSONAL RELATIONS; LEARNING; MALE; MONTE CARLO METHOD; REINFORCEMENT (PSYCHOLOGY);

EID: 77956057717     PISSN: 00100285     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cogpsych.2010.05.003     Document Type: Article

References (63)

1. Arickx M., Van Avermaet E. Interdependent learning in a minimal social situation. Behavioral Science 1981, 26:229-242.
2. Barron G., Erev I. Small feedback-based decisions and their limited correspondence to description-based decisions. Journal of Behavioral Decision Making 2003, 16:215-233.
3. Bertilson H.S., Lien S.K. Comparison of reaction time and interpersonal communication tasks to test effectiveness of a matching strategy in reducing attack-instigated aggression. Perceptual and Motor Skills 1982, 55:659-665.
4. Bertilson H.S., Wonderlich S.A., Blum M.W. Withdrawal, matching, withdrawal-matching, and variable-matching strategies in reducing attack-instigated aggression. Aggressive Behavior 1983, 9:1-11.
5. Bertilson H.S., Wonderlich S.A., Blum M.W. Withdrawal and matching strategies in reducing attack-instigated aggression. Psychological Reports 1984, 55:823-828.
6. Bitterman M.E. The comparative analysis of learning. Science 1975, 188(4189):699-709.
7. Bitterman M.E., Schoel W.M. Instrumental learning in animals: Parameters of reinforcement. Annual Review of Psychology 1970, 21:367-436.
8. Bonem M., Crossman E.K. Elucidating the effects of reinforcement magnitude. Psychological Bulletin 1988, 104:348-362.
9. Boren J.J. An experimental social relation between two monkeys. Journal of the Experimental Analysis of Behavior 1966, 9:691-700.
10. Camerer C.F. Behavioral game theory: Experiments in strategic interaction 2003, Russell Sage Foundation, New York.
11. Camerer C.F., Hogarth R.M. The effects of financial incentives in economics experiments: A review and capital-labor-production framework. Journal of Risk and Uncertainty 1999, 18:7-42.
12. Coleman A.A., Colman A.M., Thomas R.M. Cooperation without awareness: A multiperson generalization of the minimal social situation. Behavioral Science 1990, 35:115-121.
13. Colman A.M. Game theory and its applications in the social and biological sciences 1995, Routledge, London. 2nd ed.
14. Colman A.M. Evolution of cooperation without awareness in minimal social situations. Teamwork: Multi-disciplinary perspectives 2005, 216-235. Palgrave Macmillan, Basingstoke. N. Gold (Ed.).
15. Cooper D., Kagel J. Learning and transfer in signaling games. Economic Theory 2008, 34:415-439.
16. Crawford T., Sidowski J.B. Monetary incentive and cooperation/competition instructions in a minimal social situation. Psychological Reports 1964, 15:233-234.
17. Delepoulle S., Preux P., Darcheville J.-C. Evolution of cooperation within a behavior-based perspective: Confronting nature and animats. Artificial Evolution Lecture Notes in Computer Science 2000, 18291:204-216.
18. Delepoulle S., Preux P., Darcheville J.-C. Selection of behavior in social situations: Application to the development of coordinated movements. Applications of Evolutionary Computing, Proceedings 2001, 2037:384-393.
19. Dennett D.C. Why the law of effect will not go away. Journal for the Theory of Social Behaviour 1975, 5:169-187.
20. Edgeworth F.Y. Mathematical psychics: An essay on the application of mathematics to moral sciences 1881, Kegan Paul, London.
21. Erev, I., & Haruvy, E. (in press). Learning and the economics of small decisions. In J. H. Kagel & A. E. Roth (Eds.), The handbook of experimental economics (Vol. 2). Princeton, NJ: Princeton University Press.
22. Erev I., Ert E., Roth A.E., Haruvy E., Herzog S.M., Hau R., et al. A choice prediction competition: Choices from experience and from description. Journal of Behavioral Decision Making 2010, 23:15-47.
23. Erev I., Ert E., Yechiam E. Loss aversion, diminishing sensitivity, and the effect of experience on repeated decisions. Journal of Behavioral Decision Making 2008, 21:575-597.
24. Erev I., Roth A.E. Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. American Economic Review 1998, 88:848-881.
25. Feltovich N. Reinforcement-based vs. beliefs-based learning in experimental asymmetric-information games. Econometrica 2000, 68:605-641.
26. Ferster C.B., Skinner B.F. Schedules of reinforcement 1957, Appleton-Century-Crofts, New York.
27. Gittins J.C. Multi-armed bandit allocation indices 1989, Wiley, New York.
28. Herrnstein R.J. On the law of effect. Journal of the Experimental Analysis of Behavior 1970, 13:243-266.
29. Hertwig R., Ortmann A. Experimental practices in economics: A methodological challenge for psychologists?. The Behavioral and Brain Science 2001, 24:383-403.
30. Holland J.H. Adaptation in natural and artificial systems 1975, University of Michigan Press, Ann Arbor, MI. 2nd ed.
31. Humphrey G. Thinking: An introduction to its experimental psychology 1951, Methuen, London.
32. Kelley H.H. Interpersonal accommodation. American Psychologist 1968, 23:399-410.
33. Kelley H.H., Thibaut J.W. Interpersonal relations: A theory of interdependence 1978, Wiley, New York.
34. Kelley H.H., Thibaut J.W., Radloff R., Mundy D. The development of cooperation in the "minimal social situation" Psychological Monographs 1962, 76(19, Whole No. 538).
35. Kraines D., Kraines V. Pavlov and the Prisoner's Dilemma. Theory and Decision 1989, 26:47-79.
36. Lovibond P.F., Shanks D.R. The role of awareness in Pavlovian conditioning: Empirical evidence and theoretical implications. Journal of Experimental Psychology: Animal Behavior Processes 2002, 28:3-26.
37. Mitropoulos A. Learning under minimal information: An experiment on mutual fate control. Journal of Economic Psychology 2001, 22:523-557.
38. Mitropoulos A. An experiment on the value of structural information in a 2×2 repeated game. Economics Letters 2003, 78:27-32.
39. Molm L.D. A contingency change analysis of the disruption and recovery of social exchange and cooperation. Social Forces 1981, 59:729-751.
40. Nash, J. (1950). Non-cooperative games. Doctoral dissertation, Princeton University. (Reprinted in The essential John Nash. H. W. Kuhn & S. Nasar (Eds.) (2002). Princeton, NJ: Princeton University Press, pp. 53-4.).
41. Nowak M.A., Sigmund K. A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game. Nature 1993, 364:56-58.
42. Popper K.R. The logic of scientific discovery 1959, Hutchinson, London, (Original German work published 1934).
43. Posch M., Pichler A., Sigmund K. The efficiency of adapting aspiration levels. Proceedings of the Royal Society of London B 1999, 266:1427-1435.
44. Rabinowitz L., Kelley H.H., Rosenblatt R.M. Effects of different types of interdependence and response conditions in the minimal social situation. Journal of Experimental Social Psychology 1966, 2:169-197.
45. Rapoport A., Chammah A.M. Prisoner's Dilemma 1965, University of Michigan Press, Ann Arbor, MI, p. 34.
46. Roth A.E., Erev I. Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term. Games and Economic Behavior 1995, 8:164-212.
47. Schmalensee R. Alternative models of bandit selection. Journal of Economic Theory 1975, 10:333-342.
48. Sidowski J.B. Reward and punishment in the minimal social situation. Journal of Experimental Psychology 1957, 54:318-326.
49. Sidowski J.B., Smith M. Sex and game instruction variables in a minimal social situation. Psychological Reports 1961, 8:393-397.
50. Sidowski J.B., Wyckoff L.B., Tabory L. The influence of reinforcement and punishment in a minimal social situation. Journal of Abnormal and Social Psychology 1956, 52:115-119.
51. Skinner B.F. Contingencies of reinforcement 1969, Appleton-Century-Crofts, New York.
52. Smith V.L. Experimental economics: Induced value theory. American Economic Review 1976, 66:274-279.
53. Smith G.F., Murdoch P. Performance of informed versus noninformed triads and quartets in the "minimal social situation" Journal of Personality and Social Psychology 1970, 15:391-396.
54. Smith V.L., Walker J.M. Monetary rewards and decision costs in experimental economics. Economic Inquiry 1993, 31:245-261.
55. Sozański T. A combinatorial theory of minimal social situations. Journal of Mathematical Sociology 1992, 17:105-125.
56. Stroop J.R. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 1935, 18:643-662.
57. Teigen K.H. One hundred years of laws in psychology. American Journal of Psychology 2002, 115:103-118.
58. Thibaut J.W., Kelley H.H. The social psychology of groups 1959, Wiley, New York.
59. Thorndike E.L. Animal intelligence: An experimental study of the associative processes in animals. Psychological Review Monograph Supplement 1898, 2(4, Whole No. 8):1-109.
60. Thorndike E.L. Animal intelligence: Experimental studies 1911, Macmillan, New York.
61. Thorndike E.L. The law of effect. American Journal of Psychology 1927, 39:212-222.
62. Tversky A., Edwards W. Information versus reward in binary choice. Journal of Experimental Psychology 1966, 71:680-683.
63. Young P. Individual strategy and social structure: An evolutionary theory of institutions 1998, Princeton University Press, Princeton, NJ.