Evolution of social learning when high expected payoffs are associated with high risk of failure

Journal of the Royal Society Interface

Volumn 8, Issue 64, 2011, Pages 1604-1615

  Arbilly, Michal ^a,c   Motro, Uzi ^b   Feldman, Marcus W ^c   Lotem, Arnon ^a  

^a TEL AVIV UNIVERSITY   (Israel)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Cognition; Risk aversion; Social foraging

Indexed keywords

ANIMALS; COMPUTER SIMULATION;

AGENT BASED; COGNITION; FOOD SOURCES; INDIVIDUAL RISKS; RISK AVERSION; RISK OF FAILURE; SOCIAL CONTEXT; SOCIAL FORAGING; SOCIAL INFORMATION; SOCIAL LEARNING;

RISKS;

ARTICLE; COMPUTER SIMULATION; DECISION MAKING; ENVIRONMENTAL FACTOR; FORAGING BEHAVIOR; HUMAN; PERSONAL EXPERIENCE; PROBABILITY; SOCIAL INTERACTION; SOCIAL LEARNING;

ANIMALIA;

EID: 80054751337     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2011.0138     Document Type: Article

References (76)

1. Cavalli-Sforza, L. L. & Feldman, M. W. 1981 Cultural transmission and evolution: a quantitative approach. Princeton, NJ: Princeton University Press.
2. Feldman, M. W., Aoki, K. & Kumm, J. 1996 Individual versus social learning: evolutionary analysis in a fluctuating environment. Anthropol. Sci. 104, 209-231.
3. Henrich, J. & McElreath, R. 2003 The evolution of cultural evolution. Evol. Anthropol. 12, 123-135. (doi:10.1002/evan.10110)
4. Laland, K. N., Odling-Smee, J. & Myles, S. 2010 How culture shaped the human genome: bringing genetics and the human sciences together. Nat. Rev. Genet. 11, 137-148. (doi:10.1038/nrg2734)
5. Lumsden, C. J. & Wilson, E. O. 1981 Genes, mind, and culture. Cambridge, MA: Harvard University Press.
6. Boyd, R. & Richerson, P. J. 1985 Culture and the evolutionary process. Chicago, IL: University of Chicago Press.
7. Lehmann, L. & Feldman, M. W. 2009 Coevolution of adaptive technology, maladaptive culture and population size in a producer-scrounger game. Proc. R. Soc. B 276, 3853-3862. (doi:10.1098/rspb.2009.0724)
8. Barta, Z. & Giraldeau, A. 2001 Breeding colonies as information centers: a reappraisal of information-based hypotheses using the producer-scrounger game. Behav. Ecol. 12, 121-127. (doi:10.1093/beheco/12.2.121)
9. Clark, C. W. & Mangel, M. 1986 The evolutionary advantages of group foraging. Theoret. Popul. Biol. 30, 45-75. (doi:10.1016/0040-5809(86)90024-9)
10. Giraldeau, L.-A., Valone, T. J. & Templeton, J. J. 2002 Potential disadvantages of using socially acquired information. Phil. Trans. R. Soc. Lond. B. 357, 1559-1566. (doi:10.1098/rstb.2002.1065)
11. Bateson, M. & Kacelnik, A. 1997 Starlings' preferences for predictable and unpredictable delays to food. Anim. Behav. 53, 1129-1142. (doi:10.1006/anbe.1996.0388)
12. Erev, I.&Barron,G. 2005On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychol. Rev. 112, 912-931. (doi:10.1037/0033-295X.112.4.912)
13. Niv, Y., Joel, D., Meilijson, I. & Ruppin, E. 2002 Evolution of reinforcement learning in uncertain environments: a simple explanation for complex foraging behaviors. Adapt. Behav. 10, 5-24. (doi:10.1177/ 10597123020101001)
14. Shafir, S., Reich, T., Tsur, E., Erev, I. & Lotem, A. 2008 Perceptual accuracy and conflicting effects of certainty on risk-taking behaviour. Nature 453, 917-920. (doi:10. 1038/nature06841)
15. Denrell, J. & March, J. G. 2001 Adaptation as information restriction: the hot stove effect. Organ. Sci. 12, 523-538. (doi:10.1287/orsc. 12.5.523.10092)
16. March, J. G. 1996 Learning to be risk averse. Psychol. Rev. 103, 309-319. (doi:10.1037/0033-295X.103.2.309)
17. Edenius, L. 1991 The effect of resource depletion on the feeding behaviour of a browser: winter foraging by moose on Scots pine. J. Appl. Ecol. 28, 318-328. (doi:10.2307/2404132)
18. Kelrick, M. I., Macmahon, J. A., Parmenter, R. R. & Sisson, D. V. 1986 Native seed preferences of shrubsteppe rodents, birds and ants: the relationships of seed attributes and seed use. Oecologia 68, 327-337. (doi:10. 1007/BF01036734)
19. Lewis, A. 1980 Patch by gray squirrels and optimal foraging. Ecology 61, 1371-1379. (doi:10.2307/1939046)
20. Price, M. & Reichman, O. 1987 Distribution of seeds in Sonoran Desert soils: implications for heteromyid rodent foraging. Ecology 68, 1797-1811. (doi:10.2307/1939871)
21. Stephens, D. 1981 The logic of risk-sensitive foraging preferences. Anim. Behav. 29, 628-629. (doi:10.1016/S0003-3472(81)80128-5)
22. Real, L. A. 1991 Animal choice behavior and the evolution of cognitive architecture. Science 253, 980-986. (doi:10. 1126/science.1887231)
23. Rogers, A. R. 1988 Does biology constrain culture? Am. Anthropol. 90, 819-831. (doi:10.1525/aa.1988.90.4. 02a00030)
24. Boyd, R. & Richerson, P. J. 1995 Why does culture increase human adaptability? Ethol. Sociobiol. 16, 125-143. (doi:10.1016/0162-3095(94)00073-G)
25. Galef, B. G. & Laland, K. N. 2005 Social learning in animals: empirical studies and theoretical models. Bioscience 55, 489-499. (doi:10.1641/0006-3568(2005) 055[0489:SLIAES]2.0.CO;2)
26. Kendal, R. L., Coolen, I., van Bergen, Y. & Laland, K. N. 2005 Trade-offs in the adaptive use of social and asocial learning. Adv. Stud. Behav. 35, 333-379. (doi:10.1016/S0065-3454(05)35008-X)
27. Laland, K. N. 2004 Social learning strategies. Learn. Behav. 32, 4-14. (doi:10.3758/BF03196002)
28. Kendal, J., Giraldeau, L. A. & Laland, K. 2009 The evolution of social learning rules: payoff-biased and frequency- dependent biased transmission. J. Theoret. Biol. 260, 210-219. (doi:10.1016/j.jtbi.2009.05.029)
29. Rendell, L., Fogarty, L. & Laland, K. N. 2010 Rogers'paradox recast and resolved: population structure and the evolution of social learning strategies. Evolution 64, 534-548. (doi:10.1111/j.1558-5646.2009.00817.x)
30. Aoki, K., Wakano, J. Y. & Feldman, M. W. 2005 The emergence of social learning in a temporally changing environment: a theoretical model. Curr. Anthropol. 46, 334-340. (doi:10.1086/428791)
31. Wakano, J. Y., Aoki, K. & Feldman, M. W. 2004 Evolution of social learning: a mathematical analysis. Theoret. Popul. Biol. 66, 249-258. (doi:10.1016/j.tpb. 2004.06.005)
32. Johnsson, J. I. & Sundström, L. F. 2007 Social transfer of predation risk information reduces food locating ability in European minnows (Phoxinus phoxinus). Ethology 113, 166-173. (doi:10.1111/j.1439-0310.2006.01296. x)
33. Laland, K. N. & Williams, K. 1998 Social transmission of maladaptive information in the guppy. Behav. Ecol. 9, 493-499. (doi:10.1093/beheco/9.5.493)
34. Morand-Ferron, J. & Giraldeau, A. 2010 Learning behaviorally stable solutions to producer-scrounger games. Behav. Ecol. 21, 343-348. (doi:10.1093/beheco/arp195)
35. Reader, S. M., Bruce, M. J. & Rebers, S. 2008 Social learning of novel route preferences in adult humans. Biol. Lett. 4, 37-40. (doi:10.1098/rsbl.2007.0544)
36. Rieucau, G. & Giraldeau, A. 2009 Persuasive companions can be wrong: the use of misleading social information in nutmeg mannikins. Behav. Ecol. 20, 1217-1222. (doi:10.1093/beheco/arp121)
37. Elliott, D. & Smith, D. 1993 Football stadia disasters in the United Kingdom: learning from tragedy? Organ. Environ. 7, 205-229. (doi:10.1177/ 108602669300700304)
38. Helbing, D., Farkas, I. & Vicsek, T. 2000 Simulating dynamical features of escape panic. Nature 407, 487-490. (doi:10.1038/35035023)
39. Stephens, D. W. 1991 Change, regularity, and value in the evolution of animal learning. Behav. Ecol. 2, 77-89. (doi:10.1093/beheco/2.1.77)
40. Rendell, L. et al. 2010 Why copy others? Insights from the social learning strategies tournament. Science 328, 208-213. (doi:10.1126/science. 1184719)
41. Barnard, C. J. & Sibly, R. M. 1981 Producers and scroungers-a general model and its application to captive flocks of house sparrows. Anim. Behav. 29, 543-550. (doi:10. 1016/S0003-3472(81)80117-0)
42. Giraldeau, L.-A. & Caraco, T. 2000 Social foraging theory. Princeton, NJ: Princeton University Press.
43. Giraldeau, A. 1997 The ecology of information use. In Behavioral ecology: an evolutionary approach (eds J. R. Krebs & N. B. Davis), pp. 42-68. Oxford, UK: Blackwell Scientific Publications.
44. Arbilly, M., Motro, U., Feldman, M. W. & Lotem, A. 2010 Co-evolution of learning complexity and social foraging strategies. J. Theoret. Biol. 267, 573-581. (doi:10.1016/j.jtbi.2010.09.026)
45. Groß, R., Houston, A. I., Collins, E. J., McNamara, J. M., Dechaume-Moncharmont, F. X. & Franks, N. R. 2008 Simple learning rules to cope with changing environments. J. R. Soc. Interface 5, 1193-1202. (doi:10.1098/rsif.2007.1348)
46. Henrich, J. & Boyd, R. 1998 The evolution of conformist transmission and the emergence of between-group differences. Evol. Hum. Behav. 19, 215-241. (doi:10.1016/S1090-5138(98)00018-X)
47. Nolfi, S., Elman, J. L. & Parisi, D. 1994 Learning and evolution in neural networks. Adapt. Behav. 3, 5-28. (doi:10. 1177/105971239400300102)
48. Buchanan, M. 2009 Economics: meltdown modelling. Nature 460, 680-682. (doi:10.1038/460680a)
49. Epstein, J. M. 2009 Modelling to contain pandemics. Nature 460, 687. (doi:10.1038/460687a)
50. Peck, S. L. 2004 Simulation as experiment: a philosophical reassessment for biological modeling. Trends Ecol. Evol. 19, 530-534. (doi:10.1016/j.tree. 2004.07.019)
51. Katsnelson, E., Motro, U., Feldman, M. W. & Lotem, A. 2008 Early experience affects producer-scrounger foraging tendencies in the house sparrow. Anim. Behav. 75, 1465-1472. (doi:10.1016/j.anbehav.2007.09.020)
52. Katsnelson, E., Motro, U., Feldman, M. W. & Lotem, A. 2010 Individual-learning ability predicts social-foraging strategy in house sparrows. Proc. R. Soc. B 278, 582-589. (doi:10.1098/rspb.2010.1151)
53. Lendvai, A. Z., Barta, Z., Liker, A. & Bokony, V. 2004 The effect of energy reserves on social foraging: hungry sparrows scrounge more. Proc. R. Soc. Lond. B 271, 2467-2472. (doi:10.1098/rspb.2004.2887)
54. Liker, A. & Barta, Z. 2002 The effects of dominance on social foraging tactic use in house sparrows. Behaviour 139, 1061-1076. (doi:10.1163/15685390260337903)
55. Liker, A. & Bokony, V. 2009 Larger groups are more successful in innovative problem solving in house sparrows. Proc. Natl Acad. Sci. USA 106, 7893-7898. (doi:10.1073/pnas.0900042106)
56. Grimm, V. et al. 2006 A standard protocol for describing individual-based and agent-based models. Ecol. Model. 198, 115-126. (doi:10.1016/j.ecolmodel. 2006.04.023)
57. Grimm, V., Berger, U., DeAngelis, D., Polhill, J., Giske, J.& Railsback, S. 2010 The ODD protocol: a review and first update. Ecol. Model. 221, 2760-2768. (doi:10.1016/ j.ecolmodel.2010.08.019)
58. Arbilly, M., Motro, U., Feldman, M. W. & Lotem, A. Submitted. Recombination and the evolution of coordinated phenotypic expression in a frequency-dependent game.
59. Beauchamp, G. 2000 Learning rules for social foragers: implications for the producer-scrounger game and ideal free distribution theory. J. Theoret. Biol. 207, 21-35. (doi:10.1006/jtbi.2000.2153)
60. Bernstein, C., Kacelnik, A. & Krebs, J. R. 1988 Individual decisions and the distribution of predators in a patchy environment. J. Anim. Ecol. 57, 1007-1026. (doi:10.2307/5108)
61. McNamara, J. M. & Houston, A. I. 1987 Memory and the efficient use of information. J. Theoret. Biol. 125, 385-395. (doi:10.1016/S0022-5193(87)80209- 6)
62. Ben-Akiva, M. & Lerman, S. 1985 Discrete choice analysis: theory and application to travel demand. Cambridge, UK: MIT Press.
63. Bereby-Meyer, Y. & Erev, I. 1998 On learning to become a successful loser: a comparison of alternative abstractions of learning processes in the loss domain. J. Math. Psychol. 42, 266-286. (doi:10.1006/jmps.1998.1214)
64. Busemeyer, J. R.&Myung, I. J. 1992 An adaptive approach to human decision making: learning theory, decision theory, and human performance. J. Exp. Psychol. Gen. 121, 177-194. (doi:10.1037/0096-3445.121.2.177)
65. Camerer, C. & Ho, T. H. 1999 Experience-weighted attraction learning in normal form games. Econometrica 67, 827-874. (doi:10.1111/1468-0262.00054)
66. Belmaker, A. 2007 Learning to choose among social foraging strategies in adult house sparrows. MS thesis, Tel-Aviv University, Tel-Aviv, Israel. [In Hebrew].
67. Hamblin, S. & Giraldeau, A. 2009 Finding the evolutionarily stable learning rule for frequency-dependent foraging. Anim. Behav. 78, 1343-1350. (doi:10.1016/j.anbehav. 2009.09.001)
68. Eliassen, S., Jørgensen, C., Mangel, M. & Giske, J. 2007 Exploration or exploitation: life expectancy changes the value of learning in foraging strategies. Oikos 116, 513-523. (doi:10.1111/j.2006.0030-1299. 15462.x)
69. Munichor, N., Erev, I. & Lotem, A. 2006 Risk attitude in small timesaving decisions. J. Exp. Psychol.-Appl. 12, 129-141. (doi:10.1037/1076- 898X.12.3.129)
70. Franz, M. & Nunn, C. L. 2009 Rapid evolution of social learning. J. Evol. Biol. 22, 1914-1922. (doi:10.1111/j.1420-9101.2009.01804.x)
71. Beauchamp, G. & Kacelnik, A. 1991 Effects of the knowledge of partners on learning rates in zebra finches Taeniopygia guttata. Anim. Behav. 41, 247-253. (doi:10. 1016/S0003-3472(05)80476-2)
72. Giraldeau, L.-A. & Lefebvre, L. 1987 Scrounging prevents cultural transmission of food-finding behavior in pigeons. Anim. Behav. 35, 387-394. (doi:10.1016/S0003-3472 (87)80262-2)
73. Lefebvre, L. & Helder, R. 1997 Scrounger numbers and the inhibition of social learning in pigeons. Behav. Process. 40, 201-207. (doi:10.1016/S0376- 6357(97)00783-3)
74. Caldwell, C. A. & Whiten, A. 2003 Scrounging facilitates social learning in common marmosets, Callithrix jacchus. Anim. Behav. 65, 1085-1092. (doi:10.1006/anbe.2003.2145)
75. Fritz, J. & Kotrschal, K. 1999 Social learning in common ravens, Corvus corax. Anim. Behav. 57, 785-793. (doi:10. 1006/anbe.1998.1035)
76. Enquist, M., Eriksson, K. & Ghirlanda, S. 2007 Critical social learning: a solution to Rogers's paradox of nonadaptive culture. Am. Anthropol. 109, 727-734. (doi:10.1525/ aa.2007.109.4.727)