Evolution of learned strategy choice in a frequency-dependent game

Proceedings of the Royal Society B: Biological Sciences

Volumn 279, Issue 1731, 2012, Pages 1176-1184

  Katsnelson, Edith ^a   Motro, Uzi ^b   Feldman, Marcus W ^c   Lotem, Arnon ^a  

^a TEL AVIV UNIVERSITY   (Israel)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Evolutionary simulation; Phenotypic asymmetries; Producer scrounger game; Social foraging

Indexed keywords

ASYMMETRY; ENVIRONMENTAL CHANGE; EVOLUTIONARILY STABLE STRATEGY; EVOLUTIONARY THEORY; FORAGING BEHAVIOR; FREQUENCY DEPENDENCE; INNATE BEHAVIOR; LEARNING; NATURAL SELECTION; PHENOTYPE; PRODUCER-SCROUNGER INTERACTION;

EID: 84856790601     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2011.1734     Document Type: Article

References (51)

1. Maynard-Smith, J. & Price, G. R. 1973 The logic of animal conflict. Nature 246, 15-18. (doi:10.1038/246015a0)
2. Maynard-Smith, J. 1982 Evolution and the theory of games. Cambridge, UK: Cambridge University Press.
3. Harley, C. B. 1981 Learning the evolutionarily stable strategy. J. Theor. Biol. 89, 611-633. (doi:10.1016/0022-5193(81)90032-1)
4. Beauchamp, G. 2000 Learning rules for social foragers: implications for the producer-scrounger game and ideal free distribution theory. J. Theor. Biol. 207, 21-35. (doi:10.1006/jtbi.2000.2153)
5. Hamblin, S. & Giraldeau, L. A. 2009 Finding the evolutionarily stable learning rule for frequency-dependent foraging. Anim. Behav. 78, 1343-1350. (doi:10.1016/j.anbehav.2009.09.001)
6. Bernstein, C., Kacelnik, A. & Krebs, J. R. 1988 Individual decisions and the distribution of predators in a patchy environment. J. Anim. Ecol. 57, 1007-1026. (doi:10.2307/5108)
7. Borgers, T. & Sarin, R. 1997 Learning through reinforcement and replicator dynamics. J. Econ. Theor. 77, 1-14. (doi:10.1006/jeth.1997.2319)
8. Stephens, D. W. 1991 Change, regularity, and value in the evolution of animal learning. Behav. Ecol. 2, 77-89. (doi:10.1093/beheco/2.1.77)
9. Dunlap, A. S. & Stephens, D. W. 2009 Components of change in the evolution of learning and unlearned preference. Proc. R. Soc. B 276, 3201-3208. (doi:10.1098/ rspb.2009.0602)
10. Bateson, P. 1979 How do sensitive periods arise and what are they for? Anim. Behav. 27, 470-486. (doi:10.1016/0003-3472(79)90184-2)
11. Houston, A. I. & Sumida, B. H. 1987 Learning rules, matching and frequency-dependence. J. Theor. Biol. 126, 289-308. (doi:10.1016/S0022-5193(87)80236-9)
12. Maynard-Smith, J. 1988 Can a mixed strategy be stable in a finite population? J. Theor. Biol. 130, 247-251. (doi:10.1016/S0022-5193(88)80100-0)
13. Crawford, V. P. 1989 Learning and mixed-strategy equilibria in evolutionary games. J. Theor. Biol. 140, 537-550. (doi:10.1016/S0022-5193(89)80113-4)
14. Fogel, D. B., Fogel, G. B. & Andrews, P. C. 1997 On the instability of evolutionary stable strategies. Biosystems 44, 135-152. (doi:10.1016/S0303-2647(97)00050-6)
15. Fogel, G. B., Andrews, P. C. & Fogel, D. B. 1998 On the instability of evolutionary stable strategies in small populations. Ecol. Model 109, 283-294. (doi:10.1016/ S0304-3800(98)00068-4)
16. Kedar, H., Rodriguez-Girones, M. A., Yedvab, S., Winkler, D. W. & Lotem, A. 2000 Experimental evidence for offspring learning in parent-offspring communication. Proc. R. Soc. Lond. B 267, 1723-1727. (doi:10.1098/rspb.2000.1201)
17. Bell, K. E. & Baum, W. M. 2002 Group foraging sensitivity to predictable and unpredictable changes in food distribution: past experience or present circumstances? J. Exp. Anal. Behav. 78, 179-194. (doi:10.1901/jeab.2002.78-179)
18. Belmaker, A. 2007 Learning to choose between foraging strategies in adult house sparrows. MS thesis, Tel-Aviv University, Tel-Aviv, Israel.
19. Morand-Ferron, J. & Giraldeau, L. A. 2010 Learning behaviorally stable solutions to producer-scrounger games. Behav. Ecol. 21, 343-348. (doi:10.1093/beheco/arp195)
20. Katsnelson, E., Motro, U., Feldman, M. W. & Lotem, A. 2008 Early experience affects producer-scrounger foraging tendencies in the house sparrow. Anim. Behav. 75, 1465-1472. (doi:10.1016/j.anbehav.2007.09.020)
21. Barnard, C. J. & Sibly, R. M. 1981 Producers and scroungers: a general-model and its application to captive flocks of house sparrows. Anim. Behav. 29, 543-550. (doi:10.1016/S0003-3472(81)80117-0)
22. Giraldeau, L. A. & Caraco, T. 2000 Social foraging theory. Princeton, NJ: Princeton University Press.
23. Dubois, F., Morand-Ferron, J. & Giraldeau, L. A. 2010 Learning in a game context: strategy choice by some keeps learning from evolving in others. Proc. R. Soc. B 277, 3609-3616. (doi:10.1098/rspb.2010.0857)
24. Wolf, M, van Doorn, G. S. & Weissing, F. J. 2008 Evolutionary emergence of responsive and unresponsive personalities. Proc. Natl Acad. Sci. USA 105, 15825-15830. (doi:10.1073/pnas.0805473105)
25. Real, L. A. 1991 Animal choice behavior and the evolution of cognitive architecture. Science 253, 980-986. (doi:10.1126/science.1887231)
26. Niv, Y., Joel, D., Meilijson, I. & Ruppin, E. 2002 Evolution of reinforcement learning in foraging bees: a simple explanation for risk averse behavior. Neurocomputing 44, 951-956. (doi:10.1016/S0925-2312(02)00496-4)
27. Arbilly, M., Motro, U., Feldman, M. W. & Lotem, A. 2010 Co-evolution of learning complexity and social foraging strategies. J. Theor. Biol. 267, 573-581. (doi:10.1016/j.jtbi.2010.09.026)
28. Houston, A. I. & McNamara, J. M. 1988 The ideal free distribution when competitive abilities differ: an approach based on statistical-mechanics. Anim. Behav. 36, 166-174. (doi:10.1016/S0003-3472(88)80260-4)
29. Barta, Z. & Giraldeau, L. A. 1998 The effect of dominance hierarchy on the use of alternative foraging tactics: a phenotype-limited producing-scrounging game. Behav. Ecol. Sociobiol. 42, 217-223. (doi:10.1007/s002650050433)
30. Fishman, M. A., Lotem, A. & Stone, L. 2001 Heterogeneity stabilizes reciprocal altruism interactions. J. Theor. Biol. 209, 87-95. (doi:10.1006/jtbi.2000.2248)
31. Dubois, F., Giraldeau, L. A. & Grant, J. W. A. 2003 Resource defense in a group-foraging context. Behav. Ecol. 14, 2-9. (doi:10.1093/beheco/14.1.2)
32. McElreath, R. & Strimling, P. 2006 How noisy information and individual asymmetries canmake 'personality' an adaptation: a simple model. Anim. Behav. 72, 1135-1139. (doi:10.1016/j.anbehav.2006.04.001)
33. Ruxton, G. D. & Beauchamp, G. 2008 The application of genetic algorithms in behavioural ecology, illustrated with a model of anti-predator vigilance. J. Theor. Biol. 250, 435-448. (doi:10.1016/j.jtbi.2007.10.022)
34. Schwabl, H. 1993 Yolk is a source of maternal testosterone for developing birds. Proc. Natl Acad. Sci. USA 90, 11446-11450. (doi:10.1073/pnas.90.24.11446)
35. Groothuis, T.G.G. & Carere, C. 2005 Avian personalities: characterization and epigenesis. Neurosci. Biobehav. Rev. 29, 137-150. (doi:10.1016/j.neubiorev.2004.06.010)
36. McNamara, J. M. & Houston, A. I. 1987 Memory and the efficient use of information. J. Theor. Biol. 125, 385-395. (doi:10.1016/S0022-5193(87)80209-6)
37. Mery, F. & Kawecki, T. J. 2004 An operating cost of learning in Drosophila melanogaster. Anim. Behav. 68, 589-598. (doi:10.1016/j.anbehav.2003.12.005)
38. Bergstrom, C. T. & Godfrey-Smith, P. 1998 On the evolution of behavioral heterogeneity in individuals and populations. Biol. Philos. 13, 205-231. (doi:10.1023/ A:1006588918909)
39. Krebs, J. R. & Davies, N. B. 1993 An introduction to behavioural ecology. Oxford, UK: Blackwell Scientific Publications.
40. Feldman, M. W., Aoki, K. & Kumm, J. 1996 Individual versus social learning: evolutionary analysis in a fluctuating environment. Anthropol. Sci. 104, 209-231.
41. Beauchamp, G. 2001 Consistency and flexibility in the scrounging behaviour of zebra finches. Can. J. Zool. 79, 540-544. (doi:10.1139/z01-008)
42. Giraldeau, L. A., Caraco, T. & Valone, T. J. 1994 Social foraging: individual learning and cultural transmission of innovations. Behav. Ecol. 5, 35-43. (doi:10.1093/beheco/5.1.35)
43. March, J. G. 1996 Learning to be risk averse. Psychol. Rev. 103, 309-319. (doi:10.1037/0033-295X.103.2.309)
44. Gross, R., Houston, A. I., Collins, E. J., McNamara, J. M., Dechaume-Moncharmont, F. X. & Franks, N. R. 2008 Simple learning rules to cope with changing environments. J. R. Soc. Interface 5, 1193-1202. (doi:10.1098/rsif.2007.1348)
45. Dall, S. R. X., Houston, A. I. & McNamara, J. M. 2004 The behavioural ecology of personality: consistent individual differences from an adaptive perspective. Ecol. Lett. 7, 734-739. (doi:10.1111/j.1461-0248.2004.00618.x)
46. Liker, A. & Barta, Z. 2002 The effects of dominance on social foraging tactic use in house sparrows. Behaviour 139, 1061-1076. (doi:10.1163/15685390260337903)
47. Beauchamp, G. 2006 Phenotypic correlates of scrounging behavior in zebra finches: role of foraging efficiency and dominance. Ethology 112, 873-878. (doi:10.1111/j.1439-0310.2006.01241.x)
48. Marchetti, C. & Drent, P. J. 2000 Individual differences in the use of social information in foraging by captive great tits. Anim. Behav. 60, 131-140. (doi:10.1006/ anbe.2000.1443)
49. Bell, A. M. 2007 Evolutionary biology: animal personalities. Nature 447, 539-540. (doi:10.1038/447539a)
50. Sih, A. & Bell, A. M. 2008 Insights for behavioral ecology from behavioral syndromes. Adv. Stud. Behav. 38, 227-281. (doi:10.1016/S0065-3454(08)00005-3)
51. Sih, A., Bell, A. M., Johnson, J. C. & Ziemba, R. E. 2004 Behavioral syndromes: an integrative overview. Q. Rev. Biol. 79, 241-277. (doi:10.1086/422893)