Understanding the evolution of learning by explicitly modeling learning mechanisms

Current Zoology

Volumn 61, Issue 2, 2015, Pages 341-349

  Arbilly, Michal ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Agent based simulation; Cognition; Decision rule; Learning bias; Learning rule

Indexed keywords

ANIMALIA;

EID: 84925437372     PISSN: 16745507     EISSN: None     Source Type: Journal    
DOI: 10.1093/czoolo/61.2.341     Document Type: Article

References (76)

1. Afshar M, Giraldeau L-A, 2014. A unified modelling approach for producer-scrounger games in complex ecological conditions. Anim. Behav. 96: 167–176.
2. Amano T, Ushiyama K, Moriguchi S, 2006. Decision-making in group foragers with incomplete information: Test of individual-based model in geese. Ecol. Monogr. 76: 601–616.
3. Aoki K, Wakano JY, Feldman MW, 2005. The emergence of social learning in a temporally changing environment: A theoretical model. Curr. Anthropol. 46: 334–340.
4. Arbilly M, Laland KN, 2014. The local enhancement conundrum: In search of the adaptive value of a social learning mechanism. Theor. Popul. Biol. 91: 50–57.
5. Arbilly M, Motro U, Feldman MW, Lotem A, 2010. Co-evolution of learning complexity and social foraging strategies. J. Theor. Biol. 267: 573–581.
6. Arbilly M, Motro U, Feldman MW, Lotem A, 2011. Evolution of social learning when high expected payoffs are associated with high risk of failure. J. R. Soc. Interface 8: 1604–1615.
7. Bateson M, Healy SD, Hurly TA, 2002. Irrational choices in hummingbird foraging behaviour. Anim. Behav. 63: 587–596.
8. Beauchamp G, 2000. Learning rules for social foragers: Implications for the producer-scrounger game and ideal free distribution theory. J. Theor. Biol. 207: 21–35.
9. Beauchamp G, Fernández-Juricic E, 2004. The group-size paradox: effects of learning and patch departure rules. Behav. Ecol. 16: 352–357.
10. Belmaker A, Motro U, Feldman MW, Lotem A, 2012. Learning to choose among social foraging strategies in adult house sparrows Passer domesticus. Ethology 118: 1111–1121.
11. Bereby-Meyer Y, Erev I, 1998. On learning to become a successful loser: A comparison of alternative abstractions of learning processes in the loss domain. J. Math. Psychol. 42: 266–286.
12. Bernstein C, Kacelnik A, Krebs JR, 1988. Individual decisions and the distribution of predators in a patchy environment. J. Anim. Ecol. 57: 1007–1026.
13. Boyd R, Richerson PJ, 1985. Culture and the Evolutionary Process. Chicago: University of Chicago Press.
14. Buchanan M, 2009. Meltdown modelling. Nature 460: 680–682.
15. Bush RR, Mosteler F, 1955. Stochastic Models for Learning.Oxford: John Wiley & Sons, Inc.
16. Charnov EL, 1976. Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9: 129–136.
17. Chittka L, Skorupski P, 2011. Information processing in miniature brains. Proc. R. Soc. B Biol. Sci. 278: 885–888.
18. A- receptor clustering results in enhanced anxiety and a bias for threat cues. Nat. Neurosci. 2: 833–839.
19. Dall SRX, Giraldeau L-A, Olsson O, McNamara JM, Stephens DW, 2005. Information and its use by animals in evolutionary ecology. Trends Ecol. Evol. 20: 187–193.
20. Denrell J, March JG, 2001. Adaption as information restriction : The hot stove effect. Organ. Sci. 12: 523–538.
21. Dridi S, Lehmann L, 2014. On learning dynamics underlying the evolution of learning rules. Theor. Popul. Biol. 91: 20–36.
22. Dubois F, Morand-Ferron J, Giraldeau L-A, 2010. Learning in a game context: Strategy choice by some keeps learning from evolving in others. Proc. R. Soc. B Biol. Sci. 277: 3609–3616.
23. Dunlap AS, Stephens DW, 2009. Components of change in the evolution of learning and unlearned preference. Proc. R. Soc. B Biol. Sci. 276: 3201–3208.
24. Eliassen S, Jørgensen C, Mangel M, Giske J, 2007. Exploration or exploitation: Life expectancy changes the value of learning in foraging strategies. Oikos 513–523.
25. Eliassen S, Jørgensen C, Mangel M, Giske J, 2009. Quantifying the adaptive value of learning in foraging behavior. Am. Nat. 174: 478–489.
26. Epstein JM, 2009. Modelling to contain pandemics. Nature 460: 687.
27. Epstein JM, Axtell RL, 1996. Growing Artificial Societies: Social Science from the Bottom Up. Washington: Brookings Institution Press.
28. Fawcett TW, Fallenstein WB, Higginson AD, Houston AI, Mall press DEW et al., 2014. The evolution of decision rules in complex environments. Trends Cogn. Sci. 18: 153–161.
29. Fawcett TW, Hamblin S, Giraldeau L-A, 2013. Exposing the behavioral gambit: The evolution of learning and decision rules. Behav. Ecol. 24: 2–11.
30. Feldman MW, Aoki K, Kumm J, 1996. Individual versus social learning: Evolutionary analysis in a fluctuating environment. Anthropol. Sci. 104: 209–231.
31. Frank MJ, Woroch BS, Curran T, 2005. Error-related negativity predicts reinforcement learning and conflict biases. Neuron 47: 495–501.
32. Frankenhuis WE, Del Giudice M, 2012. When do adaptive developmental mechanisms yield maladaptive outcomes? Dev. Psychol. 48: 628–642.
33. Franz M, Nunn CL, 2009. Rapid evolution of social learning. J. Evol. Biol. 22: 1914–1922.
34. Groß R, Houston AI, Collins EJ, McNamara JM, Dechaume-Moncharmont F-X et al., 2008. Simple learning rules to cope with changing environments. J. R. Soc. Interface 5: 1193–1202.
35. Hamblin S, Giraldeau L-A, 2009. Finding the evolutionarily stable learning rule for frequency-dependent foraging. Anim. Behav. 78: 1343–1350.
36. Harley CB, 1981. Learning the evolutionarily stable strategy. J. Theor. Biol. 89: 611–633.
37. Houston AI, Sumida BH, 1987. Learning rules, matching and frequency dependence. J. Theor. Biol. 126: 289–308.
38. Ilan T, Katsnelson E, Motro U, Feldman MW, Lotem A, 2013. The role of beginner’s luck in learning to prefer risky patches by socially foraging house sparrows. Behav. Ecol. 24: 1398–1406.
39. Kacelnik A, Bateson M, 1997. Risk sensitivity: Crossroads for theories of decision-making. Trends Cogn. Sci. 1: 304–309.
40. Kahneman D, Tversky A, 1979. Prospect theory: An analysis of decision under risk. Econometrica 47: 263–291.
41. Katsnelson E, Motro U, Feldman MW, Lotem A, 2012. Evolution of learned strategy choice in a frequency-dependent game. Proc. R. Soc. B Biol. Sci. 279: 1176–1184.
42. Kendal J, Giraldeau L-A, Laland K, 2009. The evolution of social learning rules: Payoff-biased and frequency-dependent biased transmission. J. Theor. Biol. 260: 210–219.
43. Kolodny O, Edelman S, Lotem A, 2014. The evolution of continuous learning of the structure of the environment. J. R. Soc. Interface11: 20131091.
44. Lotem A, Biran-Yoeli I, 2014. Evolution of learning and levels of selection: A lesson from avian parent-offspring communication. Theor. Popul. Biol. 91: 58–74.
45. March JG, 1996. Learning to be risk averse. Psychol. Rev. 103: 309–319.
46. Maren S, Quirk GJ, 2004. Neuronal signalling of fear memory. Nat. Rev. Neurosci. 5: 844–852.
47. Marsh B, Kacelnik A, 2002. Framing effects and risky decisions in starlings. Proc. Natl. Acad. Sci. U. S. A. 99: 3352–3355.
48. McNamara JM, Dall SRX, 2010. Information is a fitness enhancing resource. Oikos 119: 231–236.
49. McNamara JM, Houston AI, 1987a. Memory and the efficient use of information. J. Theor. Biol. 125: 385–395.
50. McNamara JM, Houston AI, 2009. Integrating function and mechanism. Trends Ecol. Evol. 24: 670–675.
51. McNamara JM, Houston AI, 1987. Memory and the efficient use of information. J. Theor. Biol. 125: 385–395.
52. McNamara JM, Houston AI, 1985. Optimal foraging and learning. J. Theor. Biol. 117: 231–249.
53. McNamara JM, Trimmer PC, Eriksson A, Marshall JAR, Houston AI, 2011. Environmental variability can select for optimism or pessimism. Ecol. Lett. 14: 58–62.
54. Mery F, Kawecki TJ, 2002. Experimental evolution of learning ability in fruit flies. Proc. Natl. Acad. Sci. U. S. A. 99: 14274– 14279.
55. Morand-Ferron J, Giraldeau L-A, 2010. Learning behaviorally stable solutions to producer-scrounger games. Behav. Ecol. 21: 343–348.
56. Peck SL, 2004. Simulation as experiment: A philosophical reassessment for biological modeling. Trends Ecol. Evol. 19: 530–534.
57. Regelmann K, 1984. Competitive resource sharing: A simulation model. Anim. Behav. 32: 226–232.
58. Rendell L, Boyd R, Cownden D, Enquist M, Eriksson K et al., 2010. Why copy others? Insights from the social learning strategies tournament. Science 328: 208–213.
59. Rendell L, Fogarty L, Laland KN, 2010b. Rogers’ paradox recast and resolved: Population structure and the evolution of social learning strategies. Evolution 64: 534–548.
60. Rescorla RA, Wagner AR, 1972. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF eds. Classical Conditioning II: Current Research and Theory. New York: Appleton-Century-Crofts, 64–99.
61. Robbins H, 1952. Some aspects of the sequential design of experiments. Bull. Am. Math. Soc. 58: 527–535.
62. Schönberg T, Daw ND, Joel D, O’Doherty JP, 2007. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 27: 12860–12867.
63. Schuck-Paim C, Pompilio L, Kacelnik A, 2004. State-dependent decisions cause apparent violations of rationality in animal choice. PLoS Biol. 2: e402.
64. Shafir S, Waite TA, Smith BH, 2002. Context-dependent violations of rational choice in honeybees Apis mellifera and gray jays Perisoreus canadensis. Behav. Ecol. Sociobiol. 51: 180–187.
65. ndedn. New York: Oxford University Press.
66. Stephens DW, 1991. Change, regularity, and value in the evolution of animal learning. Behav. Ecol. 2: 77–89.
67. Stephens DW, 1989. Variance and the value of information. Am. Nat. 134: 128–140.
68. Stephens DW, 1993. Learning and behavioral ecology: Incomplete information and environmental predictability. In:Papaj DR, Lewis AC eds. Insect Learning: Ecology and Evolutionary Perspectives. London: Chapman & Hall, 195–218.
69. Stephens DW, Krebs JR, 1986. Foraging Theory. Princeton: Princeton Univesity Press.
70. Sutton RS, Barto AG, 1998. Reinforcement Learning: An Introduction. Cambridge, Massachusetts: MIT Press.
71. Tenenbaum JB, Griffiths TL, Kemp C, 2006. Theory-based Bayesian models of inductive learning and reasoning. Trends Cogn. Sci. 10: 309–318.
72. Tracy ND, Seaman JW, 1995. Properties of evolutionarily stable learning rules. J. Theor. Biol. 177: 193–198.
73. Trimmer PC, McNamara JM, Houston AI, Marshall JAR, 2012. Does natural selection favour the Rescorla-Wagner rule? J. Theor. Biol. 302: 39–52. Elsevier.
74. Van der Post DJ, Hogeweg P, 2006. Resource distributions and diet development by trial-and-error learning. Behav. Ecol. Sociobiol. 61: 65–80.
75. Van der Post DJ, Hogeweg P, 2009. Cultural inheritance and diversification of diet in variable environments. Anim. Behav. 78: 155–166.
76. Van der Post DJ, Ursem B, Hogeweg P, 2009. Resource distributions affect social learning on multiple timescales. Behav. Ecol. Sociobiol. 63: 1643–1658.