Does natural selection favour the Rescorla-Wagner rule?

Journal of Theoretical Biology

Volumn 302, Issue , 2012, Pages 39-52

  Trimmer, Pete C ^a   McNamara, John M ^a   Houston, Alasdair I ^a   Marshall, James A R ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Associative value; Classical conditioning; Learning rule; Natural selection; Rescorla Wagner

Indexed keywords

ANIMAL; LEARNING; NATURAL SELECTION; OPTIMIZATION; PARAMETERIZATION; SOCIAL BEHAVIOR;

ANIMAL BEHAVIOR; ARTICLE; ASSOCIATIVE VALUE; CONDITIONING; EVOLUTION; LEARNING; NATURAL SELECTION; OPTIMALLY PERFORMING RULE; PRIORITY JOURNAL; RESCORLA WAGNER RULE;

ANIMALS; ASSOCIATION LEARNING; BEHAVIOR, ANIMAL; BIOLOGICAL EVOLUTION; CONDITIONING, CLASSICAL; MODELS, GENETIC; MODELS, PSYCHOLOGICAL; REPRODUCTION; SELECTION, GENETIC;

ANIMALIA;

EID: 84858734932     PISSN: 00225193     EISSN: 10958541     Source Type: Journal    
DOI: 10.1016/j.jtbi.2012.02.014     Document Type: Article

References (34)

1. Bitterman M.E. Cognitive evolution: a psychological perspective. The Evolution of Cognition 2000, 61-79. MIT Press, Cambridge, MA. C. Heyes, L. Huber (Eds.).
2. Bush R.R., Mosteller F. A mathematical model for simple learning. Psychol. Rev. 1951, 58:313-323.
3. Carlin B.P., Louis T.A. Bayes and Empirical Bayes Methods for Data Analysis. Monographs on Statistics and Applied Probability 1996, Chapman & Hall, London, pp. 50-52.
4. Cremer T., Cremer C. Chromosome territories, nuclear architecture and gene regulation in mammalian cells. Nat. Rev. Genet. 2001, 2(4):292-301.
5. Dayan P., Abbott L.F. Theoretical Neuroscience: Computational and Mathematical Modelling of Neural Systems 2001, MIT Press, Cambridge, MA, (Chapter 9, esp. pp. 339-340).
6. Dayan P., Kakade S, Read Montague P. Learning and selective attention. Nat. Neurosci. 2000, 3:1218-1223.
7. Dayan P., Long T. Statistical models of conditioning. Advances in Neural Information Processing Systems 1998, vol. 10:117-123.
8. Dickinson A. Contemporary Animal Learning Theory. Problems in the Behavioural Sciences 1980, Cambridge University Press, Cambridge.
9. Fisher R.A. The Genetical Theory of Natural Selection 1958, Dover, New York. second ed.
10. Gigerenzer G. Decision making: nonrational theories. Int. Encyclopedia Soc. Behav. Sci. 2001, 5:3304-3309.
11. Gigerenzer G. Why heuristics work. Perspect. Psychol. Sci. 2008, 3:20-29.
12. Gigerenzer G., Todd P.M. Simple Heuristics that Make Us Smart 1999, Oxford University Press, Oxford.
13. Kakade S., Dayan P. Dopamine: generalization and bonuses. Neural Networks 2002, 15(4-6):549-559.
14. Kalman R.E. A new approach to linear filtering and prediction problems. J. Basic Eng. 1960, 82(1):35-45.
15. Koza J.R. Genetic Programming: on the Programming of Computers by Means of Natural Selection 1992, MIT Press, Cambridge, MA.
16. McNamara J.M., Houston A.I. The application of statistical decision theory to animal behaviour. J. Theor. Biol. 1980, 85(4):673-690.
17. McNamara J.M., Houston A.I. Optimal foraging and learning. J. Theor. Biol. 1985, 117:231-249.
18. McNamara J.M., Houston A.I. Memory and the efficient use of information. J. Theor. Biol. 1987, 125:385-395.
19. McNamara J.M., Houston A.I. Integrating function and mechanism. Trends Ecol. Evol. 2009, 24(12):670-675.
20. Miller R.R., Barnet R.C., Grahame N.J. Assessment of the Rescorla-Wagner model. Psychol. Bull. 1995, 117(3):363-386.
21. Niv Y., Montague P.R. Theoretical and empirical studies of learning. Neuroeconomics: Decision Making and the Brain 2009, 331-351. Academic Press, London. P.W. Glimcher, C.F. Camerer, E. Fehr, R.A. Poldrack (Eds.).
22. Pavlov I.P. Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex 1927, Dover Publications, London.
23. Rescorla R.A. Probability of shock in the presence and absence of CS in fear conditioning. J. Comp. Physiol. Psychol. 1968, 66(1):1-5.
24. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II, Current Theory and Research. Century Psychology Series 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
25. Schmajuk N.A. Classical conditioning, signal detection, and evolution. Behav. Processes 1987, 14(3):277-289.
26. Schmajuk N.A., Dicarlo J.J. Stimulus configuration, classical conditioning, and hippocampal function. Psychol. Rev. 1992, 99(2):268-305.
27. Schmajuk N.A., Larrauri J.A. Experimental challenges to theories of classical conditioning: application of an attentional model of storage and retrieval. J. Exp. Psychol.: Anim. Behav. Processes 2006, 32(1):1-20.
28. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80(1):1-27.
29. Siegel S., Allan L.G. The widespread influence of the Rescorla-Wagner model. Psychon. Bull. Rev. 1996, 3:314-321.
30. Stephens D.W., Krebs J.R. Foraging Theory 1986, Princeton University Press, New Jersey.
31. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 1981, 88(2):135-170.
32. Sutton, R.S., 1992. Gain adaptation beats least squares. In: Proceedings of the Seventh Yale Workshop on Adaptive and Learning Systems, New Haven, CT, pp. 161-166.
33. Trimmer, P.C., 2010. The Evolution of Decision-making: Various Modelling Approaches. Ph.D. Thesis, University of Bristol.
34. Trimmer P.C., Houston A.I., Marshall J.A.R., Paul E.S., Mendl M.T., McNamara J.M. Decision-making under uncertainty: biases and Bayesians. Anim. Cognit 2011, 10.1007/s10071-011-0387-4.