Artificial life, natural rationality and probability matching

Proceedings of the 2007 IEEE Symposium on Artificial Life, CI-ALife 2007

Volumn , Issue , 2007, Pages 123-129

  Hardy Vallée, Benoit ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; PROBABILITY; PROBLEM SOLVING;

ALTERNATIVE HYPOTHESIS; ARTIFICIAL LIFE; NATURAL RATIONALITY; PROBABILITY MATCHING;

NEURAL NETWORKS;

EID: 34548783743     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALIFE.2007.367787     Document Type: Conference Paper

References (61)

1. D. C. Dennett, "Artificial Life as Philosophy," Artificial Life, vol. 1, pp. 291-292, 1994.
2. M. A. Boden, The philosophy of artificial life, Oxford; New York: Oxford University Press, 1996.
3. Bedau, "Philosophical Content and Method of Artificial Life," in The Digital Phoenix: How Computers are Changing Philosophy, T. W. Bynam and J. H. Moor, Eds.: Blackwell, 1998, pp. 135-152.
4. W. V. O. Quine, "Two Dogmas of Empiricism," The Philosophical Review, vol. 60, pp. 20-43, 1951.
5. W. V. O. Quine, Pursuit of truth. Cambridge, Mass.: Harvard University Press, 1990.
6. B. Hardy-Vallée, "Brains and decisions in the economy of nature," in Companion to Contemporary Philosophy of Biology, G. Terzis and R. Arp, Eds. Aldershot (U.K.): Ashgate, forthcoming, 2007.
7. G. Gigerenzer, "Fast and frugal heuristics: The tools of bounded rationality," in Blackwell handbook of judgment and decision making, D. Koehler and N. Harvey, Eds. Oxford: Blackwell, 2004, pp. 62-88.
8. D. Davidson, Problems of rationality. Oxford: Oxford University Press, 2004.
9. C. R. Gallistel, The organization of learning. Cambridge: MIT Press, 1990.
10. I. Erev and G. Barron, "On adaptation, maximization, and reinforcement learning among congnitive strategies," Psychol Rev, vol. 112, pp. 912-31, 2005.
11. A. K. Seth, "Modeling Group Foraging: Individual Suboptimality, Interference, and a Kind of Matching," Adaptive Behavior, vol. 9, pp. 67-89, 2001.
12. N. Vulkan, "An Economist's Perspective on Probability Matching," Journal of Economic Surveys, vol. 14, pp. 101-118, 2000.
13. U. Greggers and R. Menzel, "Memory dynamics and foraging strategies of honeybees," Behavioral Ecology and Sociobiology, vol. V32, pp. 17-29, 1993.
14. L. J. Savage, The foundations of statistics, New York,: Wiley, 1954.
15. K. J. Arrow, "Utilities, Attitudes, Chocies: A Review Note," Econometrica, vol. 26, pp. 1-23, 1958.
16. D. Kahneman, P. Slovic, and A. Tversky, "Judgment under uncertainty: heuristics and biases." Cambridge; New York: Cambridge University Press, 1982, pp. xiii, 555.
17. D. Kahneman and A. Tversky, "Prospect theory: An analysis of decision under risk," Econometrica, vol. 47, pp. 263-291, 1979.
18. J. H. Barkow, L. Cosmides, and J. Tooby, The Adapted mind: evolutionary psychology and the generation of culture. New York: Oxford University Press, 1992.
19. G. Gigerenzer, Adaptive thinking: rationality in the real world. New York: Oxford University Press, 2000.
20. G. Gigerenzer, P. M. Todd, and ABC Research Group., Simple heuristics that make us smart. New York; Oxford University Press, 1999.
21. L. Cosmides and J. Tooby, "Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty," Cognition, vol. 58, pp. 1-73, 1996.
22. G. Gigerenzer and K. Fiedler, "Minds in environments: The potential of an ecological approach to cognition," Manuscript submitted for publication, forthcoming.
23. T.P. Weber, "News from the realm of the ideal free distribution," Trends in Ecology & Evolution, vol. 13, pp. 89-90, 1998.
24. D. W. Stephens and J. R. Krebs, Foraging theory. Princeton, N.J.: Princeton University Press, 1986.
25. D. G. C. Harper, "Competitive foraging in mallards: "Ideal free' ducks," Animal Behaviour, vol. 30, pp. 575-584, 1982.
26. A. E. Lamb and J. G. Ollason, "Foraging wood-ants Formica aquilonia yarrow (hymenoptera; formicidae) tend to adopt the ideal free distribution," Behavioural Processes, vol. 28, pp. 189-198, 1993.
27. T. C. Grand, "Foraging site selection by juvenile coho salmon: ideal free distributions of unequal competitors," Animal Behaviour, vol. 53, pp. 185-196, 1997.
28. M. B. Sokolowski, F. Tonneau, and E. Freixa i Baque, "The ideal free distribution in humans: an experimental test," Psychon Bull Rev, vol. 6, pp. 157-61, 1999.
29. G. J. Madden, B. F. Peden, and T. Yamaguchi, "Human group choice: discrete-trial and free-operant tests of the ideal free distribution," J Exp Anal Behav, vol. 78, pp. 1-15, 2002.
30. P. W. Glimcher, Decisions, uncertainty, and the brain: the science of neuroeconomics. Cambridge, Mass.; London: MIT Press, 2003.
31. C. R. Gallistel, "Deconstructing the law of effect," Games and Economics Behavior, vol. 52, pp. 410-423, 2005.
32. A. K. Seth, "The ecology of action selection: Insights from artificial life," Phil. Trans. Roy. Soc. B., vol. http://www.nsi.edu/users/seth/Papers/Seth PTRS.pdf, in press.
33. C. Rode, L. Cosmides, W. Hell, and J. Tooby, "When and why do people avoid unknown probabilities in decisions under uncertainty? Testing some predictions from optimal foraging theory," Cognition, vol. 72, pp. 269-304, 1999.
34. B. Seth and M. T. Peter, "Made to Measure: Ecological Rationality in Structured Environments," Minds and Machines, vol. V9, pp. 497-541, 1999.
35. Y. Niv, D. Joel, L. Meilijson, and E. Ruppin, "Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors," Adaptive Behavior, vol. 10, pp. 5-24, 2002.
36. D. J. Anderson, "Optimal foraging and the traveling salesman," Theoretical Population Biology, vol. 24, pp. 145, 1983.
37. R. Menzel and M. Giurfa, "Cognitive architecture of a mini-brain: the honeybee," Trends in Cognitive Sciences, vol. 5, pp. 62-71, 2001.
38. P. R. Montague, P. Dayan, C. Person, and T. J. Sejnowski, "Bee foraging in uncertain environments using predictive hebbian learning," Nature, vol. 377, pp. 725-728, 1995.
39. T. Keasar, E. Rashkovich, D. Cohen, and A. Shmida, "Bees in two-armed bandit situations: foraging choices and possible decision mechanisms," Behav. Ecol., vol. 13, pp. 757-765, 2002.
40. J. C. Gittins, Multi-armed Bandit Allocation Indices. New York: Wiley, 1989.
41. J. S. Banks and R. K. Sundaram, "Switching Costs and the Gittins Index" Econometrica: Journal of the Econometric Society, vol. 62, pp. 687-694, 1994.
42. R. K. Sundaram, "Generalized Bandit Problems," Working Paper, Stern School of Business 2003.
43. J. Tackseung, "A survey on the bandit problem with switching costs," De Economist, vol. V152, pp. 513-541, 2004.
44. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement Learning: A Survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
45. W. K. Estes, "Individual behavior in uncertain situations: An interpretation in terms of statistical association theory.," in Decision processes, R. M. Thrall, C. H. Coombs, and R. L. Davies, Eds. New York: Wiley, 1954, pp. 127-137.
46. R. J. Meyer and Y. Shi, "Sequential Choice under Ambiguity: Intuitive Solutions to the Armed-Bandit Problem," Management Science, vol. 41, pp. 817-834, 1995.
47. P. W. Glimcher, M. C. Dorris, and H. M. Bayer, "Physiological utility theory and the neuroeconomics of choice," Games and Economic Behavior, vol. 52, pp. 213, 2005.
48. G. Morris, A. Nevet, D. Arkadir, E. Vaadia, and H. Bergman, "Midbrain dopamine neurons encode decisions for future action," Nat Neurosci, vol. 9, pp. 1057-1063, 2006.
49. S. J. Gould and R. C. Lewontin, "The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme," Proc R. Soc Lond B Biol Sci., vol. 205, pp. 581-98, 1979.
50. D. M. Egelman, C. Person, and P. R. Montague, "A computational role for dopamine delivery in human decision-making," J Cogn Neurosci, vol. 10, pp. 623-30, 1998.
51. P. W. Glimcher, M. C. Dorris, and H. M. Bayer, "Physiological utility theory and the neuroeconomics of choice," Games Econ Behav, vol. 52, pp. 213-256, 2005.
52. A. Perez-Uribe, "Using a time-delay actor-critic neural architecture with dopamine-like reinforcement signal for learning in autonomous robots," in Emergent Neural Computational Architectures based on Neuroscience S. Wermter, J. Austin, and D. Willshaw, Eds. Heidelberg, Germany: Springer-Verlag, 2001, pp. 522-533.
53. M. Hammer, "An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees," Nature, vol. 366, pp. 59-63, 1993.
54. W. Schultz, "Reward signaling by dopamine neurons," Neuroscientist, vol. 7, pp. 293-302, 2001.
55. W. Schultz, "Behavioral theories and the neurophysiology of reward," Annu Rev Psychol, vol. 57, pp. 87-115, 2006.
56. D. E. Goldberg, "Probability Matching, the Magnitude of Reinforcement, and Classifier System Bidding," Machine Learning, vol. V5, pp. 407-425, 1990.
57. T. D. Wickens, Elementary signal detection theory. Oxford; New York: Oxford University Press, 2002.
58. R. Noë and P. Hammerstein, "Biological markets," vol. 10, pp. 336, 1995.
59. R. Noë, J. A. R. A. M. v. Hooff, and P. Hammerstein, Economics in nature: social dilemmas, mate choice, and biological markets, Cambridge, UK: New York, NY Cambridge University Press, 2001.
60. K. E. Stanovich, "Is probability matching smart? Associations between probabilistic choices and cognitive ability," Mem Cogntt, vol. 31, pp. 243-51, 2003.
61. D. R. Shanks, R. J. Tunney, and J. D. McCarthy, "A re-examination of probability matching and rational choice," Journal of Behavioral Decision Making, vol. 15, pp. 233-250, 2002.