Win-Stay, Lose-Sample: A simple sequential algorithm for approximating Bayesian inference

Cognitive Psychology

Volumn 74, Issue , 2014, Pages 35-65

  Bonawitz, Elizabeth ^a   Denison, Stephanie ^b   Gopnik, Alison ^c   Griffiths, Thomas L ^c  

^a RUTGERS UNIVERSITY   (United States)

^b UNIVERSITY OF WATERLOO   (Canada)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Algorithmic level; Bayesian inference; Causal learning

Indexed keywords

ALGORITHM; BAYES THEOREM; COMPREHENSION; DECISION MAKING; FEMALE; HUMAN; LEARNING; MALE; PRESCHOOL CHILD; PROBLEM SOLVING; YOUNG ADULT;

ALGORITHMS; BAYES THEOREM; CHILD, PRESCHOOL; COMPREHENSION; FEMALE; HUMANS; JUDGMENT; LEARNING; MALE; PROBLEM SOLVING; YOUNG ADULT;

EID: 84905389443     PISSN: 00100285     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cogpsych.2014.06.003     Document Type: Article

References (92)

1. Bishop C.M. Pattern recognition and machine learning 2006, Springer, New York.
2. Bonawitz, E., & Griffiths, T.L. (2010). Deconfounding hypothesis generation and evaluation in Bayesian models. In Proceedings of the 32nd annual conference of the cognitive science society.
3. Bonawitz, E., Gopnik, A., Denison, S., & Griffiths, T.L. (2012) Rational randomness: The role of sampling in an algorithmic account of preschooler's causal learning. In J.B. Benson (Serial Ed.) & F. Xu & T. Kushnir (Vol. Eds.), Advances in child development and behavior: Rational constructivism in cognitive development (pp. 161-192). Waltham, MA: Academic Press.
4. Bonawitz, E., Denison, S., Griffiths, T., & Gopnik, A. (2014) Probabilistic models, learning algorithms, response variability: Sampling in cognitive development. Trends in Cognitive Science. http://dx.doi.org/10.1016/j.tics.2014.06.006.
5. Bonawitz E., Lombrozo T. Occam's rattle: Children's use of simplicity and probability to constrain inference. Developmental Psychology 2012, 48(4):1156.
6. Bonawitz E.B., Shafto P., Gweon H., Goodman N.D., Spelke E., Schulz L.E. The double-edged sword of pedagogy: Teaching limits children's spontaneous exploration and discovery. Cognition 2011, 120(3):322-330.
7. Bonawitz E., van Schindel T., Friel D., Schulz L. Children balance theories and evidence in exploration, explanation, and learning. Cognitive Psychology 2012, 64(4):215-234.
8. Bowers J.S., Davis C.J. Bayesian just-so stories in psychology and neuroscience. Psychonomic Bulletin 2012, 138(3):389-414.
9. Bullock M., Gelman R., Baillargeon R. The development of causal reasoning. The developmental psychology of time 1982, 209-254. Academic Press, New York. W.J. Friedman (Ed.).
10. Carey S. Conceptual change in childhood 1985, MIT Press, Cambridge, MA.
11. Chater N., Goodman N., Griffiths T.L., Kemp C., Oaksford M., Tenenbaum J.B. The imaginary fundamentalists: The unshocking truth about Bayesian cognitive science. Behavioral and Brain Sciences 2011, 34(4):194-196.
12. Colman A.M., Pulford B.D., Omtzigt D., al-Nowaihi A. Learning to cooperate without awareness in multiplayer minimal social situations. Cognitive Psychology 2010, 61:201-227.
13. Dayan P., Kakade S. Explaining away in weight space. Advances in neural information processing systems 2001, vol. 13:451-457. MIT Press.
14. Denison S., Bonawitz E.B., Gopnik A., Griffiths T.L. Rational variability in children's causal inferences: The sampling hypothesis. Cognition 2013, 126(2):285-300.
15. Sequential Monte Carlo methods in practice 2001, Springer-Verlag, Berlin. A. Doucet, N. de Freitas, N.J. Gordon (Eds.).
16. Erev I., Ert E., Roth A.E., et al. A choice prediction competition: Choices from experience and from description. Journal of Behavioral Decision Making 2010, 23:15-47.
17. Erikson J.R. Hypothesis sampling in concept identification. Journal of Experimental Child Psychology 1968, 76:12-18.
18. German T.P., Nichols S. Children's inferences about long and short causal chains. Developmental Science 2003, 6:514-523.
19. Gerstadt C.L., Hong Y.J., Diamond A. The relationship between cognition and action: performance of children 3-7 years old on a stroop-like day-night test. Cognition 1994, 53:129-153.
20. Gigerenzer G., Gaissmaier W. Heuristic decision making. Annual Review of Psychology 2011, 62:451-482.
21. Gigerenzer G., Goldstein D.G. Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review 1996, 103:650-669.
22. Gilks W.R., Richardson S., Spiegelhalter D.J. Markov Chain Monte Carlo in practice 1996, Chapman and Hall/CRC, Boca Raton, FL.
23. Gonzalez, A., Shafto, P., Bonawitz, E. B. & Gopnik, A. (2012). Are you sure? The effects of neutral queries on children's choices. In Proceedings of the 34th annual conference of the Cognitive Science Society.
24. Goodman N.D., Tenenbaum J.B., Feldman J., Griffiths T.L. A rational analysis of rule-based concept learning. Cognitive Science 2008, 32:108-154.
25. Gopnik A. Scientific thinking in young children. Theoretical advances, empirical research and policy implications. Science 2012, 337:1623-1627.
26. Gopnik A., Glymour C., Sobel D., Schulz L., Kushnir T., Danks D. A theory of causal learning in children: Causal maps and Bayes nets. Psychological Review 2004, 111:1-31.
27. Gopnik A., Meltzoff A. Words, thoughts, and theories 1997, MIT Press, Cambridge, MA.
28. Gopnik A., Schulz L. Mechanisms of theory formation in young children. Trends in Cognitive Science 2004, 8:371-377.
29. Causal learning: Psychology, philosophy, and computation 2007, Oxford University Press, Oxford. A. Gopnik, L. Schulz (Eds.).
30. Gopnik A., Sobel D. Detecting blickets: How young children use information about novel causal powers in categorization and induction. Child Development 2000, 71:1205-1222.
31. Gopnik A., Tenenbaum J.B. Bayesian networks, Bayesian learning, and cognitive development. Developmental Science 2007, 10(3):281-287.
32. Gopnik A., Wellman H.M. Reconstructing constructivism: Causal models, Bayesian learning mechanisms, and the theory theory. Psychological Bulletin 2012, 138(6):1085-1108.
33. Griffiths T.L., Chater N., Kemp C., Perfors A., Tenenbaum J. Probabilistic models of cognition: Exploring representations and inductive biases. Trends in Cognitive Sciences 2010, 14(8):357-364.
34. Griffiths T.L., Chater N., Norris D., Pouget A. How the Bayesians got their beliefs (and what those beliefs actually are): Comment on Bowers and Davis (2012). Psychological Bulletin 2012, 138(3):415-422.
35. Griffiths T.L., Sobel D., Tenenbaum J.B., Gopnik A. Bayes and Blickets: Effects of knowledge on causal induction in children and adults. Cognitive Science 2011, 35(8):1407-1455.
36. Griffiths T.L., Tenenbaum J.B. Structure and strength in causal induction. Cognitive psychology 2005, 51(4):334-384.
37. Griffiths T.L., Tenenbaum J.B. Theory-based causal induction. Psychological Review 2009, 116:661-716.
38. Griffiths T.L., Vul E., Sanborn A.N. Bridging levels of analysis for probabilistic models of cognition. Current Directions in Psychological Science 2012, 21(4):263-268.
39. Gweon H., Schulz L., Tenenbaum J. Infants consider both the sample and the sampling process in inductive generalization. Proceedings of the National Academy of Science 2010, 107(20):9066-9071.
40. Jones M.H., Liverant S. Effects of age differences on choice behavior. Child Development 1960, 31(4):673-680.
41. Jones M., Love B.C. Bayesian fundamentalism or Enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition. Behavioral and Brain Sciences 2011, 34:169-231.
42. Kass R.E., Raftery A.E. Bayes factors. Journal of the American Statistical Association 1995, 90(430):773-795.
43. Katz, Y., Gooman, N. D., Kersting, K., Kemp, C., & Tenenbaum, J. B. (2008). Modeling semantic cognition as logical dimensionality reduction. In Proceedings of the thirtieth annual conference of the cognitive sciences society.
44. Kemp C., Goodman N.D., Tenenbaum J.B. Learning to learn causal models. Cognitive Science 2011, 1-59.
45. Kemp C., Tenenbaum J.B., Niyogi S., Griffiths T.L. A probabilistic model of theory formation. Cognition 2010, 114(2):165-196.
46. Klahr D., Fay A., Dunbar K. Heuristics for scientific experimentation: A developmental study. Cognitive Psychology 1993, 25:111-146.
47. Kuhn D. Children and adults as intuitive scientists. Psychological Review 1989, 96:674-689.
48. Kushnir T., Gopnik A. Conditional probability versus spatial contiguity in causal learning: Preschoolers use new contingency evidence to overcome prior spatial assumptions. Developmental Psychology 2007, 44:186-196.
49. Levine M. A cognitive theory of learning: Research on hypothesis testing 1975, Lawrence Erlbaum, Hillsdale, NJ.
50. Levy, R., Reali, F., Griffiths, T. L., 2009. Modeling the effects of memory on human online sentence processing with particle filters. In: D. Koller, D. Schuurmans, Y. Bengio, L. Bottou (Eds.), Advances in neural information processing systems (Vol. 21, pp. 937-944).
51. Marcus G.F., Davis E. How robust are probabilistic models of higher-level cognition?. Psychological Science 2013, 24(12):2351-2360.
52. Marr D. Vision 1982, Freeman Publishers.
53. McClelland J.L., Botvinick M.M., Noelle D.C., Plaut D.C., Rogers T.T., Seidenberg M.S., et al. Letting structure emerge: connectionist and dynamical systems approaches to cognition. Trends in Cognitive Sciences 2010, 14(8):348-356.
54. Myers J.L. Probability learning and sequence learning. Handbook of learning and cognitive processes: Approaches to human learning and motivation 1976, 171-205. Erlbaum, Hillsdale, NJ. W.K. Estes (Ed.).
55. Neal, R. M. (1993). Probabilistic inference using Markov chain Monte Carlo methods. Technical Report CRG-TR-93-1, Dept. of Computer Science, University of Toronto.
56. Neimark E.D., Shuford E.H. Comparison of predictions and estimates in a probability learning situation. Journal of Experimental Psychology 1959, 57(5):294-298.
57. Nowak M., Sigmund K. A strategy of win-stay, lose-shift that outperforms tit-or-tat in the prisoner's dilemma game. Nature 1993, 364:56-58.
58. Pearl J. Causality: Models, reasoning and inference 2000, Cambridge University Press, Cambridge, UK.
59. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning II: Current research and theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
60. Restle F. The selection of strategies in cue learning. Psychological Review 1962, 69:329-343.
61. Robbins H. Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society 1952, 58:527-535.
62. Robert C., Casella G. Monte Carlo statistical methods 2004, Springer, New York. 2nd ed.
63. Russell S.J., Norvig P. Artificial intelligence: A modern approach 2003, Prentice Hall, Upper Saddle River, NJ. 2nd ed.
64. Sanborn A.N., Griffiths T.L., Navarro D.J. Rational approximations to rational models: Alternative algorithms for category learning. Psychological Review 2010, 117(4):1144-1167.
65. Schulz L.E., Bonawitz E.B., Griffiths T.L. Can being scared make your tummy ache? Naive theories, ambiguous evidence and preschoolers' causal inferences. Developmental Psychology 2007, 43:1124-1139.
66. Schulz L., Gopnik A., Glymour C. Preschool children learn about causal structure from conditional interventions. Developmental Science 2007, 10(3):322-332.
67. Schulz L.E., Hooppell K., Jenkins A. Judicious imitation: Young children imitate deterministic actions exactly, stochastic actions more variably. Child Development 2008, 79(20):395-410.
68. Schulz L.E., Sommerville J. God does not play dice: Causal determinism and children's inferences about unobserved causes. Child Development 2006, 77(2):427-442.
69. Schusterman R.J. The use of strategies in two-choice behavior of children and chimpanzees. Journal of Comparative and Physiological Psychology 1963, 56(1):96-100.
70. Seiver T., Gopnik A., Goodman N.D. Did she jump because she was the big sister or because the trampoline was safe? Causal inference and the development of social attribution. Child Development 2012, 84(2):443-454.
71. Shafto, P., & Goodman, N. (2008). Teaching games: Statistical sampling assumptions for pedagogical situations. In Proceedings of the 30th annual conference of the cognitive science society.
72. Shi, L., Feldman, N. H., & Griffiths, T. L. (2008). Performing Bayesian inference with exemplar models. In Proceedings of the 30th annual conference of the cognitive science society.
73. Siegler R.S. Defining the locus of developmental differences in children's causal reasoning. Journal of Experimental Child Psychology 1975, 20:512-525.
74. Siegler R.S. Emerging minds: The process of change in children's thinking 1996, Oxford University Press, New York.
75. Siegler R.S., Chen Z. Developmental differences in rule learning: A microgenetic analysis. Cognitive Psychology 1998, 36(3):273-310.
76. Simon H. A behavioural model of rational choice. Quarterly Journal of Economics 1955, 69:99-118.
77. Simon H. Models of man 1957, Wiley, New York.
78. Sobel D.M., Tenenbaum J.B., Gopnik A. Children's causal inferences from indirect evidence: Backwards blocking and Bayesian reasoning in preschoolers. Cognitive Science 2004, 28(3):303-333.
79. Sobel D., Yoachim C., Gopnik A., Meltzoff A., Blumenthal E. The blicket within: Preschoolers' inferences about insides and causes. Journal of Cognition and Development 2007, 8(2):159-182.
80. Spirtes P., Glymour C., Scheines R. Causation, prediction and search 2000, MIT Press, New York, NY. 2nd ed.
81. Tenenbaum J.B., Griffiths T.L., Kemp C. Theory-based Bayesian models of inductive learning and reasoning. Trends in Cognitive Science 2006, 10:309-318.
82. Thorndike E.L. Animal intelligence: Experimental studies 1911, Macmillan, New York.
83. Trabasso T., Bower G.H. Presolution dimensional shifts in concept identification: A test of the sampling with replacement axiom in all-or-none models. Journal of Mathematical Psychology 1966, 3:163-173.
84. Ullman T., Goodman N., Tenenbaum J.B. Theory acquisition as stochastic search. Proceedings of the 32nd annual conference of the cognitive science society 2010, 2840-2845. Cognitive Science Society, Austin, TX. S. Ohlsson, R. Catrambone (Eds.).
85. Vul, E., Goodman, N. D., Griffiths, T., & Tenenbaum, J. B. (2009) One and done? Optimal decisions from very few samples. In Proceedings of the 31st annual conference of the cognitive science society.
86. Vul E., Pashler H. Measuring the crowd within probabilistic representations within individuals. Psychological Science 2008, 19(7):645-647.
87. Vulkan N. An economist's perspective on probability matching. Journal of Economic Surveys 2000, 14(1):101-118.
88. Weir M.W. Developmental changes in problem solving strategies. Psychological Review 1964, 71(6):473-490.
89. Wellman H.M. The child's theory of mind 1990, MIT Press, Cambridge, MA.
90. Wellman H.M., Gelman S.A. Cognitive development: Foundational theories of core domains. Annual Review of Psychology 1992, 43:337-375.
91. Xu F., Kushnir T. Rational constructivism in cognitive development. Advances in child development and behavior 2012, Vol. 43. Academic Press, Waltham, MA.
92. Xu F., Tenenbaum J.B. Word learning as Bayesian inference. Psychological Review 2007, 144(20):245.