Types of approximation for probabilistic cognition: Sampling and variational

Brain and Cognition

Volumn 112, Issue , 2017, Pages 98-101

  Sanborn, Adam N ^a  

^a UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

Probabilistic cognition; Rational process models; Sampling; Variational approximations

Indexed keywords

ALGORITHM; ARTICLE; BEHAVIORAL BIAS; COGNITION; COGNITIVE BIAS; KERNEL METHOD; MARKOV CHAIN; MEAN FIELD APPROXIMATION; MONTE CARLO METHOD; PREDICTION; PROBABILITY; BRAIN; COMPUTER SIMULATION; HUMAN; PHYSIOLOGY; STATISTICAL MODEL;

ALGORITHMS; BRAIN; COGNITION; COMPUTER SIMULATION; HUMANS; MODELS, STATISTICAL;

EID: 84937871458     PISSN: 02782626     EISSN: 10902147     Source Type: Journal    
DOI: 10.1016/j.bandc.2015.06.008     Document Type: Article

References (40)

1. Abbott, J. T., & Griffiths, T. L. (2011). Exploring the influence of particle filter parameters on order effects in causal learning. In Proceedings of the 33rd annual conference of the cognitive science society.
2. Anderson, J.R., The adaptive nature of human categorization. Psychological Review 98:3 (1991), 409–429.
3. Beck, J., Pouget, A., Heller, K.A., Complex inference in neural circuits with probabilistic population codes and topic models. Pereira, F., Burges, C., Bottou, L., Weinberger, K., (eds.) Advances in neural information processing systems, Vol. 25, 2012, Curran Associates, Inc., 3059–3067.
4. Bishop, C.M., Pattern recognition and machine learning. 2006, Springer, New York, NY.
5. Brown, S.D., Steyvers, M., Detecting and predicting changes. Cognitive Psychology 58 (2009), 49–67.
6. Buesing, L., Bill, J., Nessler, B., Maass, W., Neural dynamics as sampling: A model for stochastic computation in recurrent networks of spiking neurons. PLoS Computational Biology, 7(11), 2011, e1002211.
7. Daw, N.D., Courville, A.C., The pigeon as particle filter. Platt, J., Koller, D., Singer, Y., Roweis, S., (eds.) Advances in neural information processing systems, Vol. 20, 2008, MIT Press, Cambridge, MA, 369–376.
8. Daw, N.D., Courville, A.C., Dayan, P., Semi-rational models of conditioning: The case of trial order. Chater, N., Oaksford, M., (eds.) The probabilistic mind, 2008, Oxford University Press, Oxford, UK, 431–452.
9. Doucet, A., de Freitas, N., Gordon, N., Sequential Monte Carlo methods in practice. 2001, Springer, New York.
10. Fiser, J., Berkes, P., Orbán, G., Lengyel, M., Statistically optimal perception and learning: From behavior to neural representations. Trends in Cognitive Sciences 14 (2010), 119–130.
11. Friston, K., Hierarchical models in the brain. PLoS Computational Biology, 4(11), 2008, e1000211.
12. Gershman, S.J., Vul, E., Tenenbaum, J.B., Multistability and perceptual inference. Neural Computation 24 (2012), 1–24.
13. Griffiths, T.L., Steyvers, M., Tenenbaum, J.B., Topics in semantic representation. Psychological Review, 114(2), 2007, 211.
14. Hennequin, G., Aitchison, L., Lengyel, M., Fast sampling-based inference in balanced neuronal networks. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., Weinberger, K., (eds.) Advances in neural information processing systems, Vol. 27, 2014, Curran Associates, Inc., 2240–2248.
15. Hinton, G. E., & Van Camp, D. (1993). Keeping the neural networks simple by minimizing the description length of the weights. In Proceedings of the sixth annual conference on computational learning theory (pp. 5–13).
16. Huang, Y., Rao, R.P., Neurons as Monte Carlo samplers: Bayesian inference and learning in spiking networks. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., Weinberger, K., (eds.) Advances in neural information processing systems, Vol. 27, 2014, Curran Associates, Inc., 1943–1951.
17. Kemp, C., Tenenbaum, J.B., The discovery of structural form. Proceedings of the National Academy of Sciences 105:31 (2008), 10687–10692.
18. Körding, K., Wolpert, D.M., Bayesian integration in sensorimotor learning. Nature 427 (2004), 244–247.
19. Kruschke, J.K., Base rates in category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 22 (1996), 3–26.
20. Kruschke, J.K., Locally Bayesian learning. Sun, R., (eds.) Proceedings of the 28th annual meeting of the cognitive science society, 2006, Erlbaum, 453–458.
21. Kruschke, J.K., Locally Bayesian learning with applications to retrospective revaluation and highlighting. Psychological Review 113 (2006), 677–699.
22. Lee, T.S., Mumford, D., Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America A 20:7 (2003), 1434–1448.
23. Legenstein, R., Maass, W., Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment. PLoS Computational Biology, 10(10), 2014, e1003859.
24. Levy, R., Reali, F., & Griffiths, T. L. (2009). Modeling the effects of memory on human online sentence processing with particle filters. In D. Koller, D. Schuurmans, Y. Bengio & L. Bottou (Eds.), Advances in neural information processing systems (Vol. 21, pp. 937–944).
25. Lieder, F., Griffiths, T., & Goodman, N. (2012). Burn-in, bias, and the rationality of anchoring. In Advances in neural information processing systems (pp. 2690–2798).
26. Medin, D.L., Edelson, S.M., Problem structure and the use of base-rate information from experience. Journal of Experimental Psychology: General 117 (1988), 68–85.
27. Minka, T. (2001). A family of algorithms for approximate Bayesian inference. Unpublished doctoral dissertation. MIT, Boston.
28. Moreno-Bote, R., Knill, D.C., Pouget, A., Bayesian sampling in visual perception. Proceedings of the National Academy of Sciences 108:30 (2011), 12491–12496.
29. Neal, R. M. (1993). Probabilistic inference using Markov chain Monte Carlo methods. Tech. rep. no. CRG-TR-93-1. Department of Computer Science, University of Toronto.
30. Probst, D., Petrovici, M.A., Bytschok, I., Bill, J., Pecevski, D., Schemmel, J., et al. Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons. Frontiers in Computational Neuroscience, 9, 2015.
31. Sanborn, A.N., Griffiths, T.L., Navarro, D.J., Rational approximations to the rational model of categorization. Psychological Review 117 (2010), 1144–1167.
32. Sanborn, A.N., Silva, R., Constraining bridges between levels of analysis: A computational justification for locally Bayesian learning. Journal of Mathematical Psychology, 2013.
33. Shanks, D.R., Forward and backward blocking in human contingency judgment. Quarterly Journal of Experimental Psychology 97B (1985), 1–21.
34. Shi, L., & Griffiths, T. L. (2009). Neural implementation of hierarchical Bayesian inference by importance sampling. In Advances in neural information processing systems (pp. 1669–1677).
35. Shi, L., Griffiths, T.L., Feldman, N.H., Sanborn, A.N., Exemplar models as a mechanism for performing Bayesian inference. Psychological Bulletin and Review 17 (2010), 443–464.
36. Simon, H.A., A behavioral model of rational choice. The Quarterly Journal of Economics 69:1 (1955), 99–118.
37. Tassinari, H., Hudson, T.E., Landy, M.S., Combining priors and noisy visual cues in a rapid pointing task. The Journal of Neuroscience 26:40 (2006), 10154–10163.
38. Tversky, A., Kahneman, D., Causal schemata in judgments under uncertainty. Progress in social psychology, 1978, Lawrence Erlbaum.
39. Van Rooij, I., The tractable cognition thesis. Cognitive Science 32:6 (2008), 939–984.
40. Wainwright, M.J., Jordan, M.I., Graphical models, exponential families, and variational inference. Foundations and Trends® in Machine Learning 1:1–2 (2008), 1–305.