Statistically optimal perception and learning: from behavior to neural representations

Trends in Cognitive Sciences

Volumn 14, Issue 3, 2010, Pages 119-130

  Fiser, József ^a   Berkes, Pietro ^a   Orbán, Gergo ^a,b   Lengyel, Máté ^c  

^a BRANDEIS UNIVERSITY   (United States)

^b INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN PERCEPTION; INTERNAL MODELS; NEURAL REPRESENTATIONS; PROBABILISTIC COMPUTATION; SAMPLING-BASED; SENSORY INPUT; SPONTANEOUS ACTIVITY; STATISTICAL INFERENCE;

ANIMALS; OPTIMIZATION; STATISTICAL METHODS;

SENSORY PERCEPTION;

BEHAVIOR; BRAIN CORTEX; HUMAN; LEARNING; NERVE CELL; NONHUMAN; PERCEPTION; PROBABILITY; REVIEW; UNCERTAINTY;

ANIMALS; CEREBRAL CORTEX; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; PERCEPTION;

EID: 76749113376     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2010.01.003     Document Type: Review

References (101)

1. Barlow H.B. Possible principles underlying the transformations of sensory messages. In: Rosenblith W. (Ed). Sensory Communication (1961), MIT Press 217-234
2. Geisler W.S., and Diehl R.L. Bayesian natural selection and the evolution of perceptual systems. Philos. Trans. R. Soc. Lond. B Biol. Sci. 357 (2002) 419-448
3. Smith J.D. The study of animal metacognition. Trends Cogn. Sci. 13 (2009) 389-396
4. Pouget A., et al. Inference and computation with population codes. Annu. Rev. Neurosci. 26 (2004) 381-410
5. Helmholtz H.V. Treatise on Physiological Optics (1925), Optical Society of America
6. Green D.M., and Swets J.A. Signal Detection Theory and Psychophysics (1966), John Wiley and Sons
7. Cox R.T. Probability, frequency and reasonable expectation. Am. J. Phys. 14 (1946) 1-13
8. Bernoulli J. Ars Conjectandi (1713), Thurnisiorum
9. Atkins J.E., et al. Experience-dependent visual cue integration based on consistencies between visual and haptic percepts. Vision Res. 41 (2001) 449-461
10. Ernst M.O., and Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415 (2002) 429-433
11. Kording K.P., and Wolpert D.M. Bayesian integration in sensorimotor learning. Nature 427 (2004) 244-247
12. Weiss Y., et al. Motion illusions as optimal percepts. Nat. Neurosci. 5 (2002) 598-604
13. Trommershäuser J., et al. Decision making, movement planning and statistical decision theory. Trends Cogn. Sci. 12 (2008) 291-297
14. Kording K. Decision theory: What "should" the nervous system do?. Science 318 (2007) 606-610
15. Zemel R., et al. Probabilistic interpretation of population codes. Neural Comput. 10 (1998) 403-430
16. Ma W.J., et al. Bayesian inference with probabilistic population codes. Nat. Neurosci. 9 (2006) 1432-1438
17. Beck J.M., et al. Probabilistic population codes for Bayesian decision making. Neuron 60 (2008) 1142-1152
18. Jacobs R.A., et al. Adaptive mixtures of local experts. Neural Comput. 3 (1991) 79-87
19. Geisler W.S., et al. Edge co-occurrence in natural images predicts contour grouping performance. Vision Res. 41 (2001) 711-724
20. Griffiths T.L., and Tenenbaum J.B. Optimal predictions in everyday cognition. Psychol. Sci. 17 (2006) 767-773
21. Chater N., et al. Probabilistic models of cognition: conceptual foundations. Trends Cogn. Sci. 10 (2006) 287-291
22. Courville A.C., et al. Model uncertainty in classical conditioning. In: Thrun S., et al. (Ed). Advances in Neural Information Processing Systems 16 (2004), MIT Press 977-984
23. Blaisdell A.P., et al. Causal reasoning in rats. Science 311 (2006) 1020-1022
24. Gopnik A., et al. A theory of causal learning in children: causal maps and Bayes nets. Psychol. Rev. 111 (2004) 3-32
25. Kemp C., and Tenenbaum J.B. The discovery of structural form. Proc. Natl. Acad. Sci. U. S. A. 105 (2008) 10687-10692
26. Orbán G., et al. Bayesian learning of visual chunks by human observers. Proc. Natl. Acad. Sci. U. S. A. 105 (2008) 2745-2750
27. Buonomano D.V., and Merzenich M.M. Cortical plasticity: from synapses to maps. Annu. Rev. Neurosci. 21 (1998) 149-186
28. Gilbert C.D., et al. Perceptual learning and adult cortical plasticity. J. Physiol. Lond. 587 (2009) 2743-2751
29. Deneve S. Bayesian spiking neurons II: learning. Neural Comput. 20 (2008) 118-145
30. Lengyel M., and Dayan P. Uncertainty, phase and oscillatory hippocampal recall. In: Scholkopf B., et al. (Ed). Advances in Neural Information Processing Systems 19 (2007), MIT Press 833-840
31. In: Rumelhart D.E., et al. (Ed). Parallel Distributed Processing - Explorations in the Microstructure of Cognition (1986), MIT Press
32. Hinton G.E., et al. The wake-sleep algorithm for unsupervised neural networks. Science 268 (1995) 1158-1161
33. Hinton G.E., and Sejnowski T.J. Learning and relearning in Boltzmann machines. In: Rumelhart D.E., and McClelland J.L. (Eds). Parallel Distributed Processing: Explorations in the Microstructure of Cognition (1986), MIT Press
34. Neal R.M. Bayesian Learning for Neural Networks (1996), Springer-Verlag
35. Hinton G.E. Learning multiple layers of representation. Trends Cogn. Sci. 11 (2007) 428-434
36. Dayan P. Recurrent sampling models for the Helmholtz machine. Neural Comput. 11 (1999) 653-677
37. Dayan P., and Hinton G.E. Varieties of Helmholtz machine. Neural Netw. 9 (1996) 1385-1403
38. Hinton G.E., and Ghahramani Z. Generative models for discovering sparse distributed representations. Philos. Trans. R. Soc. Lond. B Biol. Sci. 352 (1997) 1177-1190
39. Lucke J., and Sahani M. Maximal causes for non-linear component extraction. J. Mach. Learn. Res. 9 (2008) 1227-1267
40. Bell A.J., and Sejnowski T.J. The "independent components" of natural scenes are edge filters. Vision Res. 37 (1997) 3327-3338
41. Berkes P., and Wiskott L. Slow feature analysis yields a rich repertoire of complex cell properties. J. Vis. 5 (2005) 579-602
42. Karklin Y., and Lewicki M.S. Emergence of complex cell properties by learning to generalize in natural scenes. Nature 457 (2009) 83-85
43. Olshausen B.A., and Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381 (1996) 607-609
44. Rao R.P.N., and Ballard D.H. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2 (1999) 79-87
45. Roweis S., and Ghahramani Z. A unifying review of linear Gaussian models. Neural Comput. 11 (1999) 305-345
46. Turner R., and Sahani M. A maximum-likelihood interpretation for slow feature analysis. Neural Comput. 19 (2007) 1022-1038
47. Schwartz O., and Simoncelli E.P. Natural signal statistics and sensory gain control. Nat. Neurosci. 4 (2001) 819-825
48. Olshausen B.A., and Field D.J. How close are we to understanding V1?. Neural Comput. 17 (2005) 1665-1699
49. Lopez-Aranda M.F., et al. Role of layer 6 of V2 visual cortex in object-recognition memory. Science 325 (2009) 87-89
50. Yang T., and Shadlen M.N. Probabilistic reasoning by neurons. Nature 447 (2007) 1075-1080
51. Anderson C.H., and Van Essen D.C. Neurobiological computational systems. In: Zureda J.M., et al. (Ed). Computational Intelligence Imitating Life (1994), IEEE Press 213-222
52. Ma W.J., et al. Spiking networks for Bayesian inference and choice. Curr. Opin. Neurobiol. 18 (2008) 217-222
53. Berkes, P. et al. (2009) Matching spontaneous and evoked activity in V1: a hallmark of probabilistic inference. In Frontiers in Systems Neuroscience. Conference Abstract: Computational and systems neuroscience DOI:10.3389/conf.neuro.06.2009.03.314
54. Hoyer, P.O. and Hyvarinen, A. (2003) Interpreting neural response variability as Monte Carlo sampling of the posterior. In Advances in Neural Information Processing Systems 15 (Becker, S. et al., eds), pp. 277-284, MIT Press
55. Lee T.S., and Mumford D. Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. (A) 20 (2003) 1434-1448
56. Zohary E., et al. Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370 (1994) 140-143
57. Leopold D.A., and Logothetis N.K. Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry. Nature 379 (1996) 549-553
58. Sundareswara R., and Schrater P.R. Perceptual multistability predicted by search model for Bayesian decisions. J. Vis. 8 (2008) 12.1-12.19
59. Daw N., and Courville A. The rat as particle filter. In: Platt J., et al. (Ed). Advances in Neural Information Processing Systems 20 (2008), MIT Press 369-376
60. Levy R.P., Reali F., and Griffiths T.L. Modeling the effects of memory on human online sentence processing with particle filters. In: Koller P., et al. (Ed). Advances in Neural Information Processing Systems 21 (2009), MIT Press 937-944
61. Vul E., and Pashler H. Measuring the crowd within - probabilistic representations within individuals. Psychol. Sci. 19 (2008) 645-647
62. Shadlen M.N., and Newsome W.T. Noise, neural codes and cortical organization. Curr. Opin. Neurobiol. 4 (1994) 569-579
63. Anderson J.S., et al. The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science 290 (2000) 1968-1972
64. Fiser J., et al. Small modulation of ongoing cortical dynamics by sensory input during natural vision. Nature 431 (2004) 573-578
65. Ringach D. Spontaneous and driven cortical activity: implications for computation. Curr. Opin. Neurobiol. 19 (2009) 439-444
66. Kenet T., et al. Spontaneously emerging cortical representations of visual attributes. Nature 425 (2003) 954-956
67. Tsodyks M., et al. Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science 286 (1999) 1943-1946
68. Dayan P., and Abbott L.F. Theoretical Neuroscience (2001), MIT Press
69. Neal R.M. Annealed importance sampling. Stat. Comput. 11 (2001) 125-139
70. Thorpe S., et al. Speed of processing in the human visual system. Nature 381 (1996) 520-522
71. Serre T., et al. A feedforward architecture accounts for rapid categorization. Proc. Natl. Acad. Sci. U. S. A. 104 (2007) 6424-6429
72. Saffran J.R., et al. Statistical learning by 8-month-old infants. Science 274 (1996) 1926-1928
73. Seitz A.R., et al. Simultaneous and independent acquisition of multisensory and unisensory associations. Perception 36 (2007) 1445-1453
74. Pena M., et al. Signal-driven computations in speech processing. Science 298 (2002) 604-607
75. Turk-Browne N.B., et al. Neural evidence of statistical learning: efficient detection of visual regularities without awareness. J. Cogn. Neurosci. 21 (2009) 1934-1945
76. Fiser J., and Aslin R.N. Unsupervised statistical learning of higher-order spatial structures from visual scenes. Psychol. Sci. 12 (2001) 499-504
77. Fiser J., and Aslin R.N. Statistical learning of new visual feature combinations by infants. Proc. Natl. Acad. Sci. U. S. A. 99 (2002) 15822-15826
78. Kirkham N.Z., et al. Visual statistical learning in infancy: evidence for a domain general learning mechanism. Cognition 83 (2002) B35-B42
79. Fiser J., and Aslin R.N. Encoding multielement scenes: statistical learning of visual feature hierarchies. J. Exp. Psychol. Gen. 134 (2005) 521-537
80. Beck J.M., and Pouget A. Exact inferences in a neural implementation of a hidden Markov model. Neural Comput. 19 (2007) 1344-1361
81. Deneve S. Bayesian spiking neurons I: inference. Neural Comput. 20 (2008) 91-117
82. Huys Q.J.M., et al. Fast population coding. Neural Comput. 19 (2007) 404-441
83. Creutzfeldt O.D., et al. Relations between EEG phenomena and potentials of single cortical cells: II. Spontaneous and convulsoid activity. Electroencephalogr. Clin. Neurophysiol. 20 (1966) 19-37
84. Tolhurst D.J., et al. The statistical reliability of signals in single neurons in cat and monkey visual-cortex. Vision Res. 23 (1983) 775-785
85. Wu J.Y., et al. Propagating waves of activity in the neocortex: what they are, what they do. Neuroscientist 14 (2008) 487-502
86. Katz L.C., and Shatz C.J. Synaptic activity and the construction of cortical circuits. Science 274 (1996) 1133-1138
87. Arieli A., et al. Coherent spatiotemporal patterns of ongoing activity revealed by real-time optical imaging coupled with single-unit recording in the cat visual cortex. J. Neurophysiol. 73 (1995) 2072-2093
88. Fox M.D., and Raichle M.E. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 8 (2007) 700-711
89. Attwell D., and Laughlin S.B. An energy budget for signaling in the grey matter of the brain. J. Cereb. Blood Flow Metab. 21 (2001) 1133-1145
90. Ikegaya Y., et al. Synfire chains and cortical songs: temporal modules of cortical activity. Science 304 (2004) 559-564
91. Luczak A., et al. Sequential structure of neocortical spontaneous activity in vivo. Proc. Natl. Acad. Sci. U. S. A. 104 (2007) 347-352
92. Han F., et al. Reverberation of recent visual experience in spontaneous cortical waves. Neuron 60 (2008) 321-327
93. Gilbert C.D., and Sigman M. Brain states: top-down influences in sensory processing. Neuron 54 (2007) 677-696
94. Nauhaus I., et al. Stimulus contrast modulates functional connectivity in visual cortex. Nat. Neurosci. 12 (2009) 70-76
95. Yuille A., and Kersten D. Vision as Bayesian inference: analysis by synthesis?. Trends Cogn. Sci. 10 (2006) 301-308
96. Ernst M.O., and Bulthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 8 (2004) 162-169
97. Kording K.P., and Wolpert D.M. Bayesian decision theory in sensorimotor control. Trends Cogn. Sci. 10 (2006) 319-326
98. Fox M.D., et al. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 9673-9678
99. Berkes P., et al. A structured model of video reproduces primary visual cortical organisation. PLoS Comput. Biol. 5 (2009) e1000495
100. Rossi A.F., et al. The representation of brightness in primary visual cortex. Science 273 (1996) 1104-1107
101. Adelson E.H. Perceptual organization and the judgment of brightness. Science 262 (1993) 2042-2044