Theory of cortical function

Proceedings of the National Academy of Sciences of the United States of America

Volumn 114, Issue 8, 2017, Pages 1773-1782

  Heeger, David J ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Computational neuroscience; Inference; Neural net; Prediction; Vision

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN FUNCTION; FEEDBACK SYSTEM; HUMAN; MACHINE LEARNING; MOTOR CONTROL; MOTOR LEARNING; NERVE POTENTIAL; OSCILLATION; PREDICTION; PRIORITY JOURNAL; RECALL; SENSORY STIMULATION; STRIATE CORTEX; VISUAL STIMULATION; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; COGNITION; NEOCORTEX; NERVE CELL NETWORK; PERCEPTION; PHYSIOLOGY;

ARTIFICIAL INTELLIGENCE; COGNITION; FEEDBACK; HUMANS; MODELS, NEUROLOGICAL; NEOCORTEX; NERVE NET; PERCEPTION;

EID: 85013409034     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1619788114     Document Type: Article

References (85)

1. von Helmholtz H (1925) Treatise on Physiological Optics; translated from the 3rd German Edition (1910) (Optical Society of America, Washington, DC).
2. Heeger DJ (1988) Optical flow using spatiotemporal filters. Int J Comput Vis 1: 279-302.
3. Heeger DJ, Simoncelli EP (1993) Model of visual motion sensing. Spatial Vision in Humans and Robots, eds Harris L, Jenkin M (Cambridge Univ Press, New York), pp 367-392.
4. Ma WJ, Beck JM, Latham PE, Pouget A (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9(11):1432-1438.
5. Knill DC, Pouget A (2004) The Bayesian brain: The role of uncertainty in neural coding and computation. Trends Neurosci 27(12):712-719.
6. Blake R, Logothetis N (2002) Visual competition. Nat Rev Neurosci 3(1):13-21.
7. Said CP, Heeger DJ (2013) A model of binocular rivalry and cross-orientation suppression. PLoS Comput Biol 9(3):e1002991.
8. Wilson HR, Krupa B, Wilkinson F (2000) Dynamics of perceptual oscillations in form vision. Nat Neurosci 3(2):170-176.
9. Moreno-Bote R, Knill DC, Pouget A (2011) Bayesian sampling in visual perception. Proc Natl Acad Sci USA 108(30):12491-12496.
10. Hoyer PO, Hyvarinen A (2003) Interpreting neural response variability as Monte Carlo sampling of the posterior. Adv Neural Inf Process Syst 15:293-300.
11. Gershman SJ, Vul E, Tenenbaum JB (2012) Multistability and perceptual inference. Neural Comput 24(1):1-24.
12. Sundareswara R, Schrater PR (2008) Perceptual multistability predicted by search model for Bayesian decisions. J Vis 8(5):12.1-19.
13. Crapse TB, Sommer MA (2008) Corollary discharge across the animal kingdom. Nat Rev Neurosci 9(8):587-600.
14. Kawato M (1999) Internal models for motor control and trajectory planning. Curr Opin Neurobiol 9(6):718-727.
15. Wolpert DM, Ghahramani Z, Jordan MI (1995) An internal model for sensorimotor integration. Science 269(5232):1880-1882.
16. Nijhawan R (2008) Visual prediction: Psychophysics and neurophysiology of compensation for time delays. Behav Brain Sci 31(2):179-198, discussion 198-239.
17. Palmer SE, Marre O, Berry MJ 2nd, Bialek W (2015) Predictive information in a sensory population. Proc Natl Acad Sci USA 112(22):6908-6913.
18. Bialek W, Nemenman I, Tishby N (2001) Predictability, complexity, and learning. Neural Comput 13(11):2409-2463.
19. Rao RP, Ballard DH (1997) Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput 9(4):721-763.
20. Wacongne C, Changeux JP, Dehaene S (2012) A neuronal model of predictive coding accounting for the mismatch negativity. J Neurosci 32(11):3665-3678.
21. Beck JM, Latham PE, Pouget A (2011) Marginalization in neural circuits with divisive normalization. J Neurosci 31(43):15310-15319.
22. Kiebel SJ, Daunizeau J, Friston KJ (2008) A hierarchy of time-scales and the brain. PLoS Comput Biol 4(11):e1000209.
23. Hawkins J, George D, Niemasik J (2009) Sequence memory for prediction, inference and behaviour. Philos Trans R Soc Lond B Biol Sci 364(1521):1203-1209.
24. Douglas RJ, Martin KA (1991) A functional microcircuit for cat visual cortex. J Physiol 440:735-769.
25. Douglas RJ, Koch C, Mahowald M, Martin KA, Suarez HH (1995) Recurrent excitation in neocortical circuits. Science 269(5226):981-985.
26. Heeger DJ, Simoncelli EP, Movshon JA (1996) Computational models of cortical visual processing. Proc Natl Acad Sci USA 93(2):623-627.
27. Simoncelli EP, Heeger DJ (1998) A model of neuronal responses in visual area MT. Vision Res 38(5):743-761.
28. Gilbert CD, Li W (2013) Top-down influences on visual processing. Nat Rev Neurosci 14(5):350-363.
29. Kosslyn SM, Ganis G, Thompson WL (2001) Neural foundations of imagery. Nat Rev Neurosci 2(9):635-642.
30. Marroquin JL, Figueroa JE, Servin M (1997) Robust quadrature filters. J Opt Soc Am A Opt Image Sci Vis 14:779-791.
31. Heeger DJ (1992) Normalization of cell responses in cat striate cortex. Vis Neurosci 9(2):181-197.
32. Carandini M, Heeger DJ (2011) Normalization as a canonical neural computation. Nat Rev Neurosci 13(1):51-62.
33. Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427(6971):244-247.
34. Griffiths TL, Tenenbaum JB (2006) Optimal predictions in everyday cognition. Psychol Sci 17(9):767-773.
35. Tenenbaum JB, Kemp C, Griffiths TL, Goodman ND (2011) How to grow a mind: Statistics, structure, and abstraction. Science 331(6022):1279-1285.
36. Wu HG, Miyamoto YR, Gonzalez Castro LN, Ölveczky BP, Smith MA (2014) Temporal structure of motor variability is dynamically regulated and predicts motor learning ability. Nat Neurosci 17(2):312-321.
37. Tumer EC, Brainard MS (2007) Performance variability enables adaptive plasticity of "crystallized" adult birdsong. Nature 450(7173):1240-1244.
38. Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5(11):1226-1235.
39. Fiser J, Berkes P, Orbán G, Lengyel M (2010) Statistically optimal perception and learning: From behavior to neural representations. Trends Cogn Sci 14(3):119-130.
40. Ganguli D, Simoncelli EP (2014) Efficient sensory encoding and Bayesian inference with heterogeneous neural populations. Neural Comput 26(10):2103-2134.
41. Zemel RS, Dayan P, Pouget A (1998) Probabilistic interpretation of population codes. Neural Comput 10(2):403-430.
42. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46(4):681-692.
43. Haefner RM, Berkes P, Fiser J (2016) Perceptual decision-making as probabilistic inference by neural sampling. Neuron 90(3):649-660.
44. Berkes P, Orbán G, Lengyel M, Fiser J (2011) Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331(6013):83-87.
45. Black MJ, Sapiro G, Marimont DH, Heeger D (1998) Robust anisotropic diffusion. IEEE Trans Image Process 7(3):421-432.
46. Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA (1986) Robust Statistics: The Approach Based on Influence Functions (Wiley, New York).
47. Landy MS, Maloney LT, Johnston EB, Young M (1995) Measurement and modeling of depth cue combination: In defense of weak fusion. Vision Res 35(3):389-412.
48. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429-433.
49. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE (2011) Neural correlates of reliabilitybased cue weighting during multisensory integration. Nat Neurosci 15(1):146-154.
50. Wiskott L, Sejnowski TJ (2002) Slow feature analysis: Unsupervised learning of invariances. Neural Comput 14(4):715-770.
51. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NIPS 2012). Available at papers.nips.cc/paper/4824-imagenet-classification-withdeep- convolutional-neural-networks. Accessed October 15, 2015.
52. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278-2324.
53. Riesenhuber M, Poggio T (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2(11):1019-1025.
54. Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. SIGGRAPH '95 Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (ACM, New York), pp 229-238.
55. Portilla J, Simoncelli EP (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40(1):49-70.
56. Hinton GE, Dayan P, Frey BJ, Neal RM (1995) The "wake-sleep" algorithm for unsupervised neural networks. Science 268(5214):1158-1161.
57. Geman S, Geman D (1984) Stochastic relaxation, gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6(6):721-741.
58. Rao RP, Ballard DH (1999) Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2(1):79-87.
59. Lee TS, Mumford D (2003) Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis 20(7):1434-1448.
60. Friston K (2005) A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci 360(1456):815-836.
61. Bastos AM, et al. (2012) Canonical microcircuits for predictive coding. Neuron 76(4):695-711.
62. Burns SP, Xing D, Shapley RM (2010) Comparisons of the dynamics of local field potential and multiunit activity signals in macaque visual cortex. J Neurosci 30(41):13739-13749.
63. Gatys LA, Ecker AS, Bethge M(2015) A neural algorithm of artistic style. arXiv:1508.06576.
64. Chaudhuri R, Knoblauch K, Gariel MA, Kennedy H, Wang XJ (2015) A large-scale circuit mechanism for hierarchical dynamical processing in the primate cortex. Neuron 88(2):419-431.
65. Hasson U, Yang E, Vallines I, Heeger DJ, Rubin N (2008) A hierarchy of temporal receptive windows in human cortex. J Neurosci 28(10):2539-2550.
66. Honey CJ, et al. (2012) Slow cortical dynamics and the accumulation of information over long timescales. Neuron 76(2):423-434.
67. Murray JD, et al. (2014) A hierarchy of intrinsic timescales across primate cortex. Nat Neurosci 17(12):1661-1663.
68. Eagleman DM, Sejnowski TJ (2000) Motion integration and postdiction in visual awareness. Science 287(5460):2036-2038.
69. Ranzato MA, Poultney C, Chopra S, LeCun Y (2006) Efficient learning of sparse representations with an energy-based model. Advances in Neural Information Processing Systems (MIT Press, Cambridge, MA), pp 1137-1144.
70. Carreira-Perpinán MA, Wang W (2014) Distributed optimization of deeply nested systems. Proceedings of the 17th International Conference on Artificial Intelligence and Statistics (AISTATS) 2014. Available at jmlr.org/proceedings/papers/v33/carreiraperpinan14. pdf. Accessed August 11, 2016.
71. Krogh A, Thorbergsson C, Hertz JA (1989) A cost function for internal representations. Advances in Neural Information Processing Systems 2 (NIPS 1989). Available at https://papers.nips.cc/paper/229-A-cost-function-for-internal-representations.pdf. Accessed August 12, 2016.
72. O'Reilly RC (1996) Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Comput 8(5).
73. Whittington J, Bogacz R (2015) Learning in cortical networks through error backpropagation. bioRxiv:035451.
74. Bengio Y, Mesnard T, Fischer A, Zhang S, Wu Y (January 17, 2017) STDP as presynaptic activity times rate of change of postsynaptic activity approximates back-propagation. Neural Computation, 10.1162/NECO-A-00934.
75. Pollen DA, Ronner SF (1981) Phase relationships between adjacent simple cells in the visual cortex. Science 212(4501):1409-1411.
76. Marr D (1983) Vision: A Computational Investigation into the Human Representation and Processing of Visual Information (W. H. Freeman, New York).
77. Carandini M (2012) From circuits to behavior: A bridge too far? Nat Neurosci 15(4): 507-509.
78. Laughlin RB, Pines D (2000) The theory of everything. Proc Natl Acad Sci USA 97(1):28-31.
79. Rosenberg A, Patterson JS, Angelaki DE (2015) A computational perspective on autism. Proc Natl Acad Sci USA 112(30):9158-9165.
80. Sinha P, et al. (2014) Autism as a disorder of prediction. Proc Natl Acad Sci USA 111(42):15220-15225.
81. Pellicano E, Burr D (2012) When the world becomes "too real": A Bayesian explanation of autistic perception. Trends Cogn Sci 16(10):504-510.
82. Dinstein I, et al. (2012) Unreliable evoked responses in autism. Neuron 75(6):981-991.
83. Dinstein I, Heeger DJ, Behrmann M (2015) Neural variability: Friend or foe? Trends Cogn Sci 19(6):322-328.
84. Gregory RL (2005) The Medawar Lecture 2001 Knowledge for vision: vision for knowledge. Philos Trans R Soc Lond B Biol Sci 360(1458):1231-1251.
85. Marroquin JL (1976) Human visual perception of structure. Master's thesis (MIT, Cambridge, MA).