Predictive coding

Wiley Interdisciplinary Reviews: Cognitive Science

Volumn 2, Issue 5, 2011, Pages 580-593

  Huang, Yanping ^a   Rao, Rajesh P N ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79954485066     PISSN: 19395078     EISSN: 19395086     Source Type: Journal    
DOI: 10.1002/wcs.142     Document Type: Review

References (73)

1. Field DJ. Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am 1987, 4:2379-2394.
2. Ruderman DL, Bialek W. Statistics of natural images: Scaling in the woods. Phys Rev Lett 1994, 73: 814-817.
3. Dong D, Atick J. Statistics of natural time-varying images. Network: Comput Neural Sys 1995, 6: 345-358.
4. Attneave F. Some informational aspects of visual perception. Psychol Rev 1954, 61:183-193.
5. MacKay DM. The epistemological problem for automata. In: Automata Studies. NJ: Princeton University Press; 1956, 235-251.
6. Barlow HB. Possible principles underlying the transformation of sensory messages sensory. In: Sensory Communication. MA: MIT Press; 1961, 217-234.
7. Srinivasan MV, Laughlin SB, Dubs A. Predictive coding: a fresh view of inhibition in the retina. Proc R Soc London Ser B 1982, 216:427-459.
8. Meister M, Berry MJ II. The neural code of the retina. Neuron 1999, 22:435-450.
9. Atick J. Could information theory provide an ecological theory of sensory processing? Network: Comput Neural Sys 1992, 3:213-251.
10. Buchsbaum G, Gottschalk A. Trichromacy, opponent colours coding and optimum colour information transmission in the retina. Proc R Soc Lond B Biol Sci 1983, 220:89-113.
11. Dan Y, Atick JJ, Reid RC. Efficient coding of natural scenes in the lateral geniculate nucleus: experimental test of a computational theory. J Neurosci 1996, 16: 3351-3362.
12. Dong D, Atick J. Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus. Network Comput Neural Sys 1995, 16: 159-178.
13. Hosoya T, Baccus S, Meister M. Dynamic predictive coding by the retina. Nature 2005, 436:71-77.
14. Hubel DH, Wiesel TN. Receptive fields and functional architecture of monkey striate cortex. J Physiol 1968, 195:215-243.
15. Jones JP, Palmer LA. An evaluation of the two-dimensional gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol 1987, 58: 1233-1258.
16. Olshausen BA, Field DJ. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996, 381:607-609.
17. Pasupathy A, Connor C. Responses to contour features in macaque area v4. J Neurophysiol 1999, 82: 2490-2502.
18. Hegde J, Van Essen DC. Selectivity for complex shapes in primate visual area v2. J Neurosci 2000, 20: (RC61):1-6.
19. Maunsell JH, Van Essen DC. Functional properties of neurons in middle temporal area of the macaque monkey. i. selectivity for stimulus direction, speed and orientation. J Neurophysiol 1983, 49:1127-1147.
20. Allbright TD. Direction and orientation selectivity of neurons in visual area MT of the macaque. J Neurophysiol 1984, 52:1106-1130.
21. Rao RPN, Ballard DH. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 1999, 2: 79-87.
22. Mumford D. On the computational architecture of the neocortex: the role of cortico-cortical loops. Biol Cybern 1992, 66:241-251.
23. Pece AEC. Redundancy reduction of a Gabor representation: a possible computational role for feedback from primary visual cortex to lateral geniculate nucleus. Artificial Neural Networks 2. Amsterdam: Elsevier Science; 1992, 865-868.
24. Jehee J, Rothkopf C, Beck J, Ballard D. Learning receptive fields using predictive feedback. J Physiol Paris 2006, 100:125-132.
25. Dayan P, Hinton GE, Neal RM, Zemel RS. The Helmholtz machine. Neural Comput 1995, 7:889-904.
26. Luettgen MR, Willsky AS. Likelihood calculation for a class of multiscale stochastic models, with application to texture discrimination. IEEE Trans Image Process 1995, 4:194-207.
27. Rissanen J. Stochastic Complexity in Statistical Inquiry. Singapore: World Scientific Publishing; 1999.
28. Schwabe L, Obermayer K. Modeling the adaptive visual system: a survey of principled approaches. Neural Networks 2003, 16:1357-1371.
29. Olshausen BA, Field DJ. Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision Res 1997, 37:3311-3325.
30. Bell AJ, Sejnowski TJ. The "independent components" of natural scenes are edge filters. Vision Res 1997, 37: 3327-3338.
31. Olshausen BA. Learning Linear, Sparse, Factorial Codes. A.I. Memo 1580. Massachusetts: Institute of Technology; 1996.
32. van Hateren JH, Ruderman DL. Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex. Proc R Soc Lond B 1998, 265:2315-2320.
33. Rao RPN. An optimal estimation approach to visual perception and learning. Vision Res 1999, 39:1963-89.
34. Nicholls JG, Martin AR, Wallace BG. From Neuron to Brain: A Cellular and Molecular Approach to the Function of the Nervous System. 3rd ed. MA: Sinauer Associates; 1992.
35. Barlow HB, Foldiák P. Adaptation and decorrelation in the cortex. In: Miall C, Durbin RM, Mitchison GJ, eds. The Computing Neuron. Wokingham: Addison-Wesley; 1989, 54-72.
36. Barlow HB. A theory about the functional role and synaptic mechanism of visual aftereffects. In: Blakemore C, ed. Vision: Coding and Efficiency. Cambridge: Cambridge University Press; 1990, 363-375.
37. Saul AB, Humphrey AL. Spatial and temporal response properties of lagged and nonlagged cells in cat lateral geniculate nucleus. J Neurophysiol 1990, 64:206-224.
38. Jones JP, Palmer LA. Effect of cooling area 18 on striate cortex cells in the squirrel monkey. J Neurophysiol 1982, 48:38-48.
39. Murphy PC, Sillito AM. Corticofugal feedback influences the generation of length tuning in the visual pathway. Nature 1987, 329:727-729.
40. Mignard M, Malpeli JG. Paths of information flow through visual cortex. Science 1991, 93:1249-1251.
41. Zhang Z, Ballard D. A single spike model of predictive coding. Neurocomputing 2004, 58-60:165-171.
42. Rao RPN, Ballard DH. Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput 1997, 9:721-763.
43. Dobbins A, Zucker SW, Cynader MS. Endstopped neurons in the visual cortex as a substrate for calculating curvature. Nature 1987, 329:438-441.
44. Bolz J, Gilbert CD. Generation of end-inhibition in the visual cortex via interlaminar connections. Nature 1986, 320:362-365.
45. Hubel DH, Wiesel TN. Receptive fields and functional architecture in two non-striate visual areas (18 and 19) of the cat. J Neurophysiol 1965, 28:229-289.
46. Hubel DH, Livingstone MS. Receptive fields and functional architecture of monkey striate cortex. J Neurosci 1987, 7:3378-3415.
47. Desimone R, Schein SJ. Visual properties of neurons in area v4 of the macaque: sensitivity to stimulus form. J Neurophysiol 1987, 57:835-868.
48. Allman J, Miezin F, McGuinness E. Stimulus specific response from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci 1985, 8: 407-429.
49. Zipser K, Lamme VAF, Schiller PH. Contextual modulation in primary visual cortex. J Neuroscience 1996, 16:7376-7389.
50. Spratling M. Predictive coding as a model of biased competition in visual attention. Vision Res 2008, 48:1391-1408.
51. Spratling MW. Predictive coding as a model of response properties in cortical area V1. J Neurosci 2010 March 3, 30:3531-43.
52. Murray S, Kersten D, Olshausen B, Schrater P, Woods D. Shape perception reduces activity in human primary visual cortex. PNAS 2002, 99:15164-15169.
53. Murray S, Scott O, Schrater P, Kersten D. Perceptual grouping and the interactions between visual cortical areas. Neural Networks 2004, 17:695-705.
54. Deco G, Schürmann B. Predictive coding in the visual cortex by a recurrent network with gabor receptive fields. Neural Process Lett 2001, 14:107-114.
55. Rao RPN, Ballard DH. Development of localized oriented receptive fields by learning a translation-invariant code for natural images. Network: Comput Neural Sys 1998, 9:219-234.
56. Grimes DB, Rao RPN. Bilinear sparse coding for invariant vision. Neural Comput 2005, 17:47-73.
57. Miao X, Rao RPN. Learning the Lie groups of visual invariance. Neural Comput 2007, 19:2665-2693.
58. Smith EC, Lewicki MS. Efficient auditory coding. Nature 2006, 439:978-992.
59. Vuust P, Ostergaard KJ, Pallesen L, Bailey C, Roepstorff A. Predictive coding of music-brain responses to rhythmic incongruity. Cortex 2009, 45:80-92.
60. Mehta M. Neuronal dynamics of predictive coding. Neuroscientist 2001, 7:490-495.
61. O'Doherty J, Buchanan T, Seymour B, Dolan R. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 2006, 49:157-166.
62. Summerfield C, Egner T, Greene M, Koechlin E, Mangels J, Hirsch J. Predictive codes for forthcoming perception in the frontal cortex. Science 2006 November, 314:1311-1314.
63. Rao RPN, Sejnowski TJ. Predictive coding, cortical feedback, and spike-timing dependent plasticity. In: Rao RPN, Olshausen B, Lewicki MS, eds. Probabilistic Models of the Brain. MA: MIT Press; 2002; 297-315.
64. Rao RPN, Ballard DH. Probabilistic models of attention based on iconic representations and predictive coding. In: Itti L, Rees G, Tsotsos J, eds. Neurobiology of Attention. MO: Academic Press; 2004.
65. Hamker FH. Modeling feature-based attention as an active top-down inference process. BioSystems 2006, 86:91-99.
66. Kilner J, Friston K, Frith C. Predictive coding: an account of the mirror neuron system. Cognitive Processing 2007 September, 8:159-166.
67. Hohwy J, Roepstorff A, Friston K. Predictive coding explains binocular rivalry: An epistemological review. Cognition 2008, 108:687.
68. Friston KJ, Kiebel S. Predictive coding under the free-energy principle. Phil. Trans R Soc B 2009, 364: 1211-1221.
69. Hesselmann G, Sadaghiani S, Friston KJ, Kleinschmidt A. Predictive coding or evidence accumulation? False inference and neuronal fluctuations. PLoS ONE 2010, 5:e9926.
70. Friston KJ, Daunizeau J, Kilner J, Kiebel SJ. Action and behavior: a free-energy formulation. Biol Cybern 2010, 102:227-60.
71. Jääskeläinen IP, Ahveninen J, Bonmassar G, Dale AM, Ilmoniemi RJ, Levanen S, Lin FH, May P, Melcher J, Stufflebeam S, et al. Human posterior auditory cortex gates novel sounds to consciousness. Proc Natl Acad Sci 2004, 101:6809-6814.
72. Desimone R. Neural mechanisms for visual memory and their role in attention. Proc Natl Acad Sci 1996, 93:13494-13499.
73. Kaplan E, Mukherjee P, Shapley R. Information filtering in the lateral geniculate nucleus. In: Shapley R, Lam DMK, eds. Contrast Sensitivity. Cambridge, MA: The MIT Press; 1993, 183-200.