Dynamic model of visual recognition predicts neural response properties in the visual cortex

Neural Computation

Volumn 9, Issue 4, 1997, Pages 721-763

  Rao, Rajesh P N ^a   Ballard, Dana H ^a  

^a University of Rochester   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CYTOLOGY; EYE FIXATION; HAPLORHINI; HUMAN; NERVE CELL; PHYSIOLOGY; SYNAPSE; VISION; VISUAL CORTEX;

ANIMALS; ARTIFICIAL INTELLIGENCE; FIXATION, OCULAR; HAPLORHINI; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; SYNAPSES; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 0031570014     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/neco.1997.9.4.721     Document Type: Article

References (123)

1. Allman, J., Miezin, F., & McGuinness, E. (1985). Stimulus specific responses from beyond the classical receptive field: Neurophysiological mechanisms for local-global comparisons in visual neurons. Annual Review of Neuroscience, 8, 407-429.
2. Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985). Encoding of spatial location by posterior parietal neurons. Science, 230, 456-458.
3. Andersen, C. H., & Van Essen, D. C. (1987). Shifter circuits: A computational strategy for dynamic aspects of visual processing. Proceedings of the National Academy of Sciences, 84, 6297-6301.
4. Ayache, N., & Faugeras, O. D. (1986). HYPER: A new approach for the recognition and positioning of two-dimensional objects. IEEE Trans. Pattern Analysis and Machine Intelligence, 8(1), 44-54.
5. Baddeley, R. (1996). Searching for filters with "interesting" output distributions: An uninteresting direction to explore? Network, 7(2), 409-421.
6. Baizer, J. S., Robinson, D. L., & Dow, B. M. (1977). Visual responses of area 18 neurons in awake, behaving monkey. Journal of Neurophysiology, 40, 1024-1037.
7. Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (in press). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences.
8. Barrow, H. G. (1987). Learning receptive fields. In Proceedings of the IEEE Int. Conf. on Neural Networks, pp. 115-121.
9. Baum, L, E., Petric, T., Soules, G., & Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Annals of Mathematical Statistics, 41, 164-171.
10. Bell, A. J., & Sejnowski, T. J. (in press). The "independent components" of natural scenes are edge filters. Submitted to Vision Research, 1996.
11. Blake, A., & Yuille, A. (Eds.). (1992). Active vision. Cambridge, MA: MIT Press.
12. Bolz, J., & Gilbert, C. D. (1986). Generation of end-inhibition in the visual cortex via interlaminar connections. Nature, 320, 362-365.
13. Broida, T. J., & Chellappa, R. (1986). Estimation of object motion parameters from noisy images. IEEE Trans. Pattern Analysis and Machine Intelligence, 8(1), 90-99.
14. Bryson, A. E., & Ho, Y.-C. (1975). Applied optimal control. New York: Wiley.
15. Carpenter, G. A., & Grossberg, S. (1987). A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54-115.
16. Chatfield, C., & Collins, A. J. (1980). Introduction to multivariate analysis. New York: Chapman and Hall.
17. Chou, K. C., Willsky, A. S., & Benveniste, A. (1994). Multiscale recursive estimation, data fusion, and regularization. IEEE Transactions on Automatic Control, 39(3), 464-478.
18. Chou, K. C., Willsky, A. S., & Nikoukhah, R. (1994). Multiscale systems, Kalman filters, and Riccati equations. IEEE Transactions on Automatic Control, 39(3), 479-492.
19. Churchland, P., & Sejnowski, T. (1992). The computational brain. Cambridge, MA: MIT Press.
20. Churchland, P. S., Ramachandran, V. S., & Sejnowski, T. J. (1994). A critique of pure vision. In C. Koch and J. L. Davis (Eds.), Large-Scale Neuronal Theories of the Brain (pp. 23-60). Cambridge, MA: MIT Press.
21. Creutzfeldt, O. D. (1977). Generality of the functional structure of the neocortex. Naturwissenschaften, 64, 507-517.
22. Daugman, J. G. (1980). Two-dimensional spectral analysis of cortical receptive field profiles. Vision Research, 20, 847-856.
23. Daugman, J. G. (1988). Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression. IEEE Trans. Acoustics, Speech, and Signal Proc., 36(7), 1169-1179.
24. Dayan, P., & Hinton, G. E. (1996). Varieties of Helmholtz machine. Neural Networks, 9(8), 1385-1403.
25. Dayan, P., & Zemel, R. S. (1995). Competition and multiple cause models. Neural Computation, 7, 565-579.
26. Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995). The Helmholtz machine. Neural Computation, 7, 889-904.
27. Deacon, T. (1989). Holism and associationism in neuropsychology: An anatomical synthesis. In E. Perecman (Ed.), Integrating Theory and Practice in Clinical Neuropsychology (pp. 1-47). Hillsdale, NJ: Erlbaum.
28. DeAngelis, G. C., Robson, J. G., Ohzawa, I., & Freeman, R. D. (1992). Organization of suppression in receptive fields of neurons in cat visual cortex. Journal of Neitrophysiology, 68(1), 144-163.
29. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statistical Society Series B, 39, 1-38.
30. Desimone, R., & Schein, S. J. (1987). Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. Journal of Neurophysiology, 57, 835-868.
31. Desimone, R., & Ungerleider, L. G. (1989). Neural mechanisms of visual processing in monkeys. In E Boller & J. Grafman (Eds.), Handbook of Neuropsychology (Vol. 2, pp. 267-299). New York: Elsevier.
32. Dickmanns, E. D., & Mysliwetz, B. D. (1992). Recursive 3D road and relative ego-state recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 14(2), 199-213.
33. Douglas, R. J., Martin, K. A. C., & Whitteridge, D. (1989). A canonical microcircuit for neocortex. Neural Computation, 1, 480-488.
34. Duhamel, J., Colby, L., & Goldberg, M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science, 255, 90-92.
35. Edelman, G. M. (1978). Group selection and phasic re-entrant signaling: A theory of higher brain function. In V. B. Mountcastle & G. M. Edelman (Eds.), The Mindful Brain (pp. 51-100). Cambridge, MA: MIT Press.
36. Felleman, D. J., & Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1, 1-47.
37. Feller, W. (1968). An introduction to probability theory and its applications (Vol. 1). New York: Wiley.
38. Fukushima, K. (1988). A neural network for visual pattern recognition. Computer, 21(3), 65-75.
39. Gallant, J. L. (1996). Cortical responses to natural scenes under controlled and free viewing conditions. Invest. Ophthalmol. Vis. Sci., 37(3), 674.
40. Gallant, J. L., Connor, C. E., & Van Essen, D. C. (1994). Responses of visual cortical neurons in a monkey freely viewing natural scenes. Soc. Neuro. Abstr., 20, 838.
41. Gallant, J. L., Connor, C. E., Drury, W., & Van Essen, D. C. (1995). Neural responses in monkey visual cortex during free viewing of natural scenes: Mechanisms of response suppression. Invest. Ophthalmol. Vis. Sci., 36, 1052.
42. Gilbert, C. D., & Wiesel, T. N. (1981). Laminar specialization and intracortical connections in cat primary visual cortex. In F. O. Schmitt, F. G. Worden, G. Adelman, & S. G. Dennis (Eds.), The Organization of the Cerebral Cortex (pp. 163-191). Cambridge, MA: MIT Press.
43. Girosi, F., Jones, M., & Poggio, T. (1995). Regularization theory and neural networks architectures. Neural Computation, 7(2), 219-269.
44. Grenander, U. (1976-1981). Lectures in pattern theory I, II and III: Pattern analysis, pattern synthesis and regular structures. Berlin: Springer-Verlag.
45. Grimes, J., & McConkie, G. (1995). On the insensitivity of the human visual system to image changes made during saccades. In K. Akins (Ed.), Problems in Perception. Oxford: Oxford University Press.
46. Grosof, D. H., Shapley, R. M., & Hawken, M. J. (1992). Macaque striate responses to anomalous contours? Invest. Ophthalmol. Vis. Sci., 33, 1257.
47. Gulyas, B., Orban, G. A., Duysens, J., & Maes, H. (1987). The suppressive influence of moving textured backgrounds on responses of cat striate neurons to moving bars. Journal of Neurophysiology, 57(6), 1767-1791.
48. Hallam, J. (1983). Resolving observer motion by object tracking. In Proc. of 8th International Joint Conf. on Artificial Intelligence (Vol. 2, pp. 792-798).
49. Hancock, P. J. B., Baddeley, R. J., & Smith, L. S. (1992). The principal components of natural images. Network, 3, 61-70.
50. Harpur, G. F., & Prager, R. W. (1996). Development of low-entropy coding in a recurrent network. Network, 7(2), 277-284.
51. Harth, E., Unnikrishnan, K. P., & Pandya, A. S. (1987). The inversion of sensory processing by feedback pathways: A model of visual cognitive functions. Science, 237, 184-187.
52. Heeger, D. J., Simoncelli, E. P., & Movshon, J. A. (1996). Computational models of cortical visual processing. Proc. National Acad. Sciences, 93, 623-627.
53. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The wake-sleep algorithm for unsupervised neural networks. Science, 268, 1158-1161.
54. Hubel, D. H. (1988). Eye, brain, and vision. New York: Scientific American Library.
55. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction, and functional architecture in the cat's visual cortex. Journal of Physiology (London), 160, 106-154.
56. Hubel, D. H., & Wiesel, T. N. (1965). Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. Journal of Neurophysiology, 28, 229-289.
57. Hubel, D. H., & Wiesel, T. N. (1968). Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology (London), 195, 215-243.
58. Irwin, D. E., McConkie, G. W., Carlson-Radvansky, L., & Currie, C. (1994). A localist evaluation solution for visual stability across saccades. Behavioral and Brain Sciences, 17, 265-266.
59. Jaakkola, T., Saul, L. K., & Jordan, M. I. (1996). Fast learning by bounding likelihoods in sigmoid type belief networks. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems 8 (pp. 528-534). Cambridge, MA: MIT Press.
60. Jones, E. G. (1981). Anatomy of cerebral cortex: Columnar input-output organization. In F. O. Schmitt, F. G. Worden, G. Adelman, & S. G. Dennis (Eds.), The Organization of the Cerebral Cortex (pp. 199-235). Cambridge, MA: MIT Press.
61. Jordan, M. I., & Rumelhart, D. E. (1992). Forward models: Supervised learning with a distal teacher. Cognitive Science, 16, 307-354.
62. Kalman, R. E. (1960). A new approach to linear filtering and prediction theory. Trans. ASME J. Basic Eng., 82, 35-45.
63. Kalman, R. E., & Bucy, R. S. (1961). New results in linear filtering and prediction theory. Trans. ASME J. Basic Eng., 83, 95-108.
64. Kanizsa, G. (1990). Subjective contours. In I. Rock (Ed.), The Perceptual World: Readings from Scientific American Magazine (pp. 155-163). San Francisco: Freeman.
65. Kawato, M., Hayakawa, H., & Inui, T. (1993). A forward-inverse optics model of reciprocal connections between visual cortical areas. Network, 4, 415-422.
66. Koch, C. (1996). Towards the neuronal substrate of visual consciousness. In S. R. Hameroff, A. W. Kaszniak, & A. C. Scott (Eds.), Towards a Science of Consciousness: The First Tucson Discussions and Debates. Cambridge, MA: MIT Press.
67. Kosslyn, S. M., Thompson, W. I., Kim, I. J., & Alpert, N. M. (1995). Topographical representations of mental images in primary visual cortex. Nature, 378, 496-498.
68. Li, M., & Vitanyi, P. (1993). An introduction to Kolmogorov complexity and its applications. New York: Springer-Verlag.
69. Linsker, R. (1988). Self-organization in a perceptual network. Computer, 21(3), 105-117.
70. Luettgen, M. R., & Willsky, A. S. (1995). Likelihood calculation for a class of multiscale stochastic models, with application to texture discrimination. IEEE Transactions on Image Processing, 4(2), 194-207.
71. Lund, J. S. (1981). Intrinsic organization of the primate visual cortex, area 17, as seen in Golgi preparations. In F. O. Schmitt, F. G. Worden, G. Adelman, & S. G. Dennis (Eds.), The Organization of the Cerebral Cortex (pp. 105-124). Cambridge, MA: MIT Press.
72. Luttrell, S. P. (1992). Self-supervised adaptive networks. IEE Proceedings Part F, 139, 371-377.
73. Luttrell, S. P. (1995). A componential self-organising neural network (Tech. Rep. No. DRA/CIS(SE1)/651/11/RP/3.1). Malvern, UK: Defence Research Agency.
74. MacKay, D. M. (1956). The epistemological problem for automata. In C. E. Shannon & J. McCarthy (Eds.), Automata Studies (pp. 235-251). Princeton, NJ: Princeton University Press.
75. Marcelja, S. (1980). Mathematical description of the responses of simple cortical cells. Journal of the Optical Society of America, 70, 1297-1300.
76. Matthies, L., Kanade, T., & Szeliski, R. (1989). Kalman filter-based algorithms for estimating depth from image sequences. International Journal of Computer Vision, 3, 209-236.
77. Maunsell, J. H. R., & Newsome, W. T. (1987). Visual processing in monkey extrastriate cortex. Annual Review of Neuroscience, 10, 363-401.
78. Maybeck, P. S. (1979). Stochastic models, estimation, and control (Vols. 1, 2). New York: Academic Press.
79. McConkie, G. W. (1991). Perceiving a stable visual world. In Proceedings of the Sixth European Conference on Eye Movements (pp. 5-7). Leuven, Belgium: Laboratory of Experimental Psychology.
80. Mignard, M., & Malpeli, J. G. (1991). Paths of information flow through visual cortex. Science, 251, 1249-1251.
81. Miller, E. K., Li, L., & Desimone, R. (1991). A neural mechanism for working and recognition memory in inferior temporal cortex. Science, 254, 1377-1379.
82. Muller, J. R., Singer, B., Krauskopf, J., & Lennie, P. (1996). Center-surround contrast effects in macaque cortex. Invest. Ophthalmol. Vis. Sci., 37(3), 904.
83. Mumford, D. (1994). Neuronal architectures for pattern-theoretic problems. In C. Koch & J. L. Davis (Eds.), Large-Scale Neuronal Theories of the Brain (pp. 125-152). Cambridge, MA: MIT Press.
84. Murphy, P. C., & Sillito, A. M. (1987). Corticofugal feedback influences the generation of length tuning in the visual pathway. Nature, 329, 727-729.
85. Nelson, J. I., & Frost, B. J. (1978). Orientation-selective inhibition from beyond the classic visual receptive field. Brain Research, 139, 359-365.
86. Nowlan, S. J., & Hinton, G. E. (1992). Simplifying neural networks by soft weight-sharing. Neural Computation, 4(4), 473-493.
87. Oja, E. (1989). Neural networks, principal components, and subspaces. International Journal of Neural Systems, 1, 61-68.
88. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
89. Oram, M. W., & Perrett, D. I. (1992). Time course of neural responses discriminating different views of the face and head. Journal of Neurophysiology, 68(1), 70-84.
90. Palmer, L. A., Jones, J. P., & Stepnoski, R. A. (1991). Striate receptive fields as linear filters: Characterization in two dimensions of space. In A. G. Leventhal (Ed.), The Neural Basis of Visual Function (pp. 246-265). Boca Raton: CRC Press.
91. Pece, A. E. C. (1992). Redundancy reduction of a Gabor representation: A possible computational role for feedback from primary visual cortex to lateral geniculate nucleus. In I. Aleksander & J. Taylor (Eds.), Artificial Neural Networks 2 (pp. 865-868). Amsterdam: Elsevier Science.
92. Pentland, A. P. (1992). Dynamic vision. In G. A. Carpenter & S. Grossberg (Eds.), Neural Networks for Vision and Image Processing (pp. 133-159). Cambridge, MA: MIT Press.
93. Pitts, W., & McCulloch, W. S. (1947). How we know universals: The perception of auditory and visual forms. Bulletin of Mathematical Biophysics, 9:127-147.
94. Poggio, T. (1990). A theory of how the brain might work. In Cold Spring Harbor Symposia on Quantitative Biology (pp. 899-910). Cold Spring Harbor, NY: Cold Spring Harbor Laboratory Press.
95. Poggio, T., Fahle, M., & Edelman, S. (1992). Fast perceptual learning in visual hyperacuity. Science, 256, 1018-1021.
96. Poggio, T., Torre, V., & Koch, C. (1985). Computational vision and regularization theory. Nature, 317, 314-319.
97. Rabiner, L. R., & Juang, B. H. (1986). An introduction to hidden Markov models. IEEE ASSP Magazine, 3, 4-16.
98. Rao, R. P. N. (1996). Robust Kalman filters for prediction, recognition, and learning (Tech. Rep. No. 645). Rochester, NY: Dept. of Computer Science, University of Rochester.
99. Rao, R. P. N., & Ballard, D. H. (1995a). An active vision architecture based on iconic representations. Artificial Intelligence (Special Issue on Vision), 78, 461-505.
100. Rao, R. P. N., & Ballard, D. H. (1995b). Dynamic model of visual memory predicts neural response properties in the visual cortex (Tech. Rep. No. 95.4). Rochester, NY: National Resource Laboratory for the Study of Brain and Behavior, Department of Computer Science, University of Rochester.
101. Rao, R. P. N., & Ballard, D. H. (1996). A class of stochastic models for invariant recognition, motion, and stereo (Tech. Rep. No. 96.1). Rochester, NY: National Resource Laboratory for the Study of Brain and Behavior, Department of Computer Science, University of Rochester.
102. Rao, R. P. N., Zelinsky, G. J., Hayhoe, M. M., & Ballard, D. W. (1996). Modeling saccadic targeting in visual search. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems 8 (pp. 830-836). Cambridge, MA: MIT Press.
103. Rissanen, J. (1989). Stochastic complexity in statistical inquiry. Singapore: World Scientific.
104. Rockland, R. S., & Pandya, D. N. (1979). Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey. Brain Research, 179, 3-20.
105. Rolls, E. (1989). The representation and storage of information in neuronal networks in the primate cerebral cortex and hippocampus. In R. Durbin, C. Miall, & G. Mitchison (Eds.), The Computing Neuron (pp. 125-159). Reading, MA: Addison-Wesley.
106. Saul, L. K., Jaakkola, T., & Jordan, M. I. (1996). Mean field theory for sigmoid belief networks. Journal of Artificial Intelligence Research, 4, 61-76.
107. Saund, E. (1995). A multiple cause mixture model for unsupervised learning. Neural Computation, 7, 51-71.
108. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423, 623-656.
109. Softky, W. R. (1996). Unsupervised pixel-prediction. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems 8 (pp. 809-815). Cambridge, MA: MIT Press.
110. Thorpe, S. J., & Imbert, M. (1989). Biological contraints on connectionist modelling. In R. Pfeifer, Z. Schreter, F. Fogelman-Soulie, & L. Steels (Eds.), Connectionism in Perspective (pp. 63-92). Amsterdam: Elsevier.
111. Tovee, M. J., Rolls, E. T., Treves, A., & Bellis, R. P. (1993). Information encoding and the responses of single neurons in the primate temporal visual cortex. Journal of Neurophysiology, 70(2), 640-654.
112. Ullman, S. (1994). Sequence seeking and counterstreams: A model for bidirectional information flow in the cortex. In C. Koch & J. L. Davis (Eds.), Large-Scale Neuronal Theories of the Brain (pp. 257-270). Cambridge, MA: MIT Press.
113. Van Essen, D. C. (1985). Functional organization of primate visual cortex. In A. Peters & E. G. Jones (Eds.), Cerebral Cortex (vol. 3, pp. 259-329). New York: Plenum.
114. Van Essen, D. C., Anderson, C. H., & Olshausen, B. A. (1994). Dynamic routing strategies in sensory, motor, and cognitive processing. In C. Koch & J. L. Davis (Eds.), Large-Scale Neuronal Theories of the Brain (pp. 271-299). Cambridge, MA: MIT Press.
115. Van Essen, D. C., & Maunsell, J. H. R. (1983). Hierarchical organization and functional streams in the visual cortex. Trends in Neuroscience, 6, 370-375.
116. von der Heydt, R., Peterhans, E., & Baumgartner, G. (1984). Illusory contours and cortical neuron responses. Science, 224, 1260-1262.
117. Williams, R. J. (1985). Feature discovery through error-correction learning (Tech. Rep. No. 8501). Institute for Cognitive Science, University of California at San Diego.
118. Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995). An internal model for sensorimotor integration. Science, 269, 1880-1882.
119. Young, R. A. (1985). The gaussian derivative theory of spatial vision: Analysis of cortical cell receptive field line-weighting profiles (Research Publication GMR-4920). Warren, MI: General Motors.
120. Zeki, S. M. (1976). The functional organization of projections from striate to prestriate visual cortex in the rhesus monkey. Cold Spring Harbor Symp. Quant. Biology, 40, 591-600.
121. Zeki, S. M. (1978). Uniformity and diversity of structure and function in rhesus monkey prestriate visual cortex. Journal of Physiology (London), 277, 273-290.
122. Zeki, S. M. (1983). Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours. Neuroscience, 9, 741-765.
123. Zemel, R. S. (1994). A minimum description length framework for unsupervised learning. Unpublished doctoral dissertation, Department of Computer Science, University of Toronto.