An optimal estimation approach to visual perception and learning

Vision Research

Volumn 39, Issue 11, 1999, Pages 1963-1989

  Rao, Rajesh P N ^a  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Attention; Kalman filtering; Perceptual learning; Prediction; Segmentation; Visual recognition

Indexed keywords

ARTICLE; ATTENTION; HUMAN; LEARNING; PREDICTION; PRIORITY JOURNAL; SPATIAL ORIENTATION; STATISTICAL MODEL; VISUAL DISCRIMINATION; VISUAL MEMORY; VISUAL ORIENTATION;

ATTENTION; DEPTH PERCEPTION; FORM PERCEPTION; HUMANS; LEARNING; MATHEMATICS; MODELS, NEUROLOGICAL; VISUAL PERCEPTION;

EID: 0032895527     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(98)00279-X     Document Type: Article

References (91)

1. Albus J.S. Outline for a theory of intelligence. IEEE Transactions on Systems, Man and Cybernetics. 21(3):1991;473-509.
2. Ayache N., Faugeras O.D. HYPER: a new approach for the recognition and positioning of two-dimensional objects. IEEE Transactions on Pattern Analysis and Machine Intelligence. 8(1):1986;44-54.
3. Ballard D.H. Introduction to natural computation. 1997;MIT Press, Cambridge, MA.
4. Barlow, H. B. (1985). Cerebral cortex as model builder. In Models of the visual cortex (pp. 37-46). New York: Wiley.
5. Barlow H. B. What is the computational goal of the neocortex? Koch C., Davis J.L. Large-scale neuronal theories of the brain. 1994;1-22 MIT Press, Cambridge, MA.
6. Bell A.J., Sejnowski T.J. The 'independent components' of natural scenes are edge filters. Vision Research. 37(23):1997;3327-3338.
7. Black M.J., Jepson A.D. Eigentracking: robust matching and tracking of articulated objects using a view-based representation. International Journal of Computer Vision. 26(1):1998;63-84.
8. Blake A., Yuille A. Active vision. 1992;MIT Press, Cambridge, MA.
9. Broida T.J., Chellappa R. Estimation of object motion parameters from noisy images. IEEE Transactions on Pattern Analysis and Machine Intelligence. 8(1):1986;90-99.
10. Brunelli R., Poggio T. Face recognition: features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence. 15(10):1993;1042-1052.
11. Bryson A.E., Ho Y.-C. Applied optimal control. 1975;Wiley, New York.
12. Buhmann, J. M., Lades, M., & Malsburg, C. v. d. (1990). Size and distortion invariant object recognition by hierarchical graph matching. In Proceedings of the IEEE IJCNN, vol. II (pp. 411-416). New York: IEEE Neural Networks Council San Diego.
13. Bülthoff H.H., Edelman S.Y., Tarr M.J. How are three-dimensional objects represented in the brain? Cerebral Cortex. 5(3):1995;247-260.
14. Cantoni, V., & Levialdi, S. (1986). Pyramidal systems for computer vision, Proceedings of a NATO advanced research workshop, Maratea, Italy, May 5-9, 1986. Berlin: Springer.
15. Chatfield C., Collins A.J. Introduction to multivariate analysis. 1980;Chapman and Hall, New York.
16. Chou K.C., Willsky A.S., Benveniste A. Multiscale recursive estimation, data fusion, and regularization. IEEE Transactions on Automatic Control. 39(3):1994;464-478.
17. Chrisman L. Reinforcement learning with perceptual aliasing. Proceedings of the eleventh national conference on artificial intelligence. 1992;183-188 AAAI Press, Menlo Park, CA.
18. Creutzfeldt O.D. Generality of the functional structure of the neocortex. Naturwissenschaften. 64:1977;507-517.
19. Daubechies, I. (1992). Ten lectures on wavelets. CBMS-NSF Regional Conferences Series in Applied Mathematics. SIAM, Philadelphia, PA.
20. Daugman J.G. Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression. IEEE Transactions on Acoustics, Speech and Signal Procedure. 36(7):1988;1169-1179.
21. Daugman J.G. High confidence visual recognition of persons by a test of statistical independence. IEEE Transactions on Pattern Analysis and Machine Intelligence. 15(11):1993;1148-1161.
22. Dayan P., Hinton G.E., Neal R.M., Zemel R.S. The Helmholtz machine. Neural Computation. 7:1995;889-904.
23. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B. 39:1977;1-38.
24. Dickmanns E.D., Mysliwetz B.D. Recursive 3D road and relative ego-state recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 14(2):1992;199-213.
25. Edelman S., Poggio T. Models of object recognition. Current Opinion in Neurobiology. 1(2):1991;270-273.
26. Felleman D.J., Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex. 1:1991;1-47.
27. Feller W. An introduction to probability theory and its applications. 1:1968;Wiley, New York.
28. Ferster D. Linearity of synaptic interactions in the assembly of receptive fields in cat visual cortex. Current Opinion in Neurobiology. 4:1994;563-568.
29. Field D.J. What is the goal of sensory coding? Neural Computation. 6:1994;559-601.
30. Freeman W.T. The generic viewpoint assumption in a framework for visual perception. Nature. 368:1994;542-545.
31. Grimson W.E.L. Object recognition by computer: The role of geometric constraints. 1990;MIT Press, Cambridge, MA.
32. Grossberg S. Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions. Biological Cybernetics. 23:1976;187-202.
33. Hackbusch W. Multi-grid methods and applications. 1985;Springer-Verlag.
34. Hallam, J. (1983). Resolving observer motion by object tracking. In Proceedings of the 8th international joint conference on artificial intelligence Vol. 2 (pp. 792-798). Los Altos, CA: William Kaufmann.
35. Harpur G.F., Prager R.W. Development of low-entropy coding in a recurrent network. Network. 7:1996;277-284.
36. Harth E., Unnikrishnan K.P., Pandya A.S. The inversion of sensory processing by feedback pathways: a model of visual cognitive functions. Science. 237:1987;184-187.
37. Hinton G.E., Dayan P., Frey B.J., Neal R.M. The wake-sleep algorithm for unsupervised neural networks. Science. 268:1995;1158-1161.
38. Huber P.J. Robust statistics. 1981;Wiley, New York.
39. Humphrey N. A history of the mind. 1992;Simon and Schuster, New York.
40. Huttenlocher, D. P., & Ullman, S. (1987). Recognizing solid objects by alignment. In International Conference on Computer Vision.
41. Isard, M., & Blake, A. (1996). Contour tracking by stochastic propogation of conditional density. In Proceedings of the fourth european conference on computer vision (ECCV) (pp. 343-356). New York: Springer.
42. Jolliffe I.T. Principal component analysis. 1986;Springer-Verlag, New York.
43. Kaelbling L.P., Littman M.L., Moore A.W. Reinforcement learning: a survey. Journal of Artificial Intelligence Research. 4:1996;237-285.
44. Kalman R.E., Bucy R.S. New results in linear filtering and prediction theory. Transactions of the ASME Journal of Basic Engineering. 83:1961;95-108.
45. Kalman R.E. A new approach to linear filtering and prediction theory. Transactions of the ASME Journal of Basic Engineering. 82:1960;35-45.
46. Kawato M., Hayakawa H., Inui T. A forward-inverse optics model of reciprocal connections between visual cortical areas. Network. 4:1993;415-422.
47. Kersten, D. (1999). High level vision as statistical inference. In M. Gazzaniga, The cognitive neurosciences (2nd ed.). Cambridge, MA: MIT Press (to appear).
48. Knill D. C., Richards W. Perception as Bayesian inference. 1996;Cambridge University Press, Cambridge, UK.
49. Kohonen, T. (1988). Self-organization and associative memory (2nd ed.). Springer-Verlag, Berlin.
50. Lamdan, Y., & Wolfson, H. J. (1988). Geometric hashing: a general and efficient model-based recognition scheme. In International conference on computer vision (pp. 238-249). Washington, DC: IEEE Computer Society Press.
51. Leonardis, A., & Bischof, H. (1996). Dealing with occlusions in the eigenspace approach. In Proceedings of the CVPR (pp. 453-458). Los Alamitos, CA: IEEE Computer Society Press.
52. Lewicki, M. S., & Sejnowski, T. J. (1998). Learning nonlinear overcomplete representations for efficient coding. In M. I. Jordan, M. J. Kearns, & S. A. Solla, Advances in neural information processing systems 10 (pp. 556-562). Cambridge, MA: MIT Press.
53. Lindeberg T. Scale-space theory in computer vision. 1994;Kluwer Academic Publishers, Netherlands.
54. Logothetis N.K., Pauls J., Bülthoff H.H., Poggio T. View-dependent object recognition by monkeys. Current Biology. 4:1994;401-414.
55. Lowe D.G. Three-dimensional object recognition from single two-dimensional images. Artificial Intelligence. 31:1987;355-395.
56. MacKay, D. M. (1956). The epistemological problem for automata. In Automata studies (pp. 235-251). Princeton, NJ: Princeton University Press.
57. Matthies L., Kanade T., Szeliski R. Kalman filter-based algorithms for estimating depth from image sequences. International Journal of Computer Vision. 3:1989;209-236.
58. Maybeck, P. S. (1979). Stochastic models, Estimation, and Control, vol. I and II. New York: Academic Press.
59. McCallum R.A. Hidden state and reinforcement learning with instance-based state identification. IEEE Transactions on Systems, Man and Cybernetics. 26(3):1996;464-473.
60. Mel B. SEEMORE: a view-based approach to 3-D object recognition using multiple visual cues. Touretzky D., Mozer M., Hasselmo M. Advances in neural information processing systems 8. 1996;865-871 MIT Press, Cambridge, MA.
61. Mishkin M., Ungerleider L.G., Macko K.A. Object vision and spatial vision: two cortical pathways. Trends in Neuroscience. 6:1983;414-417.
62. Mumford D. On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biological Cybernetics. 66:1992;241-251.
63. Murase H., Nayar S.K. Visual learning and recognition of 3D objects from appearance. International Journal of Computer Vision. 14:1995;5-24.
64. Neisser U. Cognitive psychology. 1967;Appleton-Century-Crofts, New York.
65. Nelson R. C., Selinger A. A Cubist approach to object recognition. International conference on computer vision. 1998;614-621 Narosa Publishing House, New Dehli, India.
66. Olshausen B.A., Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 381:1996;607-609.
67. Olshausen B.A., Field D.J. Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision Research. 37(23):1997;3311-3325.
68. O'Reilly, R. C. (1996). The LEABRA model of neural interactions and learning in the neocortex. Ph.D thesis, Department of Psychology, Carnegie Mellon University.
69. Pandya D. N., Seltzer B., Barbas H. Input-output organization of the primate cerebral cortex. Steklis H. D., Erwin J. Comparative primate biology, volume 4: neurosciences. 1988;39-80 Alan R. Liss, New York.
70. Pece A. E. C. Redundancy reduction of a Gabor representation: a possible computational role for feedback from primary visual cortex to lateral geniculate nucleus. Aleksander I., Taylor J. Artificial neural networks 2. 1992;865-868 Elsevier Science, Amsterdam.
71. Pentland A.P. Dynamic vision. Carpenter G. A., Grossberg S. Neural networks for vision and image processing. 1992;133-159 MIT Press, Cambridge, MA.
72. Picton T.W., Stuss D.T. Neurobiology of conscious experience. Current Opinion in Neurobiology. 4:1994;256-265.
73. Poggio T., Edelman S. A network that learns to recognize 3D objects. Nature. 343:1990;263-266.
74. Rao R.P.N., Ballard D.H. An active vision architecture based on iconic representations. Artificial Intelligence (Special Issue on Vision). 78:1995;461-505.
75. Rao R.P.N., Ballard D.H. Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computation. 9(4):1997;721-763.
76. Rao, R. P. N., & Ballard, D. H. (1997). Efficient encoding of natural time varying images produces oriented space-time receptive fields. Technical Report 97.4, National Resource Laboratory for the study of Brain and Behavior, Computer Science Department, University of Rochester.
77. Rao R.P.N., Ballard D.H. Development of localized oriented receptive fields by learning a translation-invariant code for natural images. Network: Computation in Neural Systems. 9(2):1998;219-234.
78. Rao, R. P. N., & Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects. Nature Neuroscience 2(1) (in press).
79. Rao, R. P. N., & Ruderman, D. L. (1999). Learning Lie transformation groups for invariant visual perception. In M. Kearns, S.A. Solla, & D. Cohn, Advances in neural information processing systems 11. Cambridge, MA: MIT Press (in press).
80. Schiele, B., & Crowley, J. L. (1996). Object recognition using multidimensional receptive field histograms. In Proceedings of the fourth European conference on computer vision (ECCV) (pp. 610-619). New York: Springer.
81. Schmid, C., & Mohr, R. (1996). Combining greyvalue invariants with local constraints for object recognition. In Proceedings of the conference on computer vision and pattern recognition (pp. 872-877). Los Alamitos, CA: IEEE Computer Society Press.
82. Simoncelli E.P., Freeman W.T., Adelson E.H., Heeger D.J. Shiftable multiscale transforms. IEEE Transactions on Information Theory. 38(2):1992;587-607.
83. Softky W.R. Unsupervised pixel-prediction. Touretzky D., Mozer M., Hasselmo M. Advances in neural information processing systems 8. 1996;809-815 MIT Press, Cambridge, MA.
84. Swain M.J., Ballard D.H. Color indexing. International Journal of Computer Vision. 7:1991;11-32.
85. Tarr M.J., Pinker S. Mental rotation and orientation-dependence in shape recognition. Cognitive Psychology. 21:1989;233-282.
86. Turk M., Pentland A. Eigenfaces for recognition. Journal of Cognitive Neuroscience. 3(1):1991;71-86.
87. Ungerleider L., Mishkin M. Two cortical visual systems. Ingle D., Goodale M., Mansfield R. Analysis of visual behavior. 1982;549-585 MIT Press, Cambridge, MA.
88. Van Essen D.C., Maunsell J.H.R. Hierarchical organization and functional streams in the visual cortex. Trends in Neuroscience. 6:1983;370-375.
89. Van Essen D.C. Functional organization of primate visual cortex. Peters A., Jones E. G. Cerebral cortex. 3:1985;259-329 Plenum, New York, NY.
90. Viola, P. (1996). Complex feature recognition: A Bayesian approach for learning to recognise objects. Artificial Intelligence Lab Memo 1591, MIT, Cambridge, MA.
91. Whitehead S.D., Ballard D.H. Learning to perceive and act by trial and error. Machine Learning. 7(1):1991;45-83.