Hierarchical neural networks for image interpretation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2766, Issue , 2003, Pages 1-220

  Behnke, Sven ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 22144480622     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: None     Document Type: Article

References (248)

1. Emile H.L. Aarts and Jan Korst. Simulated Annealing and Boltzman Machines - A Stochastic Approach to Combinatorial Optimization and Neural Computing. John Wiley & Sons, Chichester, 1990.
2. David H. Ackley, Geoffrey E. Hinton, and Terrence J. Sejnowski. A learning algorithm for Boltzman machines. Cognitive Science, 9:147-169, 1985.
3. Infineon AG. Infineon enables third dimension of chip integration - develops SOLID stacking technology to connect multiple chips for 'system-in-package' electronics. Press release, 2002.
4. AIM, Inc. ISS Data Matrix. BC11, ANSI/AIM, 1995.
5. AIM, Inc. USS - Code 39. BC1, ANSI/AIM, 1995.
6. AIM, Inc. USS - Code 49. BC6, ANSI/AIM, 1995.
7. Shun-ichi Amari. Dynamics of pattern formation in lateral-inhibition type neural fields. Biological Cybernetics, 27:77-87, 1977.
8. Peter J. Angeline, Gregory M. Saunders, and Jordan B. Pollack. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions Neural Networks, 5(1):54-65, 1994.
9. Paolo Arena, Luigi Fortuna, and Mattia Frasca. Attitude control in walking hexapod robots: an analogic spatio-temporal approach. International Journal on Circuit Theory and Applications, 30(2):349-362, 2002.
10. ASME. Pitney Bowes Model M postage meter 1920. Designated the 20th international historic mechanical engineering landmark, The American Society of Mechanical Engineers, 1986.
11. Amir F. Atiya and Alexander G. Parlos. New results on recurrent network training: Unifying the algorithms and accelerating convergence. IEEE Transactions Neural Networks, 11(3):697-709, 2000.
12. Simon Baker and Takeo Kanade. Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(8), August 2002.
13. Dana H. Ballard. Generalizing the Hough transform to detect arbitrary shapes. Pattern Recognition, 13(2):111-122, 1981.
14. David Balya, Botond Roska, Tamas Roska, and Frank S. Werblin. CNN framework for modeling parallel processing in a mammalian retina. International Journal on Circuit Theory and Applications, 30(2):363-393, 2002.
15. Horace B. Barlow. Single units and sensation. Perception, 1:371-394, 1972.
16. Horace B. Barlow. Unsupervised learning. Neural Computation, 1(3):295-311, 1989.
17. Wilhelm Barthlott and Christoph Neinhuis. Purity of the sacred lotus, or escape from contamination in biological surfaces. Planta, 202(1):1-8, 1997.
18. Roberto Battiti. First and second-order methods for learning: Between steepest descent and Newton's method. Neural Computation, 4(2):141-166, 1992.
19. Volker Baumgarte, Frank May, Armin Nückel, Martin Vorbach, and Markus Weinhardt. PACT XPP - A self-reconfigurable data processing architecture. In Proceedings of International Conference on Engineering of Reconfigurable Systems and Algorithms (ERSA 2001) - Las Vegas, 2001.
20. Sven Behnke, Bernhard Frötschl, Raúl Rojas, Peter Ackers, Wolf Lindstrot, Manuel de Melo, Andreas Schebesch, Mark Simon, Martin Sprengel, and Oliver Tenchio. Using hierarchical dynamical systems to control reactive behavior. In M. Veloso, E. Pagello, and H. Kitano, editors, RoboCup-99: Robot Soccer World Cup III, volume 1856 of LNCS, pages 186-195. Springer, 2000.
21. Sven Behnke, Marcus Pfister, and Raul Rojas. Recognition of handwritten digits using structural information. In Proceedings of International Conference on Neural Networks (ICNN'97) - Houston, volume 3, pages 1391-1396, 1997.
22. Sven Behnke, Marcus Pfister, and Raul Rojas. A study on the combination of classifiers for handwritten digit recognition. In Proceedings of Third International Workshop on Neural Networks in Applications (NN'98) - Magdeburg, Germany, pages 39-46, 1998.
23. Sven Behnke and Raúl Rojas. Activity driven update in the Neural Abstraction Pyramid. In Proceedings of International Conference on Artificial Neural Networks (ICANN'98) - Skövde, Sweden, volume 2, pages 567-572, 1998.
24. Sven Behnke and Raúl Rojas. Neural Abstraction Pyramid: A hierarchical image understanding architecture. In Proceedings of International Joint Conference on Neural Networks (IJCNN'98) - Anchorage, volume 2, pages 820-825, 1998.
25. Sven Behnke and Raúl Rojas. A hierarchy of reactive behaviors handles complexity. In M. Hennebauer, J. Wendler, and E. Pagello, editors, Balancing Reactivity and Social Deliberation in Multi-Agent Systems, volume 2103 of LNAI, pages 125-136, Berlin, 2001. Springer.
26. Anthony J. Bell and Terrence J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6):1129-1159, 1995.
27. Richard E. Bellman. Adaptive Control Processes. Princeton University Press, Priceton, NJ, 1961.
28. Yoshua Bengio, Patrice Simard, and Paolo Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2):157-166, 1994.
29. Kevin Beyer, Jonathan Goldstein, Raghu Ramakrishnan, and Uri Shaft. When is 'Nearest Neighbor' meaningful? In Proceedings of 7th International Conference on Database Theory (ICDT'99) - Jerusalem, pages 217-235, 1999.
30. Michael Biehl and Holm Schwarze. Learning by online gradient descent. Journal of Physics A, 28:643-656, 1995.
31. Matthias Bierling. Displacement estimation by hierarchical blockmatching. SPIE Visual Communications and Image Processing, 1001:942-951, 1988.
32. Anselm Blumer, Andrzej Ehrenfeucht, David Haussler, and Manfred K. Warmuth. Occam's razor. Information Processing Letters, 24(6):377-380, 1987.
33. Rafal Bogacz and Marcin Chady. Local connections in a neural network improve pattern completion. In Proceedings of 3rd International Conference on Cognitive and Neural Systems (CNS'99) - Boston, 1999.
34. Jeremy S. De Bonet. Multiresolution sampling procedure for analysis and sysnthesis of texture images. In Computer Graphics Proceedings SIGGRAPH'97, pages 361-368, 1997.
35. Geoffrey M. Boynton, Jonathan B. Demb, Gary H. Glover, and David J. Heeger. Neuronal basis of contrast discrimination. Vision Research, 39:257-269, 1999.
36. Leo Breiman, Charles J. Stone, Richard A. Olshen, and Jerome H. Friedman. Classification and Regression Trees. Wadsworth International, Belmont, CA, 1984.
37. Jean Bullier. Feedback connections and conscious vision. Trends Cognitive Science, 5(9):369-370, 2001.
38. Peter J. Burt and Edward H. Adelson. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31(4):532-540, 1983.
39. Roberto Caminiti, Klaus-Peter Hoffmann, Francesco Lacquaniti, and Jennifer S. Altman, editors. Vision and Movement Mechanisms in the Cerebral Cortex. HFSP Workshop Series. Human Frontier Science Program, Strasbourg, 1996.
40. Gail A. Carpenter and Stephen Grossberg. Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge, MA, 1991.
41. Leon O. Chua and Tamas Roska. The CNN paradigm. IEEE Transactions on Circuits and Systems, 40(3):147-156, 1993.
42. Leon O. Chua and Tamas Roska. Cellular Neural Networks and Visual Computing. Cambridge University Press, Cambridge, UK, 2001.
43. Ronald R. Coifman, Yves Meyer, Steven Quake, and M. Victor Wickerhauser. Signal processing and compression with wave packets. In J. S. Byrnes, editor, Wavelets and Their Applications, pages 363-378. Kluwer Academic Press, 1994.
44. James W. Cooley and John W. Tukey. An algorithm for the machine computation of the complex Fourier series. Mathematics of Computation, 19(90):297-301, 1965.
45. Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001.
46. Thomas M. Cover and Peter E. Hart Nearest neighbor pattern classification. IEEE Transactions on Infromation Theory, 13(1):21-27, 1967.
47. Nello Cristianini and John Shawe-Taylor. An Introduction to Support Vector Machines. Cambridge University Press, Cambridge, UK, 2000.
48. George Cybenko. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems, 2:303-314, 1989.
49. Ingrid Daubechies. Ten Lectures on Wavelets, volume 61 of CBMS-NSF Series in Applied Mathematics. SIAM Publications, 1992.
50. Peter Dayan, Geoffrey E. Hinton, Radford M. Neal, and Richard S. Zemel. The Helmholtz machine. Neural Computation, 7:889-904, 1995.
51. Fabio Dell'Acqua and Robert Fisher. Reconstruction of planar surfaces behind occlusions in range images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4):569-575, 2002.
52. Arthur P. Dempster, Nan M. Laird, and Donald B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-38, 1977.
53. Marcus Dill and Manfred Fahle. Limited translation invariance of human visual pattern recognition. Perception and Psychophysics, 60(1):65-81, 1998.
54. Glen M. Doninger, John J. Foxe, Micah M. Murray, Beth A. Higgins, John G. Snodgrass, Charles E. Schroeder, and Daniel C. Javitt. Activation timecourse of ventral visual stream object-recognition areas: High density electrical mapping of perceptual closure processes. Journal of Cognitive Neuroscience, 12(4):615-621, 2000.
55. David L. Donoho and lain M. Johnstone. Adapting to unknown smoothness via wavelet shrinkage. Journal of the American Statistical Association, 90(432):1200-1224, 1995.
56. David L. Donoho and lain M. Johnstone. Adapting to unknown smoothness via wavelet shrinkage. Journal of the American Statistical Association, 90(432):1200-1224, 1995.
57. Richard O. Duda and Peter E. Hart. Pattern Recognition and Scene Analysis. John Wiley & Sons, 1973.
58. Douglas Eck and Jürgen Schmidhuber. Learning the long-term structure of the Blues. In J.R. Dorronsoro, editor, Proceedings of International Conference on Artificial Neural Networks (ICANN 2002) - Madrid, volume 2415 of LNCS, pages 284-289. Springer, 2002.
59. Reinhard Eckhorn, Roman Bauer, W. Jordan, Michael Brosch, Wolfgang Kruse, M. Munk, and H.J. Reitboeck. Coherent oscillations: a mechanism for feature linking in the visual cortex. Biological Cybernetics, 60:121-130, 1988.
60. Bradley Efron and Robert J. Tibshirani. An Introduction to the Bootstrap. Chapman and Hall, New York, 1993.
61. Michael Egmont-Petersen, Dick de Ridder, and Heinz Handels. Image processing with neural networks - a review. Pattern Recognition, 35(10):2279-2301, 2002.
62. Michael Elad and Arie Feuer. Super-resolution restoration of continuous image sequence - Adaptive filtering approach. IEEE Trans. on Image Processing, 8(3):387-395, 1999.
63. Scott E. Fahlman. Faster-learning variations on backpropagation: An empirical study. In D.S. Touretzky, G.E. Hinton, and T.J. Sejnowski, editors, Proceedings of the 1988 Connectionist Models Summer School - Pittsburg, pages 38-51, San Mateo, CA, 1988. Morgan Kaufmann.
64. Gustav Theodor Fechner. Über ein wichtiges psychophysisches Grundgesetz und dessen Beziehung zur Schätzung von Sterngrössen. In Abk. k. Ges. Wissensch. Math.-Phys. K1,4, 1858.
65. Daniel J. Felleman and David C. Van Essen. Distributed hierarchical processing in primate cerebral cortex. Cerebral Cortex, 1:1-47, 1991.
66. Roger Fletcher. Conjugate gradient methods for indefinite systems. In G. A. Watson, editor, Proceedings of 6th Biennial Conference on Numerical Analysis - Dundee, Scotland, volume 506 of Lecture Notes in Mathematics, pages 73-89. Springer, 1976.
67. Roger Fletcher. Practical Methods of Optimization. John Wiley, New York, 1987.
68. Peter Földiak. Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics, 64(2):165-170, 1990.
69. Peter Földiak. Learning invariance from transformation sequences. Neural Computation, 3(2):194-200, 1991.
70. Peter Földiak. Sparse coding in the primate cortex. In Michael A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, Second edition. MIT Press, 2002.
71. William T. Freeman, Thouis R. Jones, and Egon C. Pasztor. Example-based super-resolution. IEEE Computer Graphics and Applications, 22(2):56-65, 2002.
72. William T. Freeman and Egon C. Pasztor. Learning low-level vision. In Proceedings of IEEE 7th International Conference on Computer Vision (ICCV'99) - Kerkyra, Greece, pages 1182-1189, 1999.
73. William T. Freeman, Egon C. Pasztor, and Owen T. Carmichael. Learning low-level vision. International Journal of Computer Vision, 40(1):25-47, 2000.
74. Yoav Freund and David Haussler. Unsupervised learning of distributions of binary vectors using 2-layer networks. In J. E. Moody, S.J. Hanson, and R.P. Lippmann, editors, Advances in Neural Information Processing Systems 4, pages 912-919. Morgan Kaufmann, 1992.
75. Brendan J. Frey, Peter Dayan, and Geoffrey E. Hinton. A simple algorithm that discovers efficient perceptucl codes. In M. Jenkin and L.R. Harris, editors, Computational and Biological Mechanisms of Visual Coding, New York, 1997. Cambridge University Press.
76. Brendan J. Frey and David J. C. MacKay. A revolution: Belief propagation in graphs with cycles. In M.I. Jordan, M.J. Kearns, and S.A. Solla, editors, Advances in Neural Information Processing Systems 10, pages 479-485, Cambridge, MA, 1998. MIT Press.
77. Kunihiko Fukushima. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics, 36:193-202, 1980.
78. Kunihiko Fukushima, Sei Miyake, and Takayuki Ito. Neocognitron: A neural network model for a mechanism of visual pattern recognition. IEEE Transactions on Systems, Man, and Cybernetics, 13:826-834, 1983.
79. Dennis Gabor. Theory of communication. Journal of the Institution of Electrical Engineers, 93(III):429-457, 1946.
80. Michael D. Garris and R. Allen Wilkinson. NIST special database 3 - handwritten segmented characters. Technical Report HWSC, NIST, 1992.
81. Stuart Geman, Elie Bienenstock, and Rene Doursat. Neural networks and the bias/variance dilemma. Neural Computation, 4(1):1-58, 1992.
82. Martin A. Giese. Dynamic Neural Field Theory for Motion Perception, volume 469 of The Kluwer International Series in Engineering and Computer Science. Kluwer Academic Publishers, Boston, 1998.
83. Venu Govindaraju. Locating human faces in photographs. International Journal of Computer Vision, 19:129-146, 1996.
84. Stephen Grossberg. How does the cerebral cortex work? Learning, attention and grouping by the laminar circuits of visual cortex. Spatial Vision, 12:163-186, 1999.
85. Stephen Grossberg and James R. Williamson. A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual groupings and learning. Cerebral Cortex, 11:37-58, 2001.
86. Patrick J. Grother and Gerald T. Candela. Comparison of handprinted digit classifiers. Technical Report NISTIR 5209, NIST, 1993.
87. Jürgen Haag and Alexander Borst. Encoding of visual motion information and reliability in spiking and graded potential neurons. Journal of Neuroscience, 17:4809-4819, 1997.
88. Alfred Haar. Zur Theorie der orthogonalen Funktionensysteme. Mathematische Annalen, 69:331-371, 1910.
89. Richard H. R. Hahnloser. On the piecewise analysis of networks of linear threshold neurons. Neural Networks, 11:691-697, 1998.
90. Richard H. R. Hahnloser, Rahul Saipeshkar, Misha A. Mahowald, Rodney J. Douglas, and H. Sebastian Seung. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature, 405:947-951, 2000.
91. Donald Hebb. The Organization of Behaviour. John Wiley, New York, 1949.
92. Bernd Heisele, Tomaso Poggio, and Massimiliano Pontil. Face detection in still gray images. AI Memo 1687, MIT AI Lab, 2000.
93. Werner Heisenberg. Über den anschaulichen Inhalt der quantentheoretischen Kinematik und Mechanik. Zeitschrift für Physik, 43:172-198, 1927.
94. Rolf D. Henkel. A simple and fast neural network approach to stereovision. In M.I. Jordan, M.J. Kearns, and S.A. Solla, editors, Advances in Neural Information Processing Systems 10, pages 808-814. MIT Press, 1998.
95. Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, and David H. Salesin. Image analogies. In Computer Graphics Proceedings SIGGRAPH 2001 - Los Angeles, pages 327-340, 2001.
96. Salah El Hihi and Yoshua Bengio. Hierarchical recurrent neural networks for long-term dependencies. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems 8, pages 493-499. MIT Press, 1996.
97. Geoffrey E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
98. Geoffrey E. Hinton, Peter Dayan, Brendan J. Frey, and Radford M. Neal. The Wake-Sleep algorithm for unsupervised neural networks. Science, 268:1158-1161, 1995.
99. Erik Hjelmas and Boon Kee Low. Face detection: A survey. Computer Vision and Image Understanding, 83:236-274, 2001.
100. Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.
101. John J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 79:2554-2558, 1982.
102. John J. Hopfield and Carlos D. Brody. What is a moment? 'Cortical' sensory integration over a brief interval. Proceedings of the National Academy of Sciences, USA, 97(25):13919-13924, 2000.
103. John J. Hopfield and Carlos D. Brody. What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. Proceedings of the National Academy of Sciences, USA, 98(3):1282-1287, 2001.
104. Kurt Hornik, Maxwell Stinchcombe, and Halbert White. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5)359-366, 1989.
105. David H. Hubel and Torsten N. Wiesel. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology, 160:106-154, 1962.
106. Aapo Hyvarinen and Erkki Oja. A fast fixed-point algorithm for independent component analysis. Neural computation, 9(7):1483-1492, 1997.
107. Christian Igel and Michael Hüsken. Empirical evaluation of the improved Rprop learning algorithm. Neurocomputing, 50(C):105-123, 2003.
108. Minami Ito, Hiroshi Tamura, Ichiro Fujita, and Keiji Tanaka. Size and position invariance of neuronal-responses in inferotemporal cortex. Journal of Neurophysiology, 73(1):218-226, 1995.
109. Herbert Jaeger. The 'echo state' approach to analysing and training recurrent neural networks. Technical Report GMD 148, German National Research Center for Information Technology, 2001.
110. Shi-Hong Jeng, Hong-Yuan Mark Liao, Chin-Chuan Han, Ming-Yang Chern, and Yao-Tsorng Liu. Facial feature detection using geometrical face model: An efficient approach. Pattern Recognition, 31(3):273-282, 1998.
111. Oliver Jesorsky, Klaus J. Kirchberg, and Robert W. Frischholz. Robust face detection using the Hausdorff distance. In Proceedings of Third International Conference on Audio- and Video-based Biometric Person Authentication, LNCS-2091, Halmstad, Sweden, pages 90-95. Springer, 2001.
112. Scott P. Johnson and Richard N. Aslin. Perception of object unity in young infants: The roles of motion, depth, and orientation. Cognitive Development, 11:161-180, 1996.
113. Scott P. Johnson, J. Gavin Bremner, Alan Slater, Uschi Mason, and Kirsty Foster. Young infants' perception of object trajectories: Filling in a spatiotemporal gap. In Proceedings of 12th International Conference on Infant Studies (ICIS2000) - Brighton, England, 2000.
114. Bela Jualesz. Towards an axiomatic theory of preattentive vision. In G.M. Edelman, W.E. Gall, and W.M. Cowan, editors, Dynamic Aspects of Neocortical Function, pages 585-612, New York, 1984. Wiley.
115. Christian Jutten and Jeanny Herault. Blind separation of sources, an adaptive algorithm based on neuromimetic architecture. Signal Processing, 24(1):1-31, 1991.
116. Rudolph E. Kalman. A new approach to linear filtering and prediction problems. Transactions of the ASME-Joumal of Basic Engineering, 82(Series D):35-45, 1960.
117. Eric R. Kandel, James H. Schwartz, and Thomas M. Jessel, editors. Principles of Neural Science (Fourth Edition). McGraw-Hill, 2000.
118. G.K. Kanizsa. Organization in Vision. Praeger, New York, 1989.
119. Ujval J. Kapasi, William J. Dally, Scott Rixner, John D. Owens, and Brucek Khailany. The imagine stream processor. In Proceedings of 20th International Conference on Computer Design (ICCD 2002) - Freiburg, Germany, pages 282-288, 2002.
120. Michael Kass, Andrew Witkin, and Demetri Terzopoulous. Snakes: Active contour models. International Journal of Computer Vision, 1(4):321-331, 1988.
121. Philip J. Kellman and Elizabeth S. Spelke. Perception of partly occluded objects in infancy. Cognitive Psychology, 15:483-524, 1983.
122. Josef Kittler and John Illingworth. Minimum error thresholding. Pattern Recognition, 19(1):41-47, 1986.
123. James J. Knierim and David C. Van Essen. Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. Journal of Neurophysiology, 67(4):961-980, 1992.
124. Christof Koch and Hua Li, editors. Vision Chips: Implementing Vision Algorithms With Analog Vlsi Circuits. IEEE Computer Society, 1995.
125. Kurt Koffka. Principles of Gestalt Psychology. A Harbinger Book. Harcourt Brace & World Inc., New York, 1935.
126. Teuvo Kohonen. Self-Organization and Associative Memory, volume 8 of Springer Series in Information Sciences. Springer, Berlin, 1984.
127. Anil C. Kokaram and Simon J. Godsill. Joint noise reduction, motion estimation, missing data reconstruction, and model parameter estimation for degraded motion pictures. In Proceedings of SPIE Conference on Bayesian Inference for Inverse Problems (SD'98) - San Diego, pages 212-223, 1998.
128. Anderse Krogh and John Hertz. A simple weight decay can improve generalization. In J. Moody, S. Hanson, and R. Lippmann, editors, Advances in Neural Information Processing Systems 4, pages 950-957, San Mateo, CA, 1992. Morgan Kaufmann.
129. Frank R. Kschischang, Brendan J. Frey, and Hans-Andrea Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2):498-519, 2001.
130. Victor A.F. Lamme. The neurophysiology of figure-ground segregation in primary visual cortex. Journal of Neuroscience, 15:1605-1615, 1995.
131. Steve Lawrence, C. Lee Giles, and Sandiway Fong. Natural language grammatical inference with recurrent neural networks. IEEE Transactions on Knowledge and Data Engineering, 12(1):126-140, 2000.
132. Yann LeCun. The MNIST database of handwritten digits. http://www.research.att.com/~yann/exdb/mnist, AT&T Labs, 1994.
133. Yann LeCun, Bernhard Boser, John S. Denker, Donnie Henderson, Robert E. Howard, Wayne E. Hubbard, and Lawrence D. Jackel. Handwritten digit recognition with a back-propagation network. In David Touretzky, editor, Advances in Neural Information Processing Systems 2. Morgan Kaufman, 1990.
134. Yann LeCun, Leon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
135. Yann LeCun, Leon Bottou, Genevieve B. Orr, and Klaus-Robert Müller. Efficient backprop. In G. B. Orr and K.-R. Müller, editors, Neural Networks: Tricks of the Trade, volume 1524 of LNCS, pages 9-50. Springer, 1998.
136. Choong Hwan Lee, Jun Sung Kim, and Kyu Ho Park. Automatic human face location in a complex background. Pattern Recognition, 29:1877-1889, 1996.
137. Daniel D. Lee and H. Sebastian Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401:788-791, 1999.
138. Daniel D. Lee and H. Sebastian Seung. Algorithms for non-negative matrix factorization. In T.K. Leen, T.G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 556-562. MIT Press, 2001.
139. Tai Sing Lee, David Mumford, Richard Romero, and Victor A.F. Lamme. The role of the primary visual cortex in higher level vision. Vision Research, 38:2429-2454, 1998.
140. Robert A. Legenstein and Wolfgang Maass. Foundations for a circuit complexity theory of sensory processing. In T.K. Leen, T.G. Dietterich, , and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 259-265. MIT Press, 2001.
141. Zhaoping Li. Computational design and nonlinear dynamics of a recurrent network model of the primary visual cortex. Neural Computation, 13(8):1749-1780, 2001.
142. Zhaoping Li. A saliency map in the primary visual cortex. Trends in Cognitive Sciences, 6(1):9-16, 2002.
143. Gustavo Linan, Servando Espejo, Rafael Dominguez-Castro, and Angel Rodriguez-Vazquez. ACE16k: An advanced focal-plane analog programmable array processor. In Proceedings of European Solid-State Circuits Conference (ESSCIRC'2001) - Freiburg, Germany, pages 216-219. Frontier Group, 2001.
144. Yoseph Linde, Andres Buzo, and Robert M. Gray. An algorithm for vector quantizer design. IEEE Transactions on Communication, 28(1):84-95, 1980.
145. Stuart P. Lloyd. Least squares quantization in PCM. Technical note, Bell laboratories, 1957. IEEE Transactions on Information Theory, 28:129-137, 1982.
146. Nikos K. Logothetis, Jon Pauls, and Tomaso Poggio. Shape representation in the inferior temporal cortex of monkeys. Current Biology, 5(5):552-563, 1995.
147. David R. Lovell. The Neocognitron as a system for handwritten character recognition: limitations and improvements. PhD thesis, University of Queensland, 1994.
148. Wolfgang Maass, Thomas Natschläger, and Henry Markram. Real-time computing without stable states: A new framework for neural computation based on perturbations. submitted for publication, 2001.
149. Dario Maio and Davide Maltoni. Real-time face localization on gray-scale static images. Pattern Recognition, 33:1525-1539, 2000.
150. Ravi Malladi and James A. Sethian. Image processing via level set curvature flow. Proceedings of the National Academy of Sciences, USA, 92(15):7046-7050, 1995.
151. Stephane G. Mallat. A theory for multiresolution signal decomposition: The wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2(7):674-693, 1989.
152. Stephane G. Mallat and Sifen Zhong. Characterization of signals from multiscale edges. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(7):710-732, 1992.
153. David Marr. Vision: A Computational investigation into the Human Representation and Processing of Visual Information. W.H. Freeman and Company, San Francisco, 1982.
154. Guy Mayraz and Geoffrey E. Hinton. Recognizing hand-written digits using hierarchical products of experts. In T. K. Leen, T. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 953-959. MIT Press, 2001.
155. Robert J. McEliece, David J.C. MacKay, and Jung-Fu Cheng. Turbo-decoding as an instance of Pearl's 'Belief Propagation' algorithm. IEEE Journal on Selected Areas in Communications, 16(2):140-152, 1998.
156. Ehud Meron. Pattern formation in excitable media. Physics Reports, 218(1):1-66, 1992.
157. Kieron Messer, Jiri Matas, Josef Kittler, Juergen Luettin, and Gilbert Maitre. XM2VTSDB: The extended M2VTS database. In Proceedings of Second International Conference on Audio and Video-based Biometric Person Authentication (AVBPA'99) - Washington, DC, pages 72-77, 1999.
158. Marvin L. Minsky and Seymour A. Papert. Perceptions: An Introduction to Computational Geometry. MIT Press, Cambridge, MA, 1969.
159. Tom M. Mitchell. Machine Learning. McGraw-Hill, New York, 1997.
160. Baback Moghaddam and Alex Pentland. Probabilistic visual learning for object representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):696-710, 1997.
161. Martin F. Møller. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks, 6(4):525-533, 1993.
162. Martin F. Møller. Supervised learning on large redundant training sets. International Journal Neural Systems, 4(1):15-25, 1993.
163. Franz C. Müller-Lyer. Optische Urteiltäuschungen. Archiv für Anatomie und Physilogie, Physilogische Abteilung, Supplementband 2:263-270, 1889.
164. Ken Nakayama, Shinsuki Shimojo, and Vilayanur S. Ramachandran. Transparency: Relation to depth, subjective contours, luminance, and neon color spreading. Perception, 19:497-513, 1990.
165. Thomas A. Nazir and J. Kevin O'Regan. Some results on translation invariance in the human visual system. Spatial Vision, 5(2):81-100, 1990.
166. Heiko Neumann and Wolfgang Sepp. Recurrent V1-V2 interaction in early visual boundary processing. Biological Cybernetics, 81(5/6):425-444, 1999.
167. Isaac Newton. Methodus fluxionum et serierum infinitarum. 1664-1671.
168. Harry Nyquist. Certain topics in telegraph transmission theory. AIEE Transactions, 47(3):617-644, 1928.
169. Erkki Oja. A simplified neuron model as principal component analyzer. Journal of Mathematical Biology, 15(3):267-273, 1982.
170. Bruno A. Olshausen and David J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609, 1996.
171. Alice J. O'Toole, Heinrich H. Bulthoff, Nikolaus F. Troje, and Thomas Vetter. Face recognition across large viewpoint changes. In Proceedings of International Workshop on Automatic Face- and Gesture-Recognition (IWAFGR'95) - Zürich, pages 326-331, 1995.
172. Günther Palm. On associative memory. Biological Cybernetics, 36(1):19-31, 1980.
173. Shahla Parveen and Phil Green. Speech recognition with missing data techniques using recurrent neural networks. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 1189-1195, Cambridge, MA, 2002. MIT Press.
174. Alvaro Pascual-Leone and Vincent Walsh. Fast backprojections from the motion to the primary visual area necessary for visual awareness. Science, 292(5516):510-512, 2001.
175. Frank Pasemann. Evolving neurocontrollers for balancing an inverted pendulum. Network: Computation in Neural Systems, 9:495-511, 1998.
176. Anitha Pasupathy and Charles E. Connor. Shape representation in area V4: Position-specific tuning for boundary conformation. Journal on Neurophysiology, 86:2505-2519, 2001.
177. Judea Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, Ca, 1988.
178. Pietro Perona and Jitendra Malik. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7):629-639, 1990.
179. Lutz Prechelt. Automatic early stopping using cross validation: Quantifying the criteria. Neural Networks, 11:761-767, 1998.
180. Ning Qian. On the momentum term in gradient descent learning algorithms. Neural Networks, 12:145-151, 1999.
181. J. Ross Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986.
182. J. Ross Quinlan. C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, Ca, 1993.
183. Rajeev D.S. Raizada and Stephen Grossberg. Context-sensitive bindings by the laminar circuits of V1 and V2: A unified model of perceptual grouping, attention, and orientation contrast. Visual Cognition, 8:341-466, 2001.
184. Ulrich Ramacher, Wolfgang Raab, Nico Brüls, Ulrich Hachmann, Christian Sauer, Alex Schackow, Jörg Gliese, Jens Harnisch, Mathias Richter, Elisabeth Sicheneder, Uwe Schulze, Hendrik Feldkämper, Christian Lütkemeyer, Horst Süsse, and Sven Altmann. A 53-GOPS programmable vision processor for processing, coding-decoding and synthesizing of images. In Proceedings of European Solid-State Circuits Conference (ESSCIRC 2001) - Villach, Austria, 2001.
185. Benjamin M. Ramsden, Chou P. Hung, and Anna Wang Roe. Real and illusory contour processing in area V1 of the primate: A cortical balancing act. Cerebral Cortex, 11(7):648-665, 2001.
186. Rajesh P. N. Rao. An optimal estimation approach to visual perception and learning. Vision Research, 39(11):1963-1989, 1999.
187. Rajesh P. N. Rao and Dana H. Ballard. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1):79-87, 1999.
188. Irving S. Reed and Gustave Solomon. Polynomial codes over certain finite fields. Journal of the Society for Industrial and Applied Mathematics (J. SIAM), 8(2):300-304, 1960.
189. Gerald M. Reicher. Perceptual recognition as a function of meaningfulness of stimulus material. Journal of Experimental Psychology, 81(2):275-280, 1969.
190. John H. Reynolds and Robert Desimone. The role of neural mechanisms of attention in solving the binding problem. Neuron, 24:19-29, 1999.
191. Martin Riedmiller and Heinrich Braun. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proceedings of International Conference on Neural Networks (ICNN'93) - San Francisco, pages 586-591. IEEE, 1993.
192. Maximilian Riesenhuber and Tomaso Poggio. Hierarchical models of object recognition in cortex. Nature Neuroscience, 2:1019-1025, 1999.
193. Raúl Rojas. Neural Networks - A Systematic Introduction. Springer, New York, 1996.
194. Frank Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6):386-408, 1958.
195. Azriel Rosenfeld, Robert A. Hummel, and Steven W. Zucker. Scene labeling by relaxation operations. IEEE Transactions on Systems, Man and Cybernetics, 6:420-433, 1976.
196. Azriel Rosenfeld and Gordon J. Vanderbrug. Coarse-fine template matching. IEEE Transactions on Systems, Man, and Cybernetics, 7(2):104-107, 1977.
197. Botond Roska and Frank S. Werblin. Vertical interactions across ten parallel, stacked representations in the mammalian retina. Nature, 410:583-587, 2001.
198. Henry A. Rowley, Shumeet Baluja, and Takeo Kanade. Neural network based face detection. IEEE Trans. Pattern Analysis and Machine Intelligence, 20:23-38, 1998.
199. Henry A. Rowley, Shumeet Baluja, and Takeo Kanade. Rotation invariant neural network based face detection. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'98) - Santa Barbara, CA, pages 38-44, 1998.
200. David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. Learning representations by back-propagating errors. Nature, 323:533-536, 1986.
201. David E. Rumelhart and David Zipser. Feature discovery by competitive learning. Cognitive Science, 9:75-112, 1985.
202. Ralf Salomon and J. Leo van Hemmen. Accelerating backpropagation through dynamic self-adaptation. Neural Networks, 9(4):589-601, 1996.
203. Terence D. Sanger. Optimal unsupervised learning in a single-layer linear feed-forward neural network. Neural Networks, 2(6):459-473, 1989.
204. Harish K. Sardana, M. Farhang Daemi, and Mohammad K. Ibrahim. Global description of edge patterns using moments. Pattern Recognition, 27(1):109-118, 1994.
205. Cullen Schaffer. Selecting a classification method by cross-validation. Machine Learning, 13(1):135-143, 1993.
206. Henry Schneiderman and Takeo Kanade. A statistical model for 3D object
207. Bernhard Schölkopf and Alex Smola. Learning with Kernels - Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge, MA, 2002.
208. David M. Senseman and Kay A. Robbins. High-speed VSD imaging of visually evoked cortical waves: Decomposition into intra- and intercortical wave motions. Journal of Neurophsyiology, 87(3):1499-1514, 2002.
209. H. Sebastian Seung. Learning continuous attractors in recurrent networks. In M.I. Jordan, M.J. Kearns, and S.A. Solla, editors, Advances in Neural Information Processing Systems 10, pages 654-660. MIT Press, 1998.
210. Markus Siegel, Konrad P. Körding, and Peter König. Integrating top-down and bottom-up sensory processing by somato-dendritic interactions. Journal of Computational Neuroscience, 8:161-173, 2000.
211. Hava T. Siegelmann and Eduardo D. Sonntag. On the computational power of neural nets. Journal of Computer and System Sciences, 50(1):132-150, 1995.
212. Fernando M. Silva and Luis B. Almeida. Acceleration techniques for the backpropagation algorithm. In Proceedings of Neural Networks EURASIP 1990 Workshop - Sesimbra, Portugal, volume 412, pages 110-119. Springer, 1990.
213. Eero P. Simoncelli and Edward H. Adelson. Noise removal via Bayesian wavelet coring. In Proceedings of IEEE International Conference on Image Processing (ICIP'96) - Lausanne, Switzerland, 1996.
214. Eero P. Simoncelli, William T. Freeman, Edward H. Adelson, and David J. Heeger. Shiftable multiscale transforms. IEEE Transactions on Information Theory, 38(2):587-607, 1992.
215. Eero P. Simoncelli and Bruno A. Olshausen. Natural image statistics and neural representation. Annual Review of Neuroscience, 24:1193-1216, 2001.
216. Wolfgang Singer and Charles M. Gray. Visual feature integration and the temporal correlation hypothesis. Annual Review of Neuroscience, 18:555-586, 1995.
217. Kate Smith, Marimuthu Paliniswami, and Mohan Krishnamoorthy. Neural techniques for combinatorial optimization with applications. IEEE Transactions on Neural Networks, 9(6):1301-1318, 1998.
218. Paul Smolensky. Information processing in dynamical systems: Foundations of harmony theory. In D.E. Rumelhart, J.L. McClelland, and PDP Research Group, editors, Parallel Distributed Processing: Exploration in the Microstructure of Cognition, volume I: Foundations, pages 194-281. MIT Press, 1986.
219. David C. Somers, Emanuel V. Todorov, Athanassios G. Siapas, Louis J. Toth, Dae-Shik Kim, and Mriganka Sur. A local circuit approach to understanding: Integration of long-range inputs in primary visual cortex. Cerebral Cortex, 8(3):204-217, 1998.
220. Martin Stemmler, Marius Usher, and Ernst Niebur. Lateral interactions in primary visual cortex: A model bridging physiology and psycho-physics. Science, 269:1877-1880, 1995.
221. Kah Kay Sung and Tomaso Poggio. Example-based learning for view-based human face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(1):39-51, 1998.
222. Hans Super, Henk Spekreijse, and Victor A. F. Lamme. Two distinct modes of sensory processing observed in monkey primary visual cortex (v1). IEEE Transactions on Pattern Analysis and Machine Intelligence, 4(3):304-310, 2001.
223. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
224. Raiten Taya, Walter H. Ehrenstein, and C. Richard Cavonius. Varying the strength of the Munker-White effect by stereoscopic viewing. Perception, 24:685-694, 1995.
225. Jean-Christophe Terrillon, Mahdad Shirazi, Hideo Fukamachi, and Shigeru Akamatsu. Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images. In Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000) - Grenoble, France, pages 54-61, 2000.
226. Simon J. Thorpe, Denis Fize, and Catherine Marlot. Speed of processing in the human visual system. Nature, 381:520-522, 1996.
227. Simon J. Thorpe and Jacques Gautrais. Rank order coding: A new coding scheme for rapid processing in neural networks. In J. Bower, editor, Computational Neuroscience : Trends in Research, pages 333-361, New York, 1998. Plenum Press.
228. Tom Tollenaere. SuperSAB: Fast adaptive backpropagation with good scaling properties. Neural Networks, 3(5):520-522, 1990.
229. Anne Treisman, Marilyn Sykes, and Gary Gelade. Selective attention stimulus integration. In S. Dornie, editor, Attention and Performance VI, pages 333-361, Hilldale, NJ, 1977. Lawrence Erlbaum.
230. Misha V. Tsodyks and Henry Markram. The neural code between neocortical pyramidal neurons depends on neuro transmitter release probability. Proceedings of the National Academy of Sciences, USA, 94:719-723, 1997.
231. Mark R. Turner. Texture discrimination by Gabor functions. Biological Cybernetics, 55:71-82, 1986.
232. Rufin VanRullen, Arnaud Delorme, and Simon J. Thorpe. Feed-forward contour integration in primary visual cortex based on asynchronous spike propagation. Neurocomputing, 38-40(1-4):1003-1009, 2001.
233. Vladimir N. Vapnik and Alexei Y. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications, 16:264-280, 1971.
234. Sethu Vijayakumar, Jörg Conradt, Tomohiro Shibata, and Stefan Schaal. Overt visual attention for a humanoid robot. In Proceedings of International Conference on Intelligence in Robotics and Autonomous Systems (IROS 2001), Hawaii, pages 2332-2337, 2001.
235. Felix von Hundelshausen, Sven Behnke, and Raúl Rojas. An omnidirectional vision system that finds and tracks color edges and blobs. In A. Birk, S. Coradeschi, and S. Tadokoro, editors, RoboCup 2001: RobotSoccer WorldCup V, volume 2377 of LNAI, pages 374-379. Springer, 2002.
236. Ernst Heinrich Weber. De pulsu, resorptione, audita et tactu. Annotationes anatomicae et physiologicae. Koehler, Leipzig, 1834.
237. Peter De Weerd, Robert Desimone, and Leslie G. Ungerleider. Perceptual filling-in: A parametric study. Vision Research, 38:2721-2734, 1998.
238. Sholom M. Weiss and Casimir A. Kulikowski. Computer Systems That Learn. Morgan Kaufmann, San Mateo, CA, 1990.
239. Jörg Wellner and Andreas Schierwagen. Cellular-automata-like simulations of dynamic neural fields. In M. Holcombe and R. Paton, editors, Information Processing in Cells and Tissues, pages 295-403, New York, 1998. Plenum Press.
240. Paul J. Werbos. Backpropagation through time: What it does and how to do it. Proceedings of the IEEE, 78(10):1550-1560, 1990.
241. Ronald J. Williams and David Zipser. A learning algorithm for continually running fully recurrent neural networks. Neural Computation, 1(2):270-280, 1989.
242. Charles L. Wilson. Evaluation of character recognition systems. In Neural Networks for Signal Processing III - New York, pages 485-496. IEEE, 1993.
243. Laurenz Wiskott. How does our visual system achieve shift and size invariance? In J.L. van Hemmen and T. Sejnowski, editors, Problems in Systems Neuroscience. Oxford University Press, to appear 2003.
244. Laurenz Wiskott and Terrence J. Sejnowski. Slow feature analysis: Unsupervised learning of invariances. Neural Computation, 14(4):715-770, 2002.
245. Rachel O. L. Wong. Retinal waves and visual system development. Annual Reviews on Neuroscience, 22:29-47, 1999.
246. Fan Yang, Michel Paindavoine, Herve Abdi, and Johel Miteran. A new image filtering technique combining a wavelet transform with a linear neural network: Application to face recognition. Optical Engineering, 38:2894-2899, 2000.
247. Jonathan S. Yedidia, William T. Freeman, and Yair Weiss. Generalized belief propagation. In T.K. Leen, T.G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 689-695. MIT Press, 2001.
248. Kin Choong Yow and Roberta Cipolla. Feature-based human face detection. Image and Vision Computing, 15(9):713-735, 1997.