Information maximization in face processing

Neurocomputing

Volumn 70, Issue 13-15, 2007, Pages 2204-2217

  Bartlett, Marian Stewart ^a  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

Author keywords

Face recognition; Independent component analysis; Information maximization; Learning; Machine learning; Unsupervised learning; Vision; Visual learning

Indexed keywords

COMPUTER VISION; EIGENVALUES AND EIGENFUNCTIONS; INDEPENDENT COMPONENT ANALYSIS; LEARNING ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; PIXELS; UNSUPERVISED LEARNING;

FACE PROCESSING; INFORMATION MAXIMIZATION; VISUAL LEARNING;

FACE RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER ANALYSIS; COMPUTER MODEL; CORRELATION ANALYSIS; FACE PROFILE; IMAGE QUALITY; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; INTERMETHOD COMPARISON; LEARNING; NORMAL DISTRIBUTION; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; VISION; VISUAL DISCRIMINATION; VISUAL SYSTEM FUNCTION;

EID: 34249663979     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.02.025     Document Type: Article

References (85)

1. Atick J.J. Could information theory provide an ecological theory of sensory processing?. Network 3 (1992) 213-251
2. Atick J.J., and Redlich A.N. What does the retina know about natural scenes?. Neural Comput. 4 (1992) 196-210
3. Attneave F. Some informational aspects of visual perception. Psychol. Rev. 61 (1954) 183-193
4. F.R. Bach, M.I. Jordan, Kernel independent component analysis, in: Proceedings of the Third International Conference on Independent Component Analysis and Signal Separation, 2001.
5. Barlow H. What is the computational goal of the neocortex?. In: Koch C. (Ed). Large Scale Neuronal Theories of the Brain (1994), MIT Press, Cambridge, MA 1-22
6. Barlow H., and Foldiak P. Adaptation and decorrelation in the cortex. In: Durbin C.M.R., and Mitchinson G. (Eds). The Computing Neuron (1990), Addison-Wesley, Reading, MA 54-72
7. Barlow H.B. Unsupervised learning. Neural Comput. 1 (1989) 295-311
8. Bartlett M.S., Movellan J.R., and Sejnowski T.J. Face modeling by information maximization. In: Zhao R.C.a.Y. (Ed). Face Processing: Advanced Modeling and Methods (2006), Elsevier, Amsterdam 219-253
9. Bartlett M.S., Movellan J.R., and Sejnowski T.J. Face recognition by independent component analysis. IEEE Trans. Neural Networks 13 6 (2002) 1450-1464
10. Bartlett M.S., and Sejnowski T.J. Learning viewpoint invariant face representations from visual experience in an attractor network. Network 9 3 (1998) 399-417
11. M.S. Bartlett, J.W. Tanaka, An attractor field model of face representations: effects of typicality and image morphing, in: Proceedings of the Psychonomics Society Satellite Symposium on Object Perception and Memory (OPAM), 1998.
12. Becker S. Implicit learning in 3D object recognition: the importance of temporal context. Neural Comput. 11 2 (1999) 347-374
13. Becker S., and Plumbley M. Unsupervised neural network learning procedures for feature extraction and classification. J. Appl. Intell. 6 (1996) 1-21
14. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 711-720
15. Bell A.J., and Sejnowski T.J. The independent components of natural scenes are edge filters. Vision Res. 37 23 (1997) 3327-3338
16. Bell A.J., and Sejnowski T.J. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7 6 (1995) 1129-1159
17. Bex P.J., Bedingham S., and Hammett S.T. Apparent speed and speed sensitivity during adaptation to motion. J. Opt. Soc. Am. A 16 12 (1999) 2817-2824
18. Carandini M., Movshon J.A., and Ferster D. Pattern adaptation and cross-orientation interactions in the primary visual cortex. Neuropharmacology 37 4-5 (1998) 501-511
19. Clifford C.W., and Wenderoth P. Adaptation to temporal modulation can enhance differential speed sensitivity. Vision Res. 39 26 (1999) 4324-4332
20. Cottrell G., et al. Is all face processing holistic? The view from UCSD. In: Townsend M.W.a.J. (Ed). Computational, Geometric, and Process Perspectives on Facial Cognition: Contexts and Challenges (2000), Erlbaum, London
21. Cottrell G., and Metcalfe J. Face, gender and emotion recognition using Holons. In: Touretzky D. (Ed). Advances in Neural Information Processing Systems (1991), Morgan Kaufmann, San Mateo, CA 564-571
22. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
23. Dan Y., Atick J.J., and Ried R.C. Efficient coding of natural scenes in the lateral geniculate nucleus: experimental test of a computational theory. J. Neurosci. 16 (1996) 3351-3362
24. Daugman J.G. Entropy reduction and decorrelation in visual coding by oriented neural receptive fields. IEEE Trans. Biomed. Eng. 36 1 (1989) 107-114
25. Dayan P., Sahani M., and Deback G. Adaptation and unsupervised learning. In: Becker S.T.S., and Obermayer K. (Eds). Advances in Neural Information Processing Systems (2002), MIT Press, Cambridge, MA
26. Draper B.A., et al. Recognizing faces with {PCA} and {ICA}. Computer vision and image understanding,. Face Recognition 91 (2003) 115-137 (special issue)
27. Field D.J. What is the goal of sensory coding?. Neural Comput. 6 (1994) 559-601
28. Foldiak P. Learning invariance from transformation sequences. Neural Comput. 3 (1991) 194-200
29. P. Hallinan, A deformable model for face Recognition under arbitrary lighting conditions, Ph.D. Thesis, Harvard University, 1995.
30. P. Hancock, Alternative representations for faces, in: Proceedings of the British Psychological Society, Cognitive Section, University of Essex, September 6-8, 2000.
31. Hancock P.J.B., Burton A.M., and Bruce V. Face processing: human perception and principal components analysis. Memory Cognition 24 (1996) 26-40
32. Haxby J., Hoffman E., and Gobbini M. Trends Cognitive Sci. 4 (2000) 223-233
33. J. Huang, D. Mumford, Statistics of natural images and models, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1999, pp. 541-547.
34. Hyvarinen A., and Hoyer P.O. A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Res. 41 18 (2001) 2413-2423
35. Kanter I., and Sompolinsky H. Associative recall of memory without errors. Phys. Rev. A 35 (1987) 380-392
36. Kaping D., Duhamel P., and Webster M. Adaptation to natural face categories. J. Vision 2 10 (2002) 128
37. J. Kim, J. Choi, J. Yi, Face recognition based on ICA combined with FLD, in: Proceedings of the European Conference on Computer Vision, 2002, pp. 10-18.
38. Laughlin S. A simple coding procedure enhances a neuron's information capacity. Z. Nat. 36 (1981) 910-912
39. T.-W. Lee, B.U. Koehler, R. Orglmeister, Blind source separation of nonlinear mixing models, in: Proceedings of the IEEE International Workshop on Neural Networks for Signal Processing, Florida, 1997, pp. 406-415.
40. Leopold D., et al. Prorotype-referenced shape encoding revealed by high-level aftereffects. Nat. Neurosci. 4 (2001) 89-94
41. Lewicki M. Efficient coding of natural sounds. Nat. Neurosci. 5 (2002) 356-363
42. Lewicki M., and Olshausen B. Probabilistic framework for the adaptation and comparison of image codes. J. Opt. Soc. Am. A 16 7 (1999) 1587-1601
43. Lewicki M., and Sejnowski T.J. Learning overcomplete representations. Neural Comput. 12 2 (2000) 337-365
44. Linsker R. Self-organization in a perceptual network. Computer 21 3 (1988) 105-117
45. Q. Liu, et al., Modeling face appearance with nonlinear independent component analysis, in: Proceeding of the Sixth International Conference on Automatic Face and Gesture Recognition, 2004.
46. Loomis J.M., and Berger T. Effects of chromatic adaptation on color discrimination and color appearance. Vision Res. 19 8 (1979) 891-901
47. MacLeod D.I.A. Colour discrimination, colour constancy and natural scene statistics. In: Mollon J.D., Pokorny J., and Knoblauch K. (Eds). Normal and Defective Colour Vision (2003), Oxford University Press, New York (The Verriest lecture)
48. McKeown M.J., et al. Analysis of f{MRI} by decomposition into independent spatial components. Hum. Brain Mapp. 6 3 (1998) 160-188
49. Miyahara E., Smith V.C., and Pokorny J. How surrounds affect chromaticity discrimination. J. Opt. Soc. Am. A 10 4 (1993) 545-553
50. Miyashita Y. Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335 27 (1988) 817-820
51. Nadal J.-P., and Parga N. Non-linear neurons in the low-noise limit: a factorial code maximises information transfer. Network 4 (1994) 295-312
52. Ng M., et al. Selective tuning of face perception. J. Vision 3 9 (2003) 106a (Abstract)
53. O'Toole A., et al. Structural aspects of face recognition and the other race effect. Memory Cognition 22 2 (1994) 208-224
54. Oja E. Neural networks, principal components, and subspaces. Int. J. Neural Syst. 1 (1989) 61-68
55. Olshausen B.A., and Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381 (1996) 607-609
56. Olshausen B.A., and Field D.J. Natural image statistics and efficient coding. Network: Comput. Neural Syst. 7 2 (1996) 333-340
57. O'Reilly R., and Johnson M. Object recognition and sensitive periods: a computational analysis of visual imprinting. Neural Comput. 6 (1994) 357-389
58. Papoulis A. Probability, Random Variables, and Stochastic Processes (1991), McGraw-Hill, New York
59. Párraga C.A., Troscianko T., and Tollhurst D.J. The human visual system is optimised for processing the spatial information in natural visual images. Curr. Biol. 10 1 (2000) 35-38
60. Phillips J. Support vector machines applied to face recognition. In: Sola T.L.S., and Muller K. (Eds). Advances in Neural Information Processing Systems (1999), MIT Press, Cambridge, MA 803-809
61. Rissanen J. Modeling by shortest data description. Automatica 14 (1978) 465-471
62. Rolls E.T., Aggelopoulos N.C., Franco L., and Treves A. Information encoding in the inferior temporal cortex: contributions of the firing rates and correlations between the firing of neurons. Biol. Cybern. 90 (2004) 19-32
63. Rolls E.T., and Tovee M.J. Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J. Neurophysiol. 73 2 (1995) 713-726
64. Schrater P.R., and Simoncelli E.P. Local velocity representation: evidence from motion adaptation. Vision Res. 38 24 (1998) 3899-3912
65. Shannon C.E. A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948) 379-423 623-656
66. Simoncelli E.P., and Olshausen B.A. Natural image statistics and neural representation. Annu. Rev. Neurosci. 24 (2001) 1193-1216
67. Stocker A.A., and Simoncelli E.P. Sensory adaptation within a Bayesian framework. In: Weiss Y., Scholkopf B., and Platt B. (Eds). Advances in Neural Information Processing Systems vol. 18 (2006), MIT Press, Cambridge, MA 1291-1298
68. Stone J.V. Learning perceptually salient visual parameters using spatiotemporal smoothness constraints. Neural Comput. 8 7 (1996) 1463-1492
69. J.W. Tanaka, O. Corneille, Atypicality bias in face and object perception. Further tests of an attractor model, Perception & Psychophysics, in press.
70. Tanaka J.W., et al. Mapping attractor fields in face space: the atypicality bias in face recognition. Cognition 68 3 (1998) 199-220
71. Turk M., and Pentland A. Eigenfaces for recognition. J. Cognitive Neurosci. 3 1 (1991) 71-86
72. van Hateren J.H. Spatiotemporal contrast sensitivity of early vision. Vision Res. 33 (1993) 257-267
73. van Hateren J.H., and Ruderman D.L. Independent component analysis of natural image sequences yields spatiotemporal filters similar to simple cells in primary visual cortex. Proc. R. Soc. London Ser. B 265 1412 (1998) 2315
74. Vinje W.E., and Gallant J.L. Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287 5456 (2000) 1273-1276
75. von der Twer T., and MacLeod D.I. Optimal nonlinear codes for the perception of natural colours. Network 12 3 (2001) 395-407
76. Wachtler T., Lee T.-W., and Sejnowski T.J. The chromatic structure of natural scenes. J. Opt. Soc. Am. A 18 1 (2001) 65-77
77. Wainwright M.J., Schwartz O., and Simoncelli E.P. Natural image statistics and divisive normalization: modeling nonlinearities and adaptation in cortical neurons. In: Rao B.O.R., and Lewicki M. (Eds). Statistical Theories of the Brain (2002)
78. Walker T.M., and Tanaka J.W. An encoding advantage for own-race versus other-race faces. Perception 23 9 (2003) 1117-1125
79. Wallis G., and Rolls E.T. Invariant face and object recognition in the visual system. Prog. Neurobiol. (Oxford) 51 2 (1997) 167-194
80. Webster M., Werner J., and Field D. Adaptation and the phenomenology of perception. In: Rhodes C.C.G. (Ed). Fitting the Mind to the World: Adaptation and Aftereffects in High Level Vision (2005), Oxford University Press, Oxford
81. Webster M.A. Human color vision and its adaptation. Network: Comput. Neural Syst. 7 (1996) 587-634
82. Webster M.A., and Maclin O.H. Figural aftereffects in the perception of faces. Psychon. Bull. Rev. 6 4 (1999) 647-653
83. Whittle P. Brightness, discriminability, and the 'Crispening Effect'. Vision Res. 32 (1992) 1493-1507
84. Yang H.H., Amari S.-I., and Cichocki A. Information-theoretic approach to blind separation of sources in non-linear mixture. Signal Process. 64 3 (1998) 291-3000
85. Yang M. Face recognition using kernel methods. In: Ghahramani T.D.a.B.S.a.Z. (Ed). Advances in Neural Information Processing Systems (2002)