Identifying faces across variations in lighting: Psychophysics and computation

ACM Transactions on Applied Perception

Volumn 5, Issue 2, 2008, Pages

  Tarr, Michael J ^a   Georghiades, Athinodoros S ^b   Jackson, Cullen D ^c  

^a BROWN UNIVERSITY   (United States)

^b Yale University   (United States)

^c APTIMA INC   (United States)

Author keywords

Face recognition; Human psychophysics; Illumination invariance; Image based models; Object recognition

Indexed keywords

FACE RECOGNITION; HUMAN PSYCHOPHYSICS; ILLUMINATION INVARIANCE; IMAGE-BASED MODELS; OBJECT RECOGNITION; RECOGNITION ABILITIES; RECOGNITION PERFORMANCE; TRAINING SETS; VARYING LIGHTING;

EXPERIMENTS; IMAGE ENHANCEMENT;

LIGHTING;

EID: 50249119710     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1279920.1279924     Document Type: Article

References (46)

1. ATICK, J. J., GRIFFIN, P. A., AND REDLICH, A. N. 1996. Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation 8, 6, 1321-1340.
2. BELHUMEUR, P. N. AND KRIEGMAN, D. J. 1998. What is the set of images of an object under all possible illumination conditions? Int. J. Comput. Vision 28, 3, 245-260.
3. BELHUMEUR, P. N., HESPANHA, J. P., AND KRIEGMAN, D. J. 1997. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7, 711-720.
4. BIEDERMAN, I. 1987. Recognition-by-components: A theory of human image understanding. Psychological Review 94, 2, 115-147.
5. BIEDERMAN, I. AND GERHARDSTEIN, P. C. 1993. Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. Journal of Experimental Psychology: Human Perception and Performance 19, 6, 1162-1182.
6. BINFORD, T. O. 1971. Visual perception by computer. In IEEE Conference on Systems and Control. Miami, FL.
7. BRAJE, W. L. 2003. Illumination encoding in face recognition: Effect of position shift. Journal of Vision 3, 2, 161-170.
8. BRAJE,W. L., KERSTEN, D., TARR, M. J., AND TROJE, N. F. 1998. Illumination effects in face recognition. Psychobiology 26, 4 (Aug.), 371-380.
9. BRAJE, W. L., LEGGE, G. E., AND KERSTEN, D. 2000. Invariant recognition of natural objects in the presence of shadows. Perception 29, 4, 383-398.
10. FUKUSHIMA, K. 2000. Active and adaptive vision: Neural network models. In Biologically Motivated Computer Vision, S.-W. Lee, H. H. Bülthoff, and T. Poggio, Eds. Vol. 1811. Springer-Verlag, New York. 623-634.
11. GEORGHIADES, A. S., KRIEGMAN, D. J., AND BELHUMEUR, P. N. 1998. Illumination cones for recognition under variable lighting: Faces. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. 52-59.
12. GEORGHIADES, A. S., BELHUMEUR, P. N., AND KRIEGMAN, D. J. 2001. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23, 6 (June), 643-660.
13. GROSS, R., BAKER, S., MATTHEWS, I., AND KANADE, T. 2004. Face recognition across pose and illumination. In Handbook of Face Recognition, S. Z. Li and A. K. Jain, Eds. Springer-Verlag, New York.
14. HALLINAN, P. W. 1994. A low-dimensional representation of human faces for arbitrary lighting conditions. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. 995-999.
15. HALLINAN, P. W., GORDON, G., YUILLE, A. L., GIBLIN, P., AND MUMFORD, D. 1999. Two- and Three-Dimensional Patterns of the Face. A.K. Peters, Natick, MA.
16. HAYWARD, W. G. AND TARR, M. J. 1997. Testing conditions for viewpoint invariance in object recognition. Journal of Experimental Psychology: Human Perception and Performance 23, 5 (Oct.), 1511-1521.
17. HORN, B. K. P. 1975. Obtaining Shape from Shading Information. McGraw-Hill, New York.
18. JOHNSTON, A., HILL, H., AND CARMAN, N. 1992. Recognizing faces: Effects of lighting direction, inversion, and brightness reversal. Perception 21, 3, 365-375.
19. KARDOS, L. 1934. Ding und Schatten. Zeitschrift für Psychologie 23.
20. KERSTEN, D., KNILL, D. C., MAMASSIAN, P., AND BÜLTHOFF, I. 1996. Illusory motion from shadows. Nature (London) 379, 31.
21. KERSTEN, D., MAMASSIAN, P., AND KNILL, D. C. 1997. Moving cast shadows induce apparent motion in depth. Perception 26, 2, 171-192.
22. KERSTEN, D., MAMASSIAN, P., AND YUILLE, A. 2004. Object perception as Bayesian inference. Annual Review of Psychology 55, 271-304.
23. LADES, M., VORBRÜGGEN, J. C., BUHMANN, J., LANGE, J.,VON DER MALSBURG, C., WÜRTZ, R. P., AND KONEN, W. 1993. Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions on Computers 42, 300-311.
24. LOGOTHETIS, N. K. AND PAULS, J. 1995. Psychophysical and physiological evidence for viewer-centered object representation in the primate. Cerebral Cortex 5, 3, 270-288.
25. LOWE, D. G. 2000. Towards a computational model for object recognition in IT cortex. In Biologically Motivated Computer Vision, S.-W. Lee, H. H. Bülthoff, and T. Poggio, Eds. Vol. 1811. Springer-Verlag, New York, 20-31.
26. MARR, D. 1982. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. Freeman, San Francisco, CA.
27. MARR, D. AND NISHIHARA, H. K. 1978. Representation and recognition of the spatial organization of three-dimensional shapes. In Proc. R. Soc. of Lond. B, 200. 269-294.
28. MOORE, C. AND CAVANAGH, P. 1998. Recovery of 3D volume from 2-tone images of novel objects. Cognition 67, 1-2 (July), 45-71.
29. MOSES, Y., ADINI, Y., AND ULLMAN, S. 1994. Face recognition: The problem of compensating for changes in illumination direction. In Computer Vision - ECCV '94, J.-O. Eklundh, Ed. Lecture Notes in Computer Science, vol. 800. Springer-Verlag, New York, 286-296.
30. MOSES, Y., ULLMAN, S., AND EDELMAN, S. 1996. Generalization to novel images in upright and inverted faces. Perception 25, 443-462.
31. RAMACHANDRAN, V. S. 1988. Perception of shape from shading. Nature (London) 331, 14, 163-166.
32. RIESENHUBER, M. AND POGGIO, T. 2000. CBF: A new framework for object categorization in cortex. In Biologically Motivated Computer Vision, S.-W. Lee, H. H. Bülthoff, and T. Poggio, Eds. Vol. 1811. Springer-Verlag, New York. 1-9.
33. SANOCKI, T., BOWYER, K. W., HEATH, M. D., AND SARKAR, S. 1998. Are edges sufficient for object recognition? Journal of Experimental Psychology: Human Perception and Performance 24, 1, 340-349.
34. TARR, M. J. 1995. Rotating objects to recognize them: A case study of the role of viewpoint dependency in the recognition of three-dimensional objects. Psychonomic Bulletin and Review 2, 1, 55-82.
35. TARR, M. J. AND GAUTHIER, I. 1998. Do viewpoint-dependent mechanisms generalize across members of a class? Cognition 67, 1-2 (July), 71-108.
36. TARR, M. J., KERSTEN, D., AND BÜLTHOFF, H. H. 1998a. Why the visual system might encode the effects of illumination. Vision Research 38, 15-16 (Aug.), 2259-2275.
37. TARR, M. J., WILLIAMS, P., HAYWARD, W. G., AND GAUTHIER, I. 1998b. Three-dimensional object recognition is viewpoint-dependent. Nature Neuroscience 1, 4 (Aug.), 275-277.
38. TURK, M. AND PENTLAND, A. 1991a. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 1, 71-86.
39. TURK, M. AND PENTLAND, A. 1991b. Face recognition using eigenfaces. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. 586-591.
40. ULLMAN, S. AND SALI, E. 2000. Object classification using a fragment-based representation. In Biologically Motivated Computer Vision, S.-W. Lee, H. H. Bülthoff, and T. Poggio, Eds. Vol. 1811. Springer-Verlag, New York. 73-87.
41. ULLMAN, S., VIDAL-NAQUET, M., AND SALI, E. 2002. Visual features of intermediate complexity and their use in classification. Nature Neuroscience 5, 682-687.
42. VUONG, Q. C., PEISSIG, J. J., HARRISON, M. C., AND TARR, M. J. 2005. The role of surface pigmentation for recognition revealed by contrast reversal in faces and greebles. Vision Research 45, 10, 1213-1223.
43. WILLIAMS, P. AND TARR, M. J. 2001. RSVP: Experimental control software for MacOS [online].
44. ZHANG, L. AND SAMARAS,D. 2006. Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics. IEEE Trans. Pattern Anal. Mach. Intell. 28, 3 (Mar.), 351-363.
45. ZHOU, S. K. AND CHELLAPPA, R. 2005. Image-based face recognition under illumination and pose variations. Journal of the Optical Society of America A 22, 217-229.
46. ZHOU, S. K., AGGARWAL, G., CHELLAPPA, R., AND JACOBS, D. W. 2007. Appearance characterization of linear lambertian objects, generalized photometric stereo, and illumination-invariant face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2 (Feb.), 230-245.