Why the visual recognition system might encode the effects of illumination

Vision Research

Volumn 38, Issue 15-16, 1998, Pages 2259-2275

  Tarr, Michael J ^a   Kersten, Daniel ^b   Bülthoff, Heinrich H ^c  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

^c MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

3 D objects; Illumination; Visual recognition system

Indexed keywords

ARTICLE; HUMAN; ILLUMINATION; LIGHT; NORMAL HUMAN; PRIORITY JOURNAL; RECOGNITION; RESPONSE TIME; TASK PERFORMANCE; VISUAL MEMORY; VISUAL SYSTEM;

ADOLESCENT; ADULT; DEPTH PERCEPTION; DISCRIMINATION (PSYCHOLOGY); FORM PERCEPTION; HUMANS; LIGHTING; REACTION TIME; SENSITIVITY AND SPECIFICITY;

EID: 0031830392     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(98)00041-8     Document Type: Article

References (55)

1. Biederman I., Ju G. Surface versus edge-based determinants of visual recognition. Cogn Psychol. 20:1988;38-64.
2. Marr D., Nishihara H.K. Representation and recognition of the spatial organization of three-dimensional shapes. Proc R Soc London B. 200:1978;269-294.
3. Bülthoff H.H., Edelman S.Y., Tarr M.J. How are three-dimensional objects represented in the brain? Cereb Cortex. 5(3):1995;247-260.
4. Edelman S. Representation, similarity, and the chorus of prototypes. Minds Mach. 5(1):1995;45-68.
5. Gauthier I., Tarr M.J. Orientation priming of novel shapes in the context of viewpoint-dependent recognition. Perception. 26:1997;51-73.
6. Poggio T., Edelman S. A network that learns to recognize three-dimensional objects. Nature. 343:1990;263-266.
7. Cavanagh P. What's up in top-down processing? In: Gorea A, editor. Representations of Vision: Trends and Tacit Assumptions in Vision Research. Cambridge, UK: Cambridge University Press, 1991:295-304.
8. Moses Y, Adini Y, Ullman S. Face recognition: The problem of compensating for changes in the illumination direction. In: Eur, Stockholm Conf on Computer Vision. 1994:286-296.
9. Horn, BKP. Obtaining shape from shading information. In: Winston PH, editor. The Psychology of Computer Vision. New York: McGraw-Hill, 1975:115-155.
10. Langer M.S., Zucker S.W. Shape from shading on a cloudy day. J Opt Soc Am. A 11(2):1994;467-478.
11. Koenderink J.J., van Doom A.J., Kappers A.M.L. Surface perception in pictures. Percept Psychophys. 52(5):1992;487-496.
12. Kersten D., Knill D.C., Mamassian P., Bülthoff I. Illusory motion from shadows. Nature. 379:1996;31.
13. Bülthoff, H.H. Shape from X: psychophysics and computation. In: Landy MS, Movshon JA, editors. Computational Models of Visual Processing. Cambridge, MA: MIT Press, 1991.
14. Cavanagh P., Leclerc Y.G. Shape from shadows. J Exp Psychol Hum Percept Perform. 15(1):1989;3-27.
15. Bülthoff I., Kersten D., Bülthoff H.H. General lighting can overcome accidental viewing. Assoc Res Vis Ophthalmol. 35:1994;S1741.
16. Moore C, Cavanagh P. Recovery of 3d volume from 2-tone images of novel objects. Cognition 1998 (in press).
17. Bülthoff H.H., Edelman S. Psychophysical support for a two-dimensional view interpolation theory of object recognition. Proc Natl Acad Sci USA. 89:1992;60-64.
18. Humphrey G.K., Khan S.C. Recognizing novel views of three-dimensional objects. Can J Psychol. 46:1992;170-190.
19. Jolicoeur P. The time to name disoriented natural objects. Mem Cogn. 13:1985;289-303.
20. Tarr M.J. Rotating objects to recognize them: a case study of the role of viewpoint dependency in the recognition of three-dimensional objects. Psychon Bull Rev. 2(1):1995;55-82.
21. Tarr M.J., Bülthoff H.H. Is human object recognition better described by aeon-structural-descriptions or by multiple-views? J Exp Psychol Hum Percept Perform. 21(6):1995;1494-1505.
22. Edelman S. Class similarity and viewpoint invariance in the recognition of 3D objects. Biol Cybern. 72:1995;207-220.
23. Hummel J.E., Biederman I. Dynamic binding in a neural network for shape recognition. Psychol Rev. 99(3):1992;480-517.
24. Hummel JE, Stankiewicz BJ. An architecture for rapid, hierarchical structural description. In Inui T, McClelland J, editors. Attention and Performance vol. 15. Cambridge, MA: MIT Press, 1996:93-121.
25. Biederman I. Recognition-by-components: a theory of human image understanding. Psychol Rev. 94:1987;115-147.
26. Belhumeur P, Kriegman D. What is the set of images of an object under all possible lighting conditions? In: IEEE Conf. on Computer Vision and Pattern Recognition. San Francisco, CA, 1996:270-277.
27. Epstein R, Hallinan PW, Yuille, AL. 5±Eigenimages suffice: an empirical investigation of low-dimensional lighting models. In: IEEE Workshop on Physics-Based Modeling in Computer Vision. Boston, MA, 1995:108-11.
28. Hallinan, PW. A low-dimensional lighting representation of human faces for arbitrary lighting conditions. In: IEEE Conf. on Computer Vision and Pattern Recognition. Seattle, 1994:995-999.
29. Shashua A. Illumination and view position in 3D visual recognition. In: Moody JE, Hanson SJ, Lippmann RP, editors. Advances in Neural Information Processing Systems vol.4. San Mateo, CA: Morgan Kaufmann, 1992:404-411.
30. Shashua A. On photometric issues in 3D visual recognition from a single 2D image. Int J Comput Vis. 21:1996;99-122.
31. Biederman I., Gerhardstein P.C. Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. J Exp Psychol Hum Percept Perform. 19(6):1993;1162-1182.
32. Tarr M.J., Bülthoff H.H., Zabinski M., Blanz V. To what extent do unique parts influence recognition across changes in viewpoint? Psychol Sci. 8(4):1997;282-289.
33. Ellis R, Allport DA. Multiple levels of representation for visual objects: a behavioural study. In: Cohn AG, Thomas JR, editors. Artificial Intelligence and its Applications. New York: Wiley, 1986:245-247.
34. Biederman I., Cooper E.E. Size invariance in visual object priming. J Exp Psychol Hum Percept Perform. 18(1):1992;121-133.
35. Biederman I., Cooper E.E. Evidence for complete translational and reflectional invariance in visual object priming. Perception. 20:1991;585-593.
36. Braje W.L., Kersten D., Tarr M.J., Troje N.F. Illumination and shadows influence face recognition. Invest Ophthalmol Vis Sci. 37:1996;S176.
37. Goodale M.A., Jakobson L.S., Keillor M.M. Differences in the visual control of pantomimed and natural grasping movements. Neuropsychologia. 32(10):1994;1159-1178.
38. Brewster D. On the optical illusion of the conversion of cameos into intaglios and of intaglios into cameos, with an account of other analogous phenomena. Edinb J Sci. 4:1826;99-108.
39. Ramachandran V.S. Perceiving shape from shading. Sci Am. 256(6):1988;76-83.
40. Johnston A., Hill H., Carman N. Recognising faces: effects of lighting direction, inversion, and brightness reversal. Perception. 21:1992;365-375.
41. Edelman S., Bülthoff H.H. Orientation dependence in the recognition of familiar and novel views of three-dimensional objects. Vis Res. 32(12):1992;2385-2400.
42. Bülthoff HH, Edelman S. Evaluating object recognition theories by computer graphics psychophysics. In: Poggio TA, Glaser DA, editors. Exploring Brain Functions: Models in Neuroscience. New York, NY: Wiley, 1993:139-164.
43. Tarr M.J., Pinker S. Mental rotation and orientation-dependence in shape recognition. Cogn Psychol. 21(28):1989;233-282.
44. Snodgrass J.G., Corwin J. Pragmatics of measuring recognition memory: Applications to dementia and amnesia. J Exp Psychol Gen. 117:1988;34-50.
45. Adini Y, Moses Y, Ullman S. Face recognition: the problem of compensating for changes in illumination direction. Technical Report. The Weizmann Institute of Science, 1995.
46. Moses Y., Ullman S., Edelman S. Generalization to novel images in upright and inverted faces. Perception. 25:1996;443-462.
47. Warrington E.K. Neuropsychological studies of object recognition. Phil Trans R Soc London. B 298:1982;15-33.
48. Weiskrantz L. Visual prototypes, memory, and the inferotemporal lobe. In Mishkin EI, editor. Vision, Memory and the Temporal Lobe. New York: Elsvier, 1990:13-28.
49. Hietanen J.K., Perrett D.I., Oram M.W., Benson P.J., Dittrich W.H. The effects of lighting conditions on responses of cells selective for face views in the macaque temporal cortex. Exp Brain Res. 89:1992;151-171.
50. Yin R.K. Looking at upside-down faces. J Exp Psychol. 81(1):1969;141-145.
51. Kersten D., Mamassian P., Knill D.C. Moving cast shadows induce apparent motion in depth. Perception. 26(2):1997;171-192.
52. Kersten D., O'Toole A.J., Sereno M.E., Knill D.C., Anderson J.A. Associative learning of scene parameters from images. Appl Opt. 26:1987;4999-5006.
53. Pentland A.P. Linear shape from shading. Int J Comput Vis. 4:1990;153-162.
54. Hallinan, PW. A deformable model for face recognition under arbitrary lighting conditions. Unpublished PhD thesis, Division of Applied Sciences, Harvard University, 1995.
55. Murase H., Nayar S. Visual learning and recognition of 3-D objects from appearance. Int J Comput Vis. 14:1995;5-24.