Specular reflections and the perception of shape

Journal of Vision

Volumn 4, Issue 9, 2004, Pages 798-820

  Fleming, Roland W ^a,b   Torralba, Antonio ^c   Adelson, Edward H ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

3D shape perception; Gloss; Material perception; Modeling; Natural image statistics; Shape from shading; Shape from texture; Specularity

Indexed keywords

ACCURACY; ARTICLE; ASSOCIATION; CALCULATION; CONTROLLED STUDY; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; LIGHT RELATED PHENOMENA; PHYSICAL PARAMETERS; RELIABILITY; SPECULAR REFLECTION; SURFACE PROPERTY; THREE DIMENSIONAL IMAGING; VISUAL STIMULATION; VISUAL SYSTEM FUNCTION; LIGHT; PATTERN RECOGNITION; PHYSIOLOGY;

CUES; FORM PERCEPTION; HUMANS; IMAGING, THREE-DIMENSIONAL; LIGHT;

EID: 16544368340     PISSN: 15347362     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/4.9.10     Document Type: Article

References (78)

1. Adelson, E. H. (1999). Lightness perception and lightness illusions. In M. S. Gazzaniga (Ed.), The new cognitive neurosciences (2nd ed.) (pp. 339-351). Cambridge, MA: MIT Press.
2. Anderson B. L. (1997). A theory of illusory lightness and transparency in monocular and binocular images: The role of contour junctions. Perception, 26(4), 419-453.
3. Beck, J., & Prazdny, S. (1981). Highlights and the perception of glossiness. Perception and Psychophysics, 30(4), 407-410.
4. Ben-Shahar, O., & Zucker, S. (2001). On the perceptual organization of texture and shading flows: From a geometrical model to coherence computation. In Proceedings of CVPR, (pp. 1048-1055), Kawaii, HI.
5. Blake, A., & Brelstaff, G. (1988). Geometry from specularities. In Proceedings of ICCV (pp. 394-403), Tampa, FL.
6. Blake, A., & Bülthoff, H. H. (1990). Does the brain know the physics of specular reflection? Nature, 343, 165-168.
7. Blake, A., & Bülthoff, H. H. (1991). Shape from specularities: Computation and psychophysics. Philosophical Transactions of the Royal Society Series B, 331, 237-252.
8. Blake, A., & Marinos, C. (1990). Shape from texture: Estimation, isotropy and moments. Artificial Intelligence, 45, 323-380.
9. Breton, P., & Zucker, S. W. (1996). Shadows and shading flow fields. In Proceedings of CVPR (pp. 782-789), San Francisco, CA.
10. Buckley, D., & Frisby, J. P. (1993). Interaction of stereo, texture, and outline cues in the shape perception of three-dimensional ridges. Vision Research, 33, 919-934.
11. Clerc, M., & Mallot, S. (2002). The texture gradient equation for recovering shape from texture. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 536-549.
12. Cumming, B. G., Johnston, E. B., & Parker, A. J. (1993). Effects of different texture cues on curved surfaces viewed stereoscopically. Vision Research, 33, 827-838.
13. Cutting, J. E., & Millard, R. T. (1984). Three gradients and the perception of flat and curved surfaces. Journal of Experimental Psychology, 113(2), 198-216.
14. Debevec, P. E. (1998). Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. Proceedings of SIGGRAPH 1998, 189-198.
15. Debevec, P. E., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., & Sagar, M. (2000). Acquiring the reflectance field of a human face. Proceedings of SIGGRAPH 2000, 145-156.
16. De Valois, R. L., Yund, E. W., & Hepler, N. (1982). The orientation and direction selectivity of cells in macaque visual cortex. Vision Research, 22, 531-544.
17. Dror, R. O. (2002). Surface reflectance recognition and real world illumination statistics (AI Lab Technical Report No. AITR-2002-009). Cambridge, MA: MIT Artificial Intelligence Laboratory.
18. Dror, R. O., Leung, T., Willsky, A. S., & Adelson, E. H. (2001). Statistics of real-world illumination. In Proceedings of CVPR, 2, 164-171.
19. Field, D. J. (1987). Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America A, 4(12), 2379-2394.
20. Fleming, R. W., Dror, R. O., & Adelson, E. H. (2003). Real-world illumination and the perception of surface reflectance properties. Journal of Vision, 3(5), 347-368, http://journalofvision.org/3/5/3/, doi:10.1167/3.5.3.
21. Gibson, J. J. (1950a). The perception of the visual world. Boston: Haughton Mifflin.
22. Gibson, J. J. (1950b). The perception of visual surfaces. American Journal of Psychology, 63, 367-384.
23. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
24. Hartung, B., & Kersten, D. (2002). Distinguishing shiny from matte [Abstract]. Journal of Vision, 2(7), 551a, http://journalofvision.org/2/7/551/, doi:10.1167/2.7.551.
25. Hartung, B., & Kersten, D. (2003). How does the perception of shape interact with the perception of shiny material? [Abstract] Journal of Vision, 3(9), 59a, http://journalofvision.org/3/9/59/, doi:10.1167/3.9.59.
26. Heider, G. M. (1933). New studies in transparency, form and color. Psychologische Forschung, 17, 13-56.
27. Hill, H., & Bruce V. (1993). Independent effects of lighting, orientation, and stereopis on the hollow-face illusion. Perception, 22, 887-897.
28. Hill, H., & Bruce, V. (1994). A comparison between the hollow-face and 'hollow-potato' illusions. Perception, 23, 1335-1337.
29. Helmholtz, H. (1962). Helmholtz's treatise on physiological optics. New York: Dover. (Original work published in 1867)
30. Howard, I. (1983). Occluding edges in apparent reversal of convexity and concavity. Perception, 12, 85-86.
31. Hubel, D. H., & Wiesel, T. N. (1959). Receptive fields of single neurones in the cat's striate cortex. Journal of Physiology London, 148, 574-591.
32. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology London, 160, 106-154.
33. Hubel, D. H., & Wiesel, T. N. (1968). Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology London, 195, 215-243.
34. Huggins, P. S., Chen, H. F., Belhumeur, P. N., & Zucker, S. W. (2001). Finding folds: On the appearance and identification of occlusion, in CVPR'01. Proceedings IEEE Conference on Computer Vision and Pattern Recognition, 2, 718-725.
35. Kardos, L. (1934). Ding und Schatten: Eine experimentelle Untersuchung. In Zeitschrift für psychologie. Leipiz: Barth.
36. Klinker, G. J., Shafer, S. A., & Kanade, T. (1998). The measurement of highlights in color images. International Journal of Computer Vision, 2, 7-32.
37. Koenderink, J. J. (1984). What does the occluding contour tell us about solid shape? Perception, 13, 321-330.
38. Koenderink, J. J., & van Doorn, A. J. (1980). Photometric invariants related to solid shape. Optica Acta, 27(7), 981-996.
39. Koenderink, J. J., & van Doorn, A. J. (2003). Shape and shading. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences (pp. 1090-1105). Cambridge: MIT Press.
40. Koenderink, J. J., van Doorn, A. J., & Kappers, A. M. L. (1992). Surface perception in pictures. Perception and Psychophysics. 52, 487-496.
41. Koffka, K. (1935). Principles of Gestalt psychology. Cleveland: Harcourt, Brace and World.
42. Langer M. S., & Bülthoff, H. H. (2001). A prior for global convexity in local shape from shading. Perception, 30(4), 403-410.
43. Li, A., & Zaidi, Q. (2000). Perception of three-dimensional shape from texture is based on patterns of oriented energy. Vision Research, 40(2), 217-242.
44. Li, A., & Zaidi, Q. (2003). Observer strategies in perception of 3-D shape from isotropic textures: Developable surfaces. Vision Research, 43, 2741-2758.
45. Malik, J., & Rosenholtz, R. (1997). Computing local surface orientation and shape from texture for curved surfaces. International Journal of Computer Vision, 23, 149-168.
46. Mamassian P., & Landy, M. S. (1998). Observer biases in the 3D interpretation of line drawings. Vision Research, 38, 2817-2832.
47. Mamassian, P., & Kersten, D. (1993). Surface orientation and illumination direction from shading. Investigative Ophthalmology & Visual Science, 34, 1082.
48. Mamassian, P., & Kersten, D. (1996). Illumination, shading and the perception of local orientation. Vision Research, 36, 2351-2367.
49. Metelli, F. (1974). The perception of transparency. Scientific American, 230(4), 90-98.
50. Mingolla, E., & Todd, J. T. (1986). Perception of solid shape from shading. Biological Cybernetics, 53, 137-151.
51. Norman, J. F., Todd, J. T., & Orban, G. A. (2004). Perception of three-dimensional shape from specular highlights, deformations of shading, and other types of visual information. Psychological Science, 15(8), 565-570.
52. Oren, M., & Nayer, S. K. (1996). A theory of specular surface Geometry. International Journal of Computer Vision, 24, 105-124.
53. Poggio, T., Torre, V., & Koch, C. (1985). Computational vision and regularization theory. Nature, 317, 314-319.
54. Ramachandran, V. S. (1988). Perception of shape from shading. Nature, 331(14), 163-166.
55. Ramachandran, V. S. (1990). Perceiving shape from shading. In I. Rock (Ed.), The perceptual world (pp. 127-138). New York: W. H. Freeman.
56. Rosenholtz, R., & Malik, J. (1997). Surface orientation from texture: isotropy or homogeneity (or both)? Vision Research, 37, 2283-2293.
57. Savarese, S., Li, F. F., & Perona, P. (2003). Can we see the shape of a mirror? [Abstract] Journal of Vision, 3(9), 74a, http://journalofvision.org/3/9/74/, doi:10.1167/3.9.74.
58. Savarese, S., Li, F. F., & Perona, P. (in press). What do reflections tell us about the shape of a mirror? Proceedings of First Symposium on Applied Perception in Graphics and Visualization. New York, NY: ACM Press.
59. Savarese, S., & Perona, P. (2001). Local analysis for 3d reconstruction of specular surfaces. Proceedings of CVPR, 2, 738-745.
60. Savarese, S., & Perona, P. (2002). Local analysis for 3d reconstruction of specular surface. Part II. In A. Heyden, G. Sparr, M. Nielsen, & P. Johansen (Eds.), Computer Vision - ECCV 2002, 7th European Conference on Computer Vision (pp. 759-774). Berlin: Springer-Verlag.
61. Schiller, P. H., Finlay, B. L., & Volman, S. F. (1976). Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. Journal of Neurophysiology, 39, 1320-1333.
62. Simoncelli, E. P., & Freeman, W. T. (1995). The steerable pyramid: A flexible architecture for multi-scale derivative computation. IEEE Second Int'l Conference on Image Processing, 3, 444-447.
63. Simoncelli, E. P., Freeman, W. T., W. T., Adelson, E. H., & Heeger, D. J. (1992). Shiftable multi-scale transforms [or, "What's Wrong with Orthonormal Wavelets"]. IEEE Transactions on Information Theory, Special Issue on Wavelets, 38(2), 587-607.
64. Singh, M., & Anderson, B. L. (2002). Toward a perceptual theory of transparency. Psychological Review, 109(3), 492-519.
65. Stevens, K. A. (1981). The information content of texture gradients. Biological Cybernetics, 42, 95-105.
66. Stevens, K. A. (1983). Slant-tilt: The visual encoding of surface orientation. Biological Cybernetics, 46, 183-195.
67. Super, B., & Bovic, A. (1995). Shape from texture using local spectral moments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17, 333-343.
68. Symons, L. A., Cuddy, F., & Humphrey, K. (2000). Orientation tuning of shape from shading. Perception and Psychophysics, 62, 557-568.
69. Todd, J. T., & Akerstrom, R. A. (1987). The perception of three dimensional form from patterns of optical texture. Journal of Experimental Psychology: Human Perception and Performance, 13(2), 242-255.
70. Todd, J. T., & Mingolla, E. (1983). Perception of surface curvature and direction of illuminant from patterns of shading. Journal of Experimental Psychology: Human Perception and Performance, 9, 583-595.
71. Todd, J. T., Norman, J. F., Koenderink, J. J., & Kappers, A. M. L. (1997). Effects of texture, illumination, and surface reflectance on stereoscopic shape perception. Perception, 26, 807-822.
72. Todd, J. T., Oomes A. H., Koenderink, J. J., & Kappers, A. M. L. (2004). The perception of doubly curved surfaces from anisotropic textures. Psychological Science, 15(1), 40-46.
73. Ullman, S. (1976). On visual detection of light sources. Biological Cybernetics, 21, 205-211.
74. Ward, G. J. (1994). The RADIANCE lighting simulation and rendering system. Proceedings of SIGGRAPH 1994. 459-472.
75. Witkin, A. P. (1981). Recovering surface shape and orientation from texture. Artificial Intelligence, 17, 17-45.
76. Woodworth, R. S., & Schlosberg, H. (1954). Experimental psychology. New York: Holt, Rinehart, and Winston.
77. Yang, J. N., & Maloney, L. T. (2001). Illuminant cues in surface color perception: Tests of three candidate cues. Vision Research, 41, 2581-2600.
78. Zaidi, Q., & Li, A. (2002). Limitations on shape information provided by texture cues. Vision Research, 42(7), 815-835.