Image statistics for surface reflectance perception

Journal of the Optical Society of America A: Optics and Image Science, and Vision

Volumn 25, Issue 4, 2008, Pages 846-865

  Sharan, Lavanya ^a   Li, Yuanzhen ^b   Motoyoshi, Isamu ^c   Nishida, Shin'ya ^c   Adelson, Edward H ^b  

^a USA   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c NTT CORPORATION   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BUILDING MATERIALS; COMPUTER VISION; PHOTOGRAPHY; REFLECTION; SOLAR RADIATION; STATISTICS;

COMPLEX SURFACES; DIFFUSE REFLECTANCES; HUMAN OBSERVERS; IMAGE STATISTICS; LINEAR COMBINATIONS; MACHINE VISION SYSTEMS; REAL-WORLD; SUB BANDS; SURFACE REFLECTANCES;

SURFACE CHEMISTRY;

ARTICLE; ASSOCIATION; BIOLOGICAL MODEL; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; HUMAN; ILLUMINATION; METHODOLOGY; PHYSIOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; SURFACE PROPERTY; TASK PERFORMANCE; VISION;

COMPUTER SIMULATION; CUES; DATA INTERPRETATION, STATISTICAL; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LIGHTING; MODELS, BIOLOGICAL; MODELS, STATISTICAL; SURFACE PROPERTIES; TASK PERFORMANCE AND ANALYSIS; VISUAL PERCEPTION;

EID: 45549104768     PISSN: 10847529     EISSN: 15208532     Source Type: Journal    
DOI: 10.1364/JOSAA.25.000846     Document Type: Article

References (49)

1. A. Gelb, "Die 'Farbenkonstanz' dez Sehdinge [Color constancy of visual objects]," in Handbuchder normalen und pathologischen Psychologie, W. A. von Bethe, ed. (Springer, 1929), pp. 594-678.
2. I. Motoyoshi, S. Nishida, L. Sharan, and E. H. Adelson, "Image statistics and the perception of surface qualities," Nature 447, 206-209 (2007).
3. A. L. Gilchrist, "The perception of surface blacks and whites," Sci. Am. 240, 112-124 (1979).
4. A. L. Gilchrist and A. Jacobsen, "Perception of lightness and illumination in a world of one reflectance," Perception 13, 5-19 (1984).
5. E. H. Land and J. J. McCann, "Lightness and retinex theory," J. Opt. Soc. Am. 61, 1-11 (1971).
6. A. L. Gilchrist, "Perceived lightness depends on perceived spatial arrangement," Science 195, 185-187 (1977).
7. E. H. Adelson, "Perceptual organization and judgment of brightness," Science 262, 2042-2044 (1993).
8. M. D'Zmura and G. Iverson, "Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces," J. Opt. Soc. Am. A 10, 2148-2165 (1993).
9. D. H. Brainard, "Color constancy in the nearly natural image. 2. Achromatic loci," J. Opt. Soc. Am. A 15, 307-325 (1998).
10. A. L. Gilchrist, C. Kossyfidis, F. Bonato, T. Agostini, J. Cataliotti, X. Li, B. Spehar, V. Annan, and E. Economou, "An anchoring theory of lightness perception," Psychol. Rev. 106, 795-834 (1999).
11. M. G. Bloj, D. Kersten, and A. C. Hurlbert, "Perception of three-dimensional shape influences color perception through mutual illumination," Nature 402, 877-879 (1999).
12. H. Boyaci, L. T. Maloney, and S. Hersh, "The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes," J. Vision 3, 541-553 (2003).
13. D. H. Brainard, J. M. Kraft, and P. Longere, "Color constancy: developing empirical tests of computational models," in Color Perception: From Light to Object, R.Mausfeld and D. Heyer, eds. (Oxford U. Press, 2003), pp. 307-334.
14. L. T. Maloney and J. N. Yang, "The illumination estimation hypothesis and surface color perception," in Color Vision: Connecting the Mind to the Physical World, R. Mausfeld and D. Heyer, eds. (Oxford U. Press, 2003), pp. 335-358.
15. S. Nishida and M. Shinya, "Use of image-based information in judgments of surface reflectance properties," J. Opt. Soc. Am. A 15, 2951-2965 (1998).
16. R. O. Dror, E. H. Adelson, and A. S. Willsky, "Recognition of surface reflectance properties from a single image under unknown real-world illumination," in Proceedings of the IEEE Workshop on Identifying Objects across Variation in Lighting: Psychophysics and Computation (IEEE, 2001), available at http://web.mit.edu/persci/people/adelson/pub-pdfs/dror- cvpr01-goem.pdf.
17. R. O. Dror, "Surface reflectance recognition and real-world illumination statistics," Ph.D. dissertation (Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2002).
18. R. W. Fleming, R. O. Dror, and E. H. Adelson, "Real-world illumination and the perception of surface reflectance properties," J. Vision 3, 347-368 (2003).
19. R. Robilotto and Q. Zaidi, "Limits of lightness identification of real objects under natural viewing conditions," J. Vision 4, 779-797 (2004).
20. R. Robilotto and Q. Zaidi, "Lightness identification of patterned three-dimensional, real objects," J. Vision 6, 18-36 (2006).
21. J. Beck and S. Prazdny, "Highlights and the perception of glossiness," Percept. Psychophys. 30, 401-410 (1981).
22. F. Pellacini, J. A. Ferwerda, and D. P. Greenberg, "Towards a psychophysically-based light reflection model for image synthesis," in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, J. R.Brown and K. Akeley, eds. (ACM Press, 2000), pp. 55-64.
23. J. T. Todd, J. F. Norman, and E. Mingolla, "Lightness constancy in the presence of specular highlights," Psychol. Sci. 15, 33-39 (2004).
24. B.-T. Phong, "Illumination for computer generated pictures," Commun. ACM 18, 311-317 (1975).
25. Y. Sato, M. D. Wheeler, and K. Ikeuchi, "Object shape and reflectance modeling from observation," in Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, G. O. Owen, T. Whitted, and B.Mones-Hattal, eds. (ACM Press, 1997), pp. 379-387.
26. Y. Yu and J. Malik, "Recovering photometric properties of architectural scenes from photographs," in Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, S. Cunningham, W. Bransford, and M. F. Cohen, eds. (ACM Press, 1998), pp. 207-217.
27. S. R. Marschner, S. H. Westin, E. P. F. Lafortune, K. E. Torrance, and D. P. Green, "Image-based BRDF measurement including human skin," in Proceedings of the 10th Eurographics Workshop on Rendering, D. Lischinski and G. W. Larson, eds. (Springer, 1999), pp. 139-152.
28. Y. Yu, P. Debevec, J. Malik, and T. Hawkins, "Inverse global illumination: recovering reflectance models of real scenes from photographs," in Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, W. Waggenspack, ed. (ACM Press, 1999), pp.215-224.
29. S. Boivin and A. Gagalowicz, "Image based rendering of diffuse, specular and glossy surfaces from a single image," in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, L. Pocock, ed. (ACM Press, 2001), pp. 107-116.
30. S. Tominaga and N. Tanaka, "Estimating reflection parameters from a single color image," IEEE Comput. Graphics Appl. 20, 58-66 (2000).
31. K. Nishino, Z. Zhang, and K. Ikeuchi, "Determining reflectance parameters and illumination distributions from a sparse set of images for view-dependent image synthesis," in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2001), pp. 599-601.
32. R. Ramamoorthi and P. Hanrahan, "A signal processing framework for inverse rendering," in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, L. Pocock, ed. (ACM Press, 2001),pp. 117-128.
33. P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, "Acquiring the reflectance field of a human face," in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, J. R.Brown and K. Akeley, eds. (ACM Press, 2000), pp. 145-156.
34. P. Debevec, C. Tchou, A. Gardner, T. Hawkins, C. Poullis, J. Stumpfel, A. Jones, N. Yun, P. Einarsson, T. Lundgren, M. Fajardo, and P. Martinez, "Estimating surface reflectance properties of a complex scene under captured natural illumination," Tech. Rep. ICT-TR-06 (University of Southern California Institute for Creative Technologies Graphics Laboratory, 2004).
35. J. J. Koenderink, A. J. Van Doorn, K. J. Dana, and S. Nayar, "Bidirectional reflectance distribution function of thoroughly pitted surfaces," Int. J. Comput. Vis. 31, 129-144 (1999).
36. J. J. Koenderink and A. J. van Doorn, "Illuminance texture due to surface mesostructure," J. Opt. Soc. Am. A 13, 452-463 (1996).
37. D. Coffin, "Raw digital photo decoding in Linux," http://www.cybercom.net/̃dcoffin/dcraw.
38. P. Debevec, C. Tchou, and T. Hawkins, "HDRShop: high dynamic range image processing and manipulation," http://www.hdrshop.com.
39. P. Burt and E. H. Adelson, "Laplacian pyramid as a compact image code," IEEE Trans. Commun. 31, 532-540 (1983).
40. E. P. Simoncelli and W. T. Freeman, "The steerable pyramid: a flexible architecture for multi-scale derivative computation," in Proceedings of IEEE Conference on Image Processing (IEEE, 1995), pp. 444-447.
41. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines," http://www.csie.ntu.edu.tw/̃cjlin/libsvm.
42. Columbia-Utrecht Reflectance and Texture (CURET) database, http://www.cs.columbia.edu/CAVE/curet.
43. D. J. Heeger and J. R. Bergen, "Pyramid-based texture analysis/synthesis," in Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, R. Cook, ed. (ACM Press, 1995), pp. 229-238.
44. M. D. Rutherford and D. H. Brainard, "Lightness constancy: a direct test of the illumination estimation hypothesis," Psychol. Sci. 13, 142-149 (2002).
45. C. Chubb, M. S. Landy, and J. Econopouly, "A visual mechanism tuned to black," Vision Res. 44, 3223-3232 (2004).
46. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature 381, 607-609 (1996).
47. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci. 24, 1193-1216 (2001).
48. M. Varma and A. Zisserman, "A statistical approach to texture classification from single images," Int. J. Comput.Vis. 62, 61-81 (2005).
49. M. Oren and S. K. Nayar, "Generalization of the Lambertian model and implications for machine vision," Int. J. Comput. Vis. 14, 227-251 (1995).