Surface color perception and light field estimation in 3D scenes

Vision in 3D Environments

Volumn , Issue , 2011, Pages 280-307

  Maloney, Laurence T ^a   Gerhard, Holly E ^a   Boyaci, Huseyin ^b   Doerschner, Katja ^b  

^a NEW YORK UNIVERSITY   (United States)

^b BILKENT UNIVERSITY   (Turkey)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84928639500     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511736261.013     Document Type: Chapter

References (62)

1. Adelson, E. H. and Bergen, J. R. (1991). The plenoptic function and the elements of early vision. In M. S. Landy and J. A. Movshon (eds.), Computational Models of Visual Processing, pp 3–20. Cambridge, MA: MIT Press
2. Adelson, E. H. and Pentland, A. P. (1996). The perception of shading and reflectance. In D. Knill and W. Richards (eds.), Perception as Bayesian Inference, pp 409–423. New York: Cambridge University Press
3. Arend, L. E. and Spehar, B. (1993a), Lightness, brightness, and brightness contrast: 1. Illuminance variation. Percept. Psychophys., 54: 446–456
4. Arend, L. E. and Spehar, B. (1993b), Lightness, brightness, and brightness contrast: 2. Reflectance variation. Percept. Psychophys., 54: 457–468
5. Basri, R. and Jacobs, D. (2001). Lambertian reflectance and linear subspaces. In Proceedings of the IEEE International Conference on Computer Vision, Vancouver, pp 383–390
6. Bäuml, K.-H. (1999). Simultaneous color constancy: how surface color perception varies with the illuminant. Vis. Res., 39: 1531–1550
7. Belhumeur, P. N., Kriegman, D., and Yuille, A. (1999). The bas-relief ambiguity. Int. J. Comput. Vis., 35: 33–44
8. Bloj, M. G., Kersten D., and Hurlbert, A. C. (1999). Perception of three-dimensional shape influences colour perception through mutual illumination. Nature, 402: 877–879
9. Bloj, M., Ripamonti, C., Mitha, K., Hauck, R., Greenwald, S., and Brainard, D. H. (2004). An equivalent illuminant model for the effect of surface slant on perceived lightness. J. Vis.4(9): 735–746
10. Boyaci, H., Maloney, L. T., and Hersh, S. (2003). The effect of perceived surface orientation on perceived surface albedo in three-dimensional scenes. J. Vis., 3: 541–553
11. Boyaci, H., Doerschner, K., and Maloney, L. T. (2004). Perceived surface color in binocularly-viewed scenes with two light sources differing in chromaticity. J.Vis., 4: 664–679
12. Boyaci, H., Doerschner, K., and Maloney, L. T. (2006a). Cues to an equivalent lighting model. J. Vis., 6: 106–118
13. Boyaci, H., Doerschner, K., Snyder, J. L., and Maloney, L. T. (2006b). Surface color perception in three-dimensional scenes. Vis. Neurosci., 23: 311–321
14. Ciurea, F. and Funt, B. (2004). Failure of luminance-redness correlation for illuminant estimation. In Proceedings of the Twelfth Color Imaging Conference, Scottsdale, AZ, pp 42–46
15. Doerschner, K., Boyaci, H., and Maloney, L. T. (2004). Human observers compensate for secondary illumination originating in nearby chromatic surfaces. J. Vis., 4: 92–105
16. Doerschner, K., Boyaci, H., and Maloney, L. T. (2007). Testing limits on matte surface color perception in three-dimensional scenes with complex light fields. Vis. Res., 47: 3409–3423
17. Dror, R. O., Willsky, A., and Adelson, E. H. (2004). Statistical characterization of real-world illumination. J. Vis., 4: 821–837
18. Epstein, W. (1961). Phenomenal orientation and perceived achromatic color. J. Psychol., 52: 51–53
19. Fleming, R. W., Dror, R. O., and Adelson, E. H. (2003). Real-world illumination and the perception of surface reflectance properties. J. Vis., 3: 347–368
20. Flock, H. R. and Freedberg, E. (1970), Perceived angle of incidence and achromatic surface color. Percept. Psychophys., 8: 251–256
21. Foster, D. H. and Nascimento, S. M. C. (1994). Relational colour constancy from invariant cone-excitation ratios. Proc. R. Soc. Lond. B, 257: 115–121
22. Gerhard, H. E. and Maloney, L. T. (2008). Albedo perturbation detection under illumination transformations: a dynamic analogue of lightness constancy. [Abstract.] J. Vis., 8: 289
23. Gerhard, H. E. and Maloney, L. T. (2010). Detection of light transformations and concomitant changes in surface albedo. J. Vis.10: 1–14
24. Gerhard, H. E., Khan, R., and Maloney, L. T. (2007). Relational color constancy in the absence of ratio constancy. [Abstract.] J. Vis., 7: 459
25. Gershun, A. (1936/1939). Svetovoe Pole [The Light Field]. Moscow, 1936. Translated by P. Moon and G. Timoshenko (1939) in J. Math. Phys., 18: 51–151
26. Gilchrist, A. L. (1977). Perceived lightness depends on spatial arrangement. Science, 195: 185–187
27. Gilchrist, A. L. (1980). When does perceived lightness depend on perceived spatial arrangement? Percept. Psychophys., 28: 527–538
28. Gilchrist, A. L. and Annan, A., Jr. (2002). Articulation effects in lightness: historical background and theoretical implications. Perception, 31: 141–150
29. Gilchrist, A. L., Kossyfidis, C., Bonato F., Agostini, T., Cataliotti, J., Li, X. J., Spehar, B., Annan, V., and Economou, E. (1999). An anchoring theory of lightness perception. Psychol. Rev., 106: 795–834
30. Golz, J. and MacLeod, D. I. A. (2002). Influence of scene statistics on colour constancy. Nature, 415: 637–640
31. Granzier, J. J. M., Brenner, E., Cornelissen, F. W., and Smeets, J. B. J. (2005). Luminance–color correlation is not used to estimate the color of the illumination. J. Vis., 5: 20–27
32. Green, D. M. and Swets, J. A. (1966). Signal Detection Theory and Psychophysics. New York: Wiley
33. Hara, K., Nishino, K., and Ikeuchi, K. (2005). Light source position and reflectance estimation from a single view without the distant illumination assumption. IEEE Trans. Pattern Anal. Machine Intell., 27: 493–505
34. Haralick, R. M. and Shapiro, L. G. (1993). Computer and Robot Vision, Vol. 2. Reading, MA: Addison-Wesley
35. Henderson, S. T. (1977). Daylight and Its Spectrum, 2nd edn. Bristol: Adam Hilger
36. Hochberg, J. E. and Beck, J. (1954). Apparent spatial arrangements and perceived brightness. J. Exp. Psychol., 47: 263–266
37. Hurlbert, A. C. (1998). Computational models of colour constancy. In V. Walsh and J. Kulikowski (eds.), Perceptual Constancy: Why Things Look as They Do, pp 283–322, Cambridge: Cambridge University Press
38. Ikeda, M., Shinoda, H., and Mizokami, Y. (1998). Three dimensionality of the recognized visual space of illumination proved by hidden illumination, Opt.Rev., 5: 200–205
39. Kaiser, P. K. and Boynton. R. M. (1996). Human Color Vision, 2nd edn. Washington, DC: Optical Society of America
40. Kardos, L. (1934). Ding und Schatten; Eine experimentelle Untersuchung über die Grundlagen des Farbsehens. Z. Psychol. Physiol. Sinnesorgane, Ergänzungsband, 23. Leipzig, Germany: Verlag von J. A. Barth
41. Katz, D. (1935). The World of Colour. London: Kegan, Paul, Trench, Trubner and Co. Koenderink, J. J. and van Doorn, A. J. (1996). Illuminance texture due to surface mesostructure. J. Opt. Soc. Am. A, 13: 452–463
42. Koenderink, J. J. and van Doorn, A. J. (1996). Illuminance texture due to surface mesostructure. J. Opt. Soc. Am. A, 13: 452–463
43. Koenderink, J. J., van Doorn, A. J., and Pont S. C (2004). Light direction from shad(ow)ed random Gaussian surfaces. Perception, 33: 1403–1404. Special issue, Shadows and Illumination II
44. Koenderink, J. J., Pont S. C., van Doorn, A. J., Kappers, A. M. L., and Todd J. T. (2007). The visual light field. Perception, 36: 1595–1610
45. Land, E. H. and McCann, J. J. (1971). Lightness and retinex theory. J. Opt. Soc. Am., 61: 1–11
46. Lee, R. L., Jr. and Hernández-Andrés, J. (2005a). Short-term variability of overcast brightness. Appl. Opt., 44: 5704–5711
47. Lee, R. L., Jr. and Hernández-Andrés, J. (2005b). Colors of the daytime overcast sky. Appl. Opt., 44: 5712–5722
48. MacLeod, D. I. A. and Golz, J. (2003). A computational analysis of colour constancy. In R. Mausfeld and D. Heyer (eds.), Colour Perception: Mind and the Physical World, pp 205–242. Oxford: Oxford University Press
49. Maloney, L. T. (1999). Physics-based approaches to modeling surface color perception. In K. R. Gegenfurtner and L. T. Sharpe (eds.), Color Vision: From Genesto Perception, pp 387–422. Cambridge: Cambridge University Press
50. Maloney, L. T., Boyaci, H., and Doerschner, K. (2005). Surface color perception as an inverse problem in biological vision. Proc. SPIE, 5674: 15–26
51. Mausfeld, R. and Andres, J. (2002). Second-order statistics of colour codes modulate transformations that effectuate varying degrees of scene invariance and illumination invariance. Perception, 31: 209–224
52. Nascimento, S. M. C. and Foster, D. H. (2000). Relational color constancy in achromatic and isoluminant images. J. Opt. Soc. Am. A, 17: 225–231
53. Oruc, I., Maloney, L. T., and Landy, M. S. (2003). Weighted linear cue combination with possibly correlated error. Vis. Res., 43: 2451–2458
54. Pont, S. C. and Koenderink, J. J. (2003). Illuminance flow. In N. Petkov and M. A. Wetsenberg (eds.), Computer Analysis of Images and Patterns, pp 90–97. Berlin: Springer
55. Pont, S. C. and Koenderink, J. J. (2004). Surface illuminance flow. In Y. Aloimonos and G. Taubin (eds.), Proceedings of the second International symposium on SD Data Processing Visualization and Transmission, Thessaloniki, Greece. Piscataway, NJ: IEEE
56. Ramamoorthi, R. and Hanrahan, P. (2001a). On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. J. Opt. Soc. Am. A, 18: 2448–2458
57. Ramamoorthi, R. and Hanrahan, P. (2001b). An efficient representation for irradiance environment maps. In Proceedings of SIGGRAPH 2001, Los Angeles, CA, pp 497–500. New York: ACM Press
58. Redding, G. M. and Lester, C. F. (1980). Achromatic color matching as a function of apparent test orientation, test and background luminance, and lightness or brightness instructions. Percept. Psychophys., 27: 557–563
59. Ripamonti, C., Bloj, M., Hauck, R., Kiran, K., Greenwald, S., Maloney, S. I., and Brainard, D. H. (2004). Measurements of the effect of surface slant on perceived lightness. J. Vis., 4: 747–763
60. Snyder, J. L., Doerschner, K., and Maloney, L. T. (2005), Illumination estimation in three-dimensional scenes with and without specular cues. J. Vis., 5: 863–877
61. te Pas, S. F. and Pont S. C. (2005). Comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres. In Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization, A Coruña, Spain, Vol. 95, pp 75–81.New York: ACM Press
62. Yang, J. N. and Maloney, L. T. (2001). Illuminant cues in surface color perception: tests of three candidate cues. Vis. Res., 41: 2581–2600