How shading constrains surface patches without knowledge of light sources

SIAM Journal on Imaging Sciences

Volumn 7, Issue 2, 2014, Pages 641-668

  Kunsberg, Benjamin ^a   Zucker, Steven W ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

Covariant derivatives; Highlights; Isophotes; Orientation fields; Shape from shading

Indexed keywords

COMPUTER VISION; INVERSE PROBLEMS;

COVARIANT DERIVATIVES; HIGHLIGHTS; ISOPHOTES; ORIENTATION FIELDS; SHAPE FROM SHADING;

LIGHT SOURCES;

EID: 84900513069     PISSN: None     EISSN: 19364954     Source Type: Journal    
DOI: 10.1137/13092647X     Document Type: Article

References (41)

1. J. Barron and J. Malik, Shape, Illumination, and Reflectance from Shading, Technical Report, 2013.
2. P. Belhumeur and D. Kriegman, What is the set of images of an object under all possible illumination conditions?, Internat. J. Computer Vision, 28 (1998), pp. 1-16.
3. P. Belhumeur, D. Kriegman, and A. Yuille, The bas-relief ambiguity, Internat. J. Computer Vision, 35 (1999), pp. 33-44.
4. O. Ben-Shahar and S. Zucker, Geometrical computations explain projection patterns of long-range horizontal connections in visual cortex, Neural Comput., 16 (2004), pp. 445-476.
5. P. Breton and S.W. Zucker, Shadows and shading flow fields, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '96), 1996, pp. 782-789.
6. M. Breuss, E. Cristiani, J.-D. Durou, M. Falcone, and O. Vogel, Perspective shape from shading: Ambiguity analysis and numerical approximations, SIAM J. Imaging Sci., 5 (2012), pp. 311-342.
7. M.J. Brooks and B.K.P. Horn, Shape and source from shading, in Proceedings of the International Joint Conference on Artificial Intelligence, 1985, pp. 932-936.
8. F. Cole, K. Sanik, D. DeCarlo, A. Finkelstein, T. Funkhouser, S. Rusinkiewicz, and M. Singh, How well do line drawings depict shape?, ACM Trans. Graph., 28 (2009).
9. D. DeCarlo, A. Finkelstein, S. Rusinkiewicz, and A. Santella, Suggestive contours for conveying shape, in Proceedings of SIGGRAPH, 2003, pp. 848-855.
10. P. Dieft and J. Sylvester, Some remarks on the shape-from-shading problem in computer vision, J. Math. Anal. Appl., 84 (1981), pp. 235-248.
11. M.P. Docarmo, Differential Geometry of Curves and Surfaces, Prentice-Hall, Upper Saddle River, NJ, 1976.
12. C.T.J. Dodson and T. Potson, Tensor Geometry, Springer, Berlin, Heidelberg, 1991.
13. P. Dupuis and J. Oliensis, An optimal control formulation and related numerical methods for a problem in shape reconstruction, Ann. Appl. Probab., 4 (1994), pp. 287-346.
14. A. Ecker and A.D. Jepson, Polynomial shape from shading, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 25-27.
15. R. Erens, A. Kappers, and J.J. Koenderink, Perception of local shape from shading, Perception & Psychophys., 54 (1993), pp. 145-156.
16. R. Fleming, D. Holtmann-Rice, and H. Bulthoff, Estimation of 3D shape from image orientations, Proc. Natl. Acad. Sci. USA, 108 (2011), pp. 20438-20443.
17. R. Fleming, A. Torralba, and E.H. Adelson, Specular reflections and the perception of shape, J. Vision, 4 (2004), 10.
18. D.A. Forsyth, Variable-source shading analysis, Internat. J. Computer Vision, 91 (2011), pp. 280-302.
19. J. Garding, Surface orientation and curvature from differential texture distortion, in Proceedings of the 5th International Conference on Computer Vision, 1995, pp. 733-739.
20. B.K.P. Horn and M. Brooks, The variational approach to shape from shading, Computer Vision Graphics Image Process., 33 (1986), pp. 174-208.
21. D. Hubel, Eye, Brain, and Vision, Scientific American Library, 1988.
22. R.A. Hummel and S. Zucker, On the foundations of relaxation labeling processes, IEEE Trans. Pattern Anal. Machine Intell., 5 (1983), pp. 267-287.
23. K. Ikeuchi and B.K.P. Horn, Numerical shape from shading and occluding boundaries, Artificial Intell., 1981, pp. 141-183.
24. T. Judd, F. Durand, and E.H. Adelson, Apparent ridges for line drawing, ACM Trans. Graph., 26 (2007), 19.
25. J.J. Koenderink, What does the occluding contour tell us about solid shape?, Perception, 13 (1984), pp. 321-330.
26. J.J. Koenderink, Solid Shape, The MIT Press, Cambridge, MA, 1990.
27. J.J. Koenderink and A.J. van Doorn, Photometric invariants related to solid shape, Optica Acta, 27 (1980), pp. 981-996.
28. J.J. Koenderink and A.J. van Doorn, Two-plus-one-dimensional differential geometry, Pattern Recognition Lett., 15 (1994), pp. 439-443.
29. J.J. Koenderink, A.J. van Doorn, A.M. Kappers, and J.T. Todd, Ambiguity and the 'mental eye' in pictorial relief, Perception, 30 (2001), pp. 431-438.
30. J.J. Koenderink and A.J. van Doorn, Illuminance critical points on generic smooth surfaces, J. Opt. Soc. Amer. A, 5 (1993), pp. 844-854.
31. B. Kunsberg and S.W. Zucker, The differential geometry of shape from shading: Biology reveals curvature structure, in Proceedings of the 8th IEEE Workshop on Perceptual Organization in Computer Vision, 2012, pp. 39-46.
32. B. Kunsberg and S.W. Zucker, Shape-from-shading and cortical computation: A new formulation, J. Vision, 12 (2012), 233.
33. M. Lawlor, D. Holtmann-Rice, P. Huggins, O. Ben-Shahar, and S.W. Zucker, Boundaries, shading, and border ownership: A cusp at their interaction, J. Physiol. - Paris, 103 (2009), pp. 18-36.
34. J. Oliensis, Uniqueness in shape from shading, Internat. J. Computer Vision, 2 (1991), pp. 75-104.
35. A. Pentland, Local shading analysis, IEEE Trans. Pattern Anal. Machine Intell., PAMI-6 (1984), pp. 170-187.
36. E. Prados and O. Faugeras, Shape from shading: A well-posed problem?, in Proceedings of the 2nd IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 870-877.
37. E. Prados and O. Faugeras, Shape from shading, in Handbook of Mathematical Models in Computer Vision, N. Paragios, Y. Chen, and O. Faugeras, eds., Springer Science, New York, 2006, pp. 375-388.
38. J. Wagemans, A.J. van Doorn, and J.J. Koenderink, The shading cue in context, i-Perception, 1 (2010), pp. 159-178.
39. Y. Xiong, A. Chakrabarti, R. Basri, S.J. Gortler, D. Jacobs, and T. Zickler, From Shading to Local Shape, preprint, arXiv:1310.2916, 2013.
40. Y. Yamane, E.T. Carlson, K.C. Bowman, Z. Wang, and C.E. Connor, A neural code for threedimensional object shape in macaque inferotemporal cortex, Nature Neurosci., 11 (2008), pp. 1352-1360.
41. R. Zhang, T. Ping-Song, J. Cryer, and M. Shah, Shape from shading: A survey, IEEE Trans. Pattern Anal. Machine Intell., 21 (1999), pp. 690-706.