Numerical methods for shape-from-shading: A new survey with benchmarks

Computer Vision and Image Understanding

Volumn 109, Issue 1, 2008, Pages 22-43

  Durou, Jean Denis ^a   Falcone, Maurizio ^b   Sagona, Manuela ^b  

^a UNIVERSITÉ PAUL SABATIER   (France)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Algorithms comparison; Eikonal equation; Numerical methods; Shape from shading

Indexed keywords

ALGORITHMS; BENCHMARKING; IMAGE ACQUISITION; NUMERICAL METHODS; OPTIMIZATION;

ALGORITHMS COMPARISON; EIKONAL EQUATION;

PROBLEM SOLVING;

EID: 37049013083     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.09.003     Document Type: Article

References (100)

1. Zhang R., Tsai P.-S., Cryer J.E., and Shah M. Shape from shading: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 8 (1999) 690-706
2. In: Horn B.K.P., and Brooks M.J. (Eds). Shape from Shading (1989), MIT Press
3. Horn B.K.P. Height and gradient from shading. International Journal of Computer Vision 5 1 (1990) 37-75
4. Kimmel R., Siddiqi K., Kimia B.B., and Bruckstein A.M. Shape from shading: level set propagation and viscosity solutions. International Journal of Computer Vision 16 2 (1995) 107-133
5. Kozera R. An overview of the shape from shading problem. Machine Graphics and Vision 7 1-2 (1998) 291-312
6. Klette R., Kozera R., and Schlüns K. Reflectance-based shape recovery. In: Jähne B., Haussecker H., and Geissler P. (Eds). Signal Processing and Pattern Recognition, vol. 2 of Handbook of Computer Vision and Applications (1999), Academic Press 531-590 (Chapter 19)
7. Samaras D., and Metaxas D.N. Incorporating illumination constraints in deformable models for shape from shading and light direction estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2 (2003) 247-264
8. Chojnacki W., Brooks M.J., and Gibbins D. Revisiting Pentland's estimator of light source direction. Journal of the Optical Society of America-Part A: Optics, Image Science, and Vision 11 1 (1994) 118-124
9. Drew M.S. Direct solution of orientation-from-color problem using a modification of Pentland's light source direction estimator. Computer Vision and Image Understanding 64 2 (1996) 286-299
10. Belhumeur P.N., Kriegman D.J., and Yuille A.L. The bas-relief ambiguity. International Journal of Computer Vision 35 1 (1999) 33-44
11. Oren M., and Nayar S.K. Generalization of the Lambertian model and implications for machine vision. International Journal of Computer Vision 14 3 (1995) 227-251
12. S.M. Bakshi, Y.-H. Yang, Shape from shading for non-Lambertian surfaces, in: Proceedings of the IEEE International Conference on Image Processing (vol. II), Austin, TX, USA, 1994, pp. 130-134.
13. Lee K.M., and Kuo C.-C.J. Shape from shading with a generalized reflectance map model. Computer Vision and Image Understanding 67 2 (1997) 143-160
14. Ragheb H., and Hancock E.R. A probabilistic framework for specular shape-from-shading. Pattern Recognition 36 2 (2003) 407-427
15. Stewart A.J., and Langer M.S. Toward accurate recovery of shape from shading under diffuse lighting. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 9 (1997) 1020-1025
16. Y. Wang, D. Samaras, Estimation of multiple illuminants from a single image of arbitrary known geometry, in: Proceedings of the Seventh European Conference on Computer Vision (vol. III), vol. 2352 of Lecture Notes in Computer Science, Copenhagen, Denmark, 2002, pp. 272-288.
17. Nayar S.K., Ikeuchi K., and Kanade T. Shape from interreflections. International Journal of Computer Vision 6 3 (1991) 173-195
18. Forsyth D.A., and Zisserman A. Reflections on shading. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 7 (1991) 671-679
19. Penna M.A. A shape from shading analysis for a single perspective image of a polyhedron. IEEE Transactions on Pattern Analysis and Machine Intelligence 11 6 (1989) 545-554
20. Lee K.M., and Kuo C.-C.J. Shape from shading with perspective projection, computer vision, graphics, and image processing. Image Understanding 59 2 (1994) 202-212
21. Hasegawa J.K., and Tozzi C.L. Shape from shading with perspective projection and camera calibration. Computers and Graphics 20 3 (1996) 351-364
22. Okatani T., and Deguchi K. Shape reconstruction from an endoscope image by shape from shading technique for a point light source at the projection center. Computer Vision and Image Understanding 66 2 (1997) 119-131
23. D. Samaras, D.N. Metaxas, Coupled lighting direction and shape estimation from single images, in: Proceedings of the Seventh IEEE International Conference on Computer Vision (vol. II), Kerkyra, Greece, 1999, pp. 868-874.
24. E. Prados, O. Faugeras, Perspective shape from shading and viscosity solutions, in: Proceedings of the Ninth IEEE International Conference on Computer Vision (vol. II), Nice, France, 2003, pp. 826-831.
25. A. Tankus, N. Sochen, Y. Yeshurun, A new perspective [on] shape-from-shading, in: Proceedings of the Ninth IEEE International Conference on Computer Vision (vol. II), Nice, France, 2003, pp. 862-869.
26. F. Courteille, A. Crouzil, J.-D. Durou, P. Gurdjos, Towards shape from shading under realistic photographic conditions, in: Proceedings of the 17th International Conference on Pattern Recognition (vol. II), Cambridge, UK, 2004, pp. 277-280.
27. E. Prados, O. Faugeras, F. Camilli, Shape from shading: a well-posed problem?, Rapport de Recherche 5297, Institut National de Recherche en Informatique et en Automatique, Sophia Antipolis, France, August 2004.
28. Van Diggelen J. A photometric investigation of the slopes and heights of the ranges of hills in the maria of the moon. Bulletin of the Astronomical Institute of the Netherlands 11 423 (1951) 283-290
29. Rindfleisch T. Photometric method for lunar topography. Photometric Engineering 32 2 (1966) 262-277
30. Horn B.K.P. Obtaining shape from shading information. In: Winston P.H. (Ed). The Psychology of Computer Vision (1975), McGraw-Hill 15-155 (Chapter 4)
31. Oliensis J. Uniqueness in shape from shading. International Journal of Computer Vision 6 2 (1991) 75-104
32. Oliensis J. Shape from shading as a partially well-constrained problem. Computer Vision, Graphics, and Image Processing: Image Understanding 54 2 (1991) 163-183
33. Brooks M.J., Chojnacki W., and Kozera R. Impossible and ambiguous shading patterns. International Journal of Computer Vision 7 2 (1992) 119-126
34. Kozera R. Uniqueness in shape from shading revisited. Journal of Mathematical Imaging and Vision 7 2 (1997) 123-138
35. Rouy E., and Tourin A. A viscosity solutions approach to shape-from-shading. SIAM Journal on Numerical Analysis 29 3 (1992) 867-884
36. Barles G. Solutions de viscosité des équations de Hamilton-Jacobi (1994), Springer, Verlag (in French)
37. Lions P.-L., Rouy E., and Tourin A. Shape-from-shading, viscosity solutions and edges. Numerische Mathematik 64 3 (1993) 323-353
38. E. Prados, O. Faugeras, E. Rouy, Shape from shading and viscosity solutions, in: Proceedings of the Seventh European Conference on Computer Vision (vol. II), vol. 2351 of Lecture Notes in Computer Science, Copenhagen, Denmark, 2002, pp. 790-804.
39. J. Oliensis, P. Dupuis, A global algorithm for shape from shading, in: Proceedings of the Fourth IEEE International Conference on Computer Vision, Berlin, Germany, 1993, pp. 692-701.
40. Ishii H., and Ramaswamy M. Uniqueness results for a class of Hamilton-Jacobi equations with singular coefficients. Communications in Partial Differential Equations 20 (1995) 2187-2213
41. F. Camilli, M. Falcone, An approximation scheme for the maximal solution of the shape-from-shading model, in: Proceedings of the IEEE International Conference on Image Processing (vol. I), Lausanne, Switzerland, 1996, pp. 49-52.
42. Camilli F., and Siconolfi A. Maximal subsolutions of a class of degenerate Hamilton-Jacobi problems. Indiana University Mathematics Journal 48 3 (1999) 1111-1131
43. M. Falcone, M. Sagona, An algorithm for the global solution of the shape-from-shading model, in: Proceedings of the Ninth International Conference on Image Analysis and Processing (vol. I), vol. 1310 of Lecture Notes in Computer Science, Florence, Italy, 1997, pp. 596-603.
44. Camilli F., and Grüne L. Numerical approximation of the maximal solutions for a class of degenerate Hamilton-Jacobi equations. SIAM Journal on Numerical Analysis 38 5 (2000) 1540-1560
45. M. Sagona, Numerical methods for degenerate Eikonal type equations and applications, Tesi di dottorato, Dipartimento di Matematica dell'Università di Napoli "Federico II", Napoli, Italy, November 2001.
46. A. Tankus, N. Sochen, Y. Yeshurun, Perspective shape-from-shading by fast marching, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (vol. I), Washington, DC, USA, 2004, pp. 43-49.
47. Tankus A., Sochen N., and Yeshurun Y. Shape-from-shading under perspective projection. International Journal of Computer Vision 63 1 (2005) 21-43
48. Kimmel R., and Sethian J.A. Optimal algorithm for shape from shading and path planning. Journal of Mathematical Imaging and Vision 14 3 (2001) 237-244
49. Prados E., and Faugeras O. A generic and provably convergent shape-from-shading method for orthographic and pinhole cameras. International Journal of Computer Vision 65 1-2 (2005) 97-125
50. R. Dovgard, R. Basri, Statistical symmetric shape from shading for 3D structure recovery of faces, in: Proceedings of the Eighth European Conference on Computer Vision (vol. II), vol. 3022 of Lecture Notes in Computer Science, Prague, Czech Republic, 2004, pp. 99-113.
51. Kain J., and Ostrov D.N. Numerical shape-from-shading for discontinuous photographic images. International Journal of Computer Vision 44 3 (2001) 163-173
52. E. Prados, O. Faugeras, A mathematical and algorithmic study of the Lambertian SFS problem for orthographic and pinhole cameras, Rapport de Recherche 5005, Institut National de Recherche en Informatique et en Automatique, Sophia Antipolis, France, November 2003.
53. M. Falcone, M. Sagona, A. Seghini, A global algorithm for the shape-from-shading model with "black shadows", in: F. Brezzi, A. Buffa, S. Corsaro, A. Murli (Eds.), Numerical Mathematics and Advanced Applications-ENUMATH 2001, Springer-Verlag, 2003, pp. 503-512.
54. Bruckstein A.M. On shape from shading. Computer Vision, Graphics, and Image Processing 44 2 (1988) 139-154
55. Kimmel R., and Bruckstein A.M. Global shape from shading. Computer Vision and Image Understanding 62 3 (1995) 360-369
56. Kimmel R., and Bruckstein A.M. Tracking level sets by level sets: a method for solving the shape from shading problem. Computer Vision and Image Understanding 62 1 (1995) 47-58
57. Bruss A.R. The Eikonal equation: some results applicable to computer vision. Journal of Mathematical Physics 23 5 (1982) 890-896
58. Durou J.-D., and Piau D. Ambiguous shape from shading with critical points. Journal of Mathematical Imaging and Vision 12 2 (2000) 99-108
59. Prados E., Camilli F., and Faugeras O. A viscosity solution method for shape-from-shading without image boundary data. ESAIM: Mathematical Modelling and Numerical Analysis 40 2 (2006) 393-412
60. Horn B.K.P., and Brooks M.J. The variational approach to shape from shading. Computer Vision, Graphics, and Image Processing 33 2 (1986) 174-208
61. Y.G. Leclerc, A.F. Bobick, The direct computation of height from shading, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Maui, HI, USA, 1991, pp. 552-558.
62. P. Daniel, J.-D. Durou, From deterministic to stochastic methods for shape from shading, in: Proceedings of the Fourth Asian Conference on Computer Vision, Taipei, Taiwan, 2000, pp. 187-192.
63. T.M. Strat, A Numerical Method for Shape-From-Shading From a Single Image, Master's Thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA, 1979.
64. Frankot R.T., and Chellappa R. A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence 10 4 (1988) 439-451
65. Szeliski R. Fast shape from shading. Computer Vision, Graphics, and Image Processing: Image Understanding 53 2 (1991) 129-153
66. Ikeuchi K., and Horn B.K.P. Numerical shape from shading and occluding boundaries. Artificial Intelligence 17 1-3 (1981) 141-184
67. D. Lee, A provably convergent algorithm for shape from shading, in: Proceedings of the DARPA Image Understanding Workshop, Miami Beach, FL, USA, 1985, pp. 489-496.
68. M.J. Brooks, B.K.P. Horn, Shape and source from shading, in: Proceedings of the Ninth International Joint Conference on Artificial Intelligence (vol. II), Los Angeles, CA, USA, 1985, pp. 932-936.
69. Worthington P.L., and Hancock E.R. New constraints on data-closeness and needle map consistency for shape-from-shading. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 12 (1999) 1250-1267
70. Pong T.C., Haralick R.M., and Shapiro L.G. Shape from shading using the facet model. Pattern Recognition 22 6 (1989) 683-695
71. Lee K.M., and Kuo C.-C.J. Shape from shading with a linear triangular element surface model. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 8 (1993) 815-822
72. D. Samaras, D.N. Metaxas, Incorporating illumination constraints in deformable models, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, USA, 1998, pp. 322-329.
73. F. Courteille, J.-D. Durou, G. Morin, A global solution to the SFS problem using B-spline surface and simulated annealing, in: Proceedings of the 18th International Conference on Pattern Recognition (vol. II), Hong Kong, 2006, pp. 332-335.
74. Zheng Q., and Chellappa R. Estimation of illuminant direction, albedo, and shape from shading. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 7 (1991) 680-702
75. Worthington P.L., and Hancock E.R. Needle map recovery using robust regularizers. Image and Vision Computing 17 8 (1999) 545-557
76. Durou J.-D., and Maître H. On convergence in the methods of strat and of smith for shape from shading. International Journal of Computer Vision 17 3 (1996) 273-289
77. Crouzil A., Descombes X., and Durou J.-D. A multiresolution approach for shape from shading coupling deterministic and stochastic optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 11 (2003) 1416-1421
78. H. Saito, N. Tsunashima, Estimation of 3-D parametric models from shading image using genetic algorithms, in: Proceedings of the 12th International Conference on Pattern Recognition (vol. I), Jerusalem, Israel, 1994, pp. 668-670.
79. Pentland A.P. Local shading analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 6 2 (1984) 170-187
80. Lee C.-H., and Rosenfeld A. Improved methods of estimating shape from shading using the light source coordinate system. Artificial Intelligence 26 2 (1985) 125-143
81. Hayakawa H., Nishida S., Wada Y., and Kawato M. A computational model for shape estimation by integration of shading and edge information. Neural Networks 7 8 (1994) 1193-1209
82. Wildey R.L. Radarclinometry for the Venus Radar Mapper. Photogrammetric Engineering and Remote Sensing 52 1 (1986) 41-50
83. Pentland A.P. Linear shape from shading. International Journal of Computer Vision 4 2 (1990) 153-162
84. Kozera R., and Klette R. Finite difference based algorithms for linear shape from shading. Machine Graphics and Vision 6 2 (1997) 157-201
85. Ulich G. Provably convergent methods for the linear and nonlinear shape from shading problem. Journal of Mathematical Imaging and Vision 9 1 (1998) 69-82
86. Kozera R., and Klette R. Evaluation of numerical solution schemes for differential equations. In: Klette R., Stiehl H.S., Viergever M.A., and Vincken K.L. (Eds). Performance Characterization in Computer Vision, vol. 17 of Computational Imaging and Vision (1999), Kluwer Academic Publishers 153-166
87. Tsai P.-S., and Shah M. Shape from shading using linear approximation. Image and Vision Computing 12 8 (1994) 487-498
88. M. Bichsel, A.P. Pentland, A simple algorithm for shape from shading, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA, 1992, pp. 459-465.
89. A. Crouzil, X. Descombes, J.-D. Durou, A Multiresolution Approach for Shape from Shading Coupling Deterministic and Stochastic Optimization, Rapport de Recherche 2003-19-R, Institut de Recherche en Informatique de Toulouse, Toulouse, France, September 2003.
90. A.P. Pentland, Shape information from shading: a theory about human perception, in: Proceedings of the Second IEEE International Conference on Computer Vision, Tampa, FL, USA, 1988, pp. 404-413.
91. Bardi M., and Falcone M. An approximation scheme for the minimum time function. SIAM Journal of Control and Optimization 28 4 (1990) 950-965
92. Bardi M., and Falcone M. Discrete approximation of the minimal time function for systems with regular optimal trajectories. In: Bensoussan A., and Lions P.-L. (Eds). Analysis and Optimization of Systems, vol. 144 of Lecture Notes in Control and Information Science (1990), Springer-Verlag 103-112
93. Falcone M., Giorgi T., and Loreti P. Level sets of viscosity solutions: some applications to fronts and Rendez-Vous problems. SIAM Journal on Applied Mathematics 54 5 (1994) 1335-1354
94. Sethian J.A., and Vladimirsky A. Fast methods for the Eikonal and related Hamilton-Jacobi equations on unstructured meshes. Proceedings of the National Academy of Sciences of the United States of America 97 11 (2000) 5699-5703
95. Cristiani E., and Falcone M. Fast Marching Semi-Lagrangian Methods for the Eikonal Equation and Applications. SIAM Journal on Numerical Analysis 45 5 (2007) 1979-2011
96. Wu Z., and Li L. A line-integration based method for depth recovery from surface normals. Computer Vision, Graphics, and Image Processing 43 1 (1988) 53-66
97. P. Daniel, J.-D. Durou, Creation of real images which are valid for the assumptions made in shape from shading, in: Proceedings of the 10th International Conference on Image Analysis and Processing, Venice, Italy, 1999, pp. 418-423.
98. R. Kozera, A note on existence and uniqueness in shape from shading, in: Proceedings of the Fourth IEEE International Conference on Computer Vision, Berlin, Germany, 1993, pp. 507-511.
99. Horn B.K.P., Szeliski R., and Yuille A.L. Impossible shaded images. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 2 (1993) 166-170
100. Ascher U.M., and Carter P.M. A multigrid method for shape from shading. SIAM Journal on Numerical Analysis 30 1 (1993) 102-115