Example-based photometric stereo: Shape reconstruction with general, varying BRDFs

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 27, Issue 8, 2005, Pages 1254-1264

  Hertzmann, Aaron ^a   Seitz, Steven M ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b University of Washington   (United States)

Author keywords

Bidirectional reflectance distribution function (BRDF); Clustering materials; Photometric stereo; Shape reconstruction; Shape from shading; Specular materials

Indexed keywords

IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS;

BIDIRECTIONAL DISTRIBUTION FUNCTION (BRDF); CLUSTERING MATERIALS; PHOTOMETRIC STEREO; SHAPE RECONSTRUCTION; SPECULAR MATERIALS;

OBJECT RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COLORIMETRY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; DEMOGRAPHY; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; PHOTOGRAPHY; PHOTOMETRY; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COLORIMETRY; COMPUTER SIMULATION; DEMOGRAPHY; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAMMETRY; PHOTOMETRY;

EID: 24344435585     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2005.158     Document Type: Article

References (38)

1. S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman, and A.Y. Wu, "An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions," J. ACM, vol. 45, no. 6, pp. 891-923, 1998.
2. R. Bajcsy, S. Lee, and A. Leonardis, "Color Image Segmentation with Detection of Highlights and Local Illumination Induced by Inter-Reflections," Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 785-790, 1990.
3. R. Basri and D. Jacobs, "Photometric Stereo with General, Unknown Lighting," Proc. Computer Vision and Pattern Recognition Conf., pp. 374-381, 2001.
4. R. Basri and D.W. Jacobs, "Lambertian Reflectance and Linear Subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.
5. J.S. Beis and D.G. Lowe, "Indexing without Invariants in 3D Object Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 1000-1015, Oct. 1999.
6. W.-C. Chen, J.-Y. Bouguet, M.H. Chu, and R. Grzeszczuk, "Light Field Mapping: Efficient Representation and Hardware Rendering of Surface Light Fields," Proc. SIGGRAPH, pp. 447-456, 2002.
7. E. Coleman Jr. and R. Jain, "Obtaining 3-Dimensional Shape of Textured and Specular Surfaces Using Four-Source Photometry," Proc. Int'l Conf. Color in Graphics and Image Processing (CGIP), vol. 18, no. 4, pp. 309-328, Apr. 1982.
8. K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink, "Reflectance and Texture of Real-World Surfaces," ACM Trans. Graphics, vol. 18, no. 1, pp. 1-34, 1999.
9. P.E. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. SIGGRAPH '97, pp. 369-378, 1997.
10. C. Fraley and A.E. Raftery, "How Many Clusters? Which Clustering Method? Answers via Model-Based Cluster Analysis," The Computer J., vol. 41, no. 8, pp. 578-588, 1998.
11. J.H. Friedman, J.L. Bentley, and R.A. Finkel, "An Algorithm for Finding Best Matches in Logarithmic Expected Time," ACM Trans. Math. Software, vol. 3, no. 3, pp. 209-226, 1977.
12. A.S. Georghiades, "Recovering 3-D Shape and Reflectance from a Small Number of Photographs," Proc. Eurographics Symp. Rendering: 14th Eurographics Workshop Rendering, pp. 230-240, June 2003.
13. G. Healey, "Segmenting Images Using Normalized Color," IEEE Trans. Systems, Man, and Cybernetics, vol. 22, no. 1, pp. 64-73, 1992.
14. A. Hertzmann and S.M. Seitz, "Shape and Materials by Example: A Photometric Stereo Approach," Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 533-540, June 2003.
15. B.K.P. Horn, Robot Vision. New York: McGraw-Hill, 1986.
16. K. Ikeuchi, "Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 6, pp. 661-669, 1981.
17. G.J. Klinker, S.A. Shafer, and T. Kanade, "A Physical Approach to Color Image Understanding," Int'l J. Computer Vision, vol. 4, no. 1, pp. 7-38, 1990.
18. D.J. Kriegman, T. Zickler, J. Ho, J. Ponce, and P.N. Belhumeur, "Binocular Helmholtz Stereopsis," Proc. European Conf. Computer Vision, pp. 1411-1417, Oct. 2003.
19. H.P. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, "Image-Based Reconstruction of Spatial Appearance and Geometric Detail," ACM Trans. Graphics, vol. 22, no. 2, pp. 234-257, Apr. 2003.
20. W. Matusik, H. Pfister, M. Brand, and L. McMillan, "A Data-Driven Reflectance Model," ACM Trans. Graphics, vol. 22, no. 3, pp. 759-769, July 2003.
21. W. Matusik, H. Pfister, M. Brand, and L. McMillan, "Efficient Isotropic BRDF Measurement," Proc. Eurographics Symp. Rendering: 14th Eurographics Workshop Rendering, pp. 241-248, June 2003.
22. S.K. Nayar, K. Ikeuchi, and T. Kanade, "Determining Shape and Reflectance of Hybrid Surfaces by Photometric Sampling," IEEE Trans. Robotics and Automation, vol. 6, no. 4, pp. 418-431, 1990.
23. S.A. Nene and S.K. Nayar, "A Simple Algorithm for Nearest Neighbor Search in High Dimensions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 989-1003, Sept. 1997.
24. D. Pelleg and A.W. Moore, "X-Means: Extending K-Means with Efficient Estimation of q Number of Clusters," Proc. Int'l Conf. Machine Learning, pp. 727-734, 2000.
25. R. Ramamoorthi and P. Hanrahan, "Frequency Space Environment Map Rendering," ACM Trans. Graphics, vol. 21, no. 3, pp. 517-526, July 2002.
26. W.M. Silver, "Determining Shape and Reflectance Using Multiple Images," Master's thesis, MIT, Cambridge, Mass., 1980.
27. A.R. Smith and J.F. Blinn, "Blue Screen Matting," Proc. SIGGRAPH '96, pp. 259-268, Aug. 1996.
28. D. Terzopoulos, "The Computation of Visible-Surface Representations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 417-438, 1988.
29. A. Treuille, A. Hertzmann, and S.M. Seitz, "Example-Based Stereo with General BRDFs," Proc. European Conf. Computer Vision, pp. 457-469, 2004.
30. P. Tu and P.R.S. Mendonça, "Surface Reconstruction via Helmholtz Reciprocity with a Single Image Pair," Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 541-547, June 2003.
31. Physics-Based Vision: Principles and Practice, Shape Recovery, L.B. Wolff, S.A. Shafer, and G.E. Healey, eds., Boston: Jones and Bartlett, 1992.
32. D.N. Wood, D.I. Azuma, W. Aldinger, B. Curless, T. Duchamp, D.H. Salesin, and W. Stuetzle, "Surface Light Fields for 3D Photography," Proc. SIGGRAPH, pp. 287-296, 2000.
33. R.J. Woodham, "Photometric Method for Determining Surface Orientation from Multiple Images," Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
34. R.J. Woodham, "Gradient and Curvature from Photometric Stereo Including Local Confidence Estimation," J. Optical Soc. Am. A, vol. 11, no. 11, pp. 3050-3068, Nov. 1994.
35. T. Zickler, P.N. Belhumeur, and D.J. Kriegman, "Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction," Int'l J. Computer Vision, vol. 49, nos. 2-3, pp. 215-227, 2002.
36. T. Zickler, P.N. Belhumeur, and D.J. Kriegman, "Toward a Stratification of Helmholtz Stereopsis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 548-555, June 2003.
37. R.J. Woodham, "Reflectance Map Techniques for Analyzing Surface Defects in Metal Castings," Technical Report AI-TR-457, MIT, Artificial Intelligence Laboratory, Cambridge, Mass., 1978.
38. R. Lu, J.J. Koenderink, and A.M.L. Kappers, "Optical Properties (Bidirectional Reflection Distribution Functions) of Velvet," Applied Optics-OT, vol. 37, no. 25, pp. 5974-5984, 1998.