A theory of frequency domain invariants: Spherical harmonic identities for BRDF/lighting transfer and image consistency

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 2, 2008, Pages 197-213

  Mahajan, Dhruv ^a   Ramamoorthi, Ravi ^a   Curless, Brian ^b  

^a Department of Earth and Environmental Sciences   (United States)

^b University of Washington   (United States)

Author keywords

Convolution; Frequency domain invariants; Image forensics; Inverse rendering; Relighting; Spherical harmonic identities; Tampering

Indexed keywords

ALGORITHMS; COMPUTER VISION; FREQUENCY DOMAIN ANALYSIS; HARMONIC ANALYSIS; INVERSE PROBLEMS; LIGHT REFLECTION;

FREQUENCY DOMAIN INVARIANTS; IMAGE FORENSICS; INVERSE RENDERING; SPHERICAL HARMONIC IDENTITIES;

IMAGE ANALYSIS;

EID: 37549050220     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2007.1162     Document Type: Article

References (28)

1. R. Basri and D. Jacobs, "Photometric Stereo with General, Unknown Lighting," Proc. Conf. Computer Vision and Pattern Recognition, pp. II-374-II-381, 2001.
2. R. Basri and D. Jacobs, "Lambertian Reflectance and Linear Subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.
3. V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. ACM SIGGRAPH '99, pp. 187-194, 1999.
4. J. Davis, R. Yang, and L. Wang, "BRDF Invariant Stereo Using Light Transport Constancy," Proc. Int'l Conf. Computer Vision, pp. 436-443, 2005.
5. R. Gonzalez and R. Woods, Digital Image Processing, second ed. Pearson Education, 2003.
6. A. Hertzmann, C. Jacobs, N. Oliver, B. Curless, and D. Salesin, "Image Analogies," Proc. ACM SIGGRAPH '01, pp. 327-340, 2001.
7. A. Hertzmann and S. Seitz, "Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1254-1264, Aug. 2005.
8. M. Johnson and H. Farid, "Exposing Digital Forgeries by Detecting Inconsistencies in Lighting," Proc. ACM Multimedia and Security Workshop, pp. 1-10, 2005.
9. H. Jin, S. Soatto, and A. Yezzi, "Multi-View Stereo Beyond Lambert," Proc. Conf. Computer Vision and Pattern Recognition, pp. 171-178, 2003.
10. Z. Lin, R. Wang, X. Tang, and H. Shum, "Detecting Doctored Images Using Camera Response Normality and Consistency," Proc. Conf. Computer Vision and Pattern Recognition, pp. 1087-1092, 2005.
11. S. Marschner and D. Greenberg, "Inverse Lighting for Photography," Proc. Color Imaging Conf., pp. 262-265, 1997.
12. D. Mahajan, R. Ramamoorthi, and B. Curless, "A Theory of Spherical Harmonic Identities for BRDF/Lighting Transfer and Image Consistency," Proc. European Conf. Computer Vision, vol. IV, pp. 41-55, 2006.
13. S. Marschner, S. Westin, E. Lafortune, and K. Torrance, "Image-Based BRDF Measurement," Applied Optics, vol. 39, no. 16, pp. 2592-2600, 2000.
14. S. Mallick, T. Zickler, and P. Belhumeur, "Specularity Removal in Images and Videos: A PDE Approach," Proc. European Conf. Computer Vision, vol. 1, pp. 550-563, 2006.
15. S. Nayar and R. Bolle, "Reflectance Based Object Recognition," Int'l J. Computer Vision, vol. 17, no. 3, pp. 219-240, 1996.
16. T. Ng, S. Chang, and Q. Sun, "Blind Detection of Photomontage Using Higher Order Statistics," Proc. IEEE Int'l Symp. Circuits and Systems, pp. V-688-V-691, 2004.
17. S. Narasimhan, V. Ramesh, and S. Nayar, "A Class of Photometric Invariants: Separating Material from Shape and Illumination," Proc. Int'l Conf. Computer Vision, pp. 1387-1394, 2003.
18. B. Oh, M. Chen, J. Dorsey, and F. Durand, "Image-Based Modeling and Photo Editing," Proc. ACM SIGGRAPH '01, pp. 433-442, 2001.
19. R. Ramamoorthi and P. Hanrahan, "A Signal-Processing Framework for Inverse Rendering," Proc. ACM SIGGRAPH '01, pp. 117-128, 2001.
20. R. Ramamoorthi and P. Hanrahan, "Frequency Space Environment Map Rendering," Proc. ACM SIGGRAPH '02, vol. 21, no. 3, pp. 517-526, 2002.
21. S. Rusinkiewicz, "A New Change of Variables for Efficient BRDF Representation," Proc. Eurographics Rendering Workshop, 1998.
22. D. Simakov, D. Frolova, and R. Basri, "Dense Shape Reconstruction of a Moving Object Under Arbitrary, Unknown Lighting," Proc. Int'l Conf. Computer Vision, pp. 1202-1209, 2003.
23. P. Sloan, J. Kautz, and J. Snyder, "Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments," ACM Trans. Graphics, vol. 21, no. 3, pp. 527-536, 2002.
24. I. Sato, Y. Sato, and K. Ikeuchi, "Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions," Proc. Int'l Conf. Computer Vision, pp. 875-882, 1999.
25. N. Wiener, Extrapolation, Interpolation and Smoothing of Stationary Time Series. MIT Press, 1942.
26. Z. Wen, Z. Liu, and T.S. Huang, "Face Relighting with Radiance Environment Maps," Proc. Conf. Computer Vision and Pattern Recognition, vol. II, pp. 158-165, 2003.
27. L. Zhang, G. Phocion, J. Samson, and S. Seitz, "Single View Modeling of Free-Form Scenes," J. Visualization and Computer Animation, vol. 13, no. 4, pp. 225-235, 2002.
28. L. Zhang, S. Weng, and D. Samaras, "Face Synthesis and Recognition from a Single Image under Arbitrary Unknown Lighting Using a Spherical Harmonic Basis Morphable Model," Proc. Conf. Computer Vision and Pattern Recognition, pp. 209-216, 2005.