Inverse compositional estimation of 3D pose and lighting in dynamic scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 7, 2008, Pages 1300-1307

  Xu, Yilei ^a   Roy Chowdhury, Amit K ^a  

^a University of California Riverside   (United States)

Author keywords

Motion; Video analysis

Indexed keywords

COMPUTATIONAL METHODS; CONVERGENCE OF NUMERICAL METHODS; ESTIMATION; IMAGING TECHNIQUES; INVERSE PROBLEMS; LIGHTING; MECHANICS; PHOTOGRAPHY; REAL TIME SYSTEMS; VIDEO RECORDING;

COMPUTATIONAL BURDEN; COMPUTATIONAL SAVINGS; CONVERGENCE (MATHEMATICS); DYNAMIC SCENES; EXPERIMENTAL ANALYSIS; MULTIPLE VIDEO SEQUENCES; RIGID OBJECTS; SIGNIFICANT REDUCTION; SPEED UPS; THREE DIMENSIONAL (3D) MOTION; TIME-VARYING; WARPING FUNCTIONS;

DYNAMICS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; ILLUMINATION; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; LIGHTING; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 45349102065     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2008.81     Document Type: Article

References (22)

1. G.D. Hager and P.N. Belhumeur, "Efficient Region Tracking with Parametric Models of Geometry and Illumination," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp. 1025-1039, Oct. 1998.
2. D. Freedman and M. Turek, "Illumination-Invariant Tracking via Graph Cuts," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
3. H. Jin, P. Favaro, and S. Soatto, "Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination," Proc. Eighth IEEE Int'l Conf. Computer Vision, 2001.
4. Y. Xu and A. Roy-Chowdhury, "Integrating Motion, Illumination and Structure in Video Sequences, with Applications in Illumination-Invariant Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 5, pp. 793-807, May 2007.
5. R. Basri and D.W. Jacobs, "Lambertian Reflectance and Linear Subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 25, no. 2, pp. 218-233, Feb. 2003.
6. R. Ramamoorthi and P. Hanrahan, "On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of a Convex Lambertian Object," J. Optical Soc. Am. A, vol. 18, no. 10, Oct. 2001.
7. S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: A Unifying Framework," Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-255, Mar. 2004.
8. B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision (DARPA)," Proc. DARPA Image Understanding Workshop, Apr. 1981.
9. H.-Y. Shum and R. Szeliski, "Construction of Panoramic Image Mosaics with Global and Local Alignment," Int'l J. Computer Vision, vol. 16, no. 1, pp. 63-84, 2000.
10. I. Matthews and S. Baker, "Active Appearance Models Revisited," Int'l J. Computer Vision, vol. 60, no. 2, pp. 135-164, Nov. 2004.
11. S. Romdhani and T. Vetter, "Efficient, Robust and Accurate Fitting of a 3D Morphable Model," Proc. 10th IEEE Int'l Conf. Computer Vision, 2003.
12. A. Bartoli, "Groupwise Geometric and Photometric Direct Image Registration," Proc. Seventh British Machine Vision Conf., Sept. 2006.
13. V. Blanz and T. Vetter, "Face Recognition Based on Fitting a 3D Morphable Model," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
14. P. Eisert and B. Girod, "Illumination-Compensated Motion Estimation for Analysis Synthesis Coding," 3D Image Analysis and Synthesis, pp. 61-66, 1996.
15. M. Gouiffes, C. Collewet, C. Fernandez-Maloigne, and A. Trémeau, "Feature Points Tracking: Robustness to Specular Highlights and Lighting Changes," Proc. Ninth European Conf. Computer Vision, May 2006.
16. G. Finlayson, S. Hordley, and M. Drew, Removing Shadows from Images 2002.
17. D. Pizarro and A. Bartoli, "Shadow Resistant Direct Image Registration," Proc. 15th Scandinavian Conf. Image Analysis, June 2007.
18. J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994.
19. A. Kale and C. Jaynes, "A Joint Illumination and Shape Model for Visual Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition pp. 602-609, 2006.
20. L.D. Lathauwer, B.D. Moor, and J. Vandewalle, "A Multillinear Singular Value Decomposition," SIAM J. Matrix Analysis and Applications, vol. 21, no. 4, pp. 1253-1278, 2000.
21. R. Szeliski and S.B. Kang, "Recovering 3D Shape and Motion from Image Streams Using Non-Linear Least Squares," J. Visual Comm. and Image Representation, vol. 5, no. 1, pp. 10-28, 1994.
22. R. Ramamoorthi, "Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, 2002.