Quasi-perspective projection model: Theory and application to structure and motion factorization from uncalibrated image sequences

International Journal of Computer Vision

Volumn 87, Issue 3, 2010, Pages 213-234

  Wang, Guanghui ^a,b   Wu, Q M Jonathan ^a  

^a UNIVERSITY OF WINDSOR   (Canada)

^b INSTITUTE OF AUTOMATION   (China)

Author keywords

Computational models of vision; Euclidean reconstruction; Imaging geometry; Matrix factorization; Quasi perspective projection; Singular value decomposition; Structure from motion

Indexed keywords

COMPUTATIONAL MODEL; COMPUTATIONAL MODELS OF VISION; EUCLIDEAN RECONSTRUCTION; IMAGING GEOMETRY; MATRIX FACTORIZATIONS; PERSPECTIVE PROJECTIONS; SINGULAR VALUES;

CAMERAS; COMPUTATIONAL GEOMETRY; ERROR ANALYSIS; FACTORIZATION; IMAGE RECONSTRUCTION; LIGHT MEASUREMENT; REPAIR; RIGID STRUCTURES; ROTATION; SINGULAR VALUE DECOMPOSITION; STEREO VISION;

THREE DIMENSIONAL;

EID: 77951204176     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-009-0267-4     Document Type: Article

References (43)

1. Bascle, B., & Blake, A. (1998). Separability of pose and expression in facial tracing and animation. In Proceedings of the international conference on computer vision (pp. 323-328) 1998.
2. Brand, M. (2001). Morphable 3D models from video. In Proceedings of IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 456-463) 2001.
3. Brand, M. (2005). A direct method for 3D factorization of nonrigid motion observed in 2d. In Proceedings of IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 122-128) 2005.
4. Bregler, C., Hertzmann, A., & Biermann, H. (2000). Recovering non-rigid 3D shape from image streams. In Proceedings of IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 690-696) 2000.
5. Buchanan, A. M., & Fitzgibbon, A. W. (2005). Damped newton algorithms for matrix factorization with missing data. In Proceedings of IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 316-322) 2005.
6. P. Chen 2008 Optimization algorithms on subspaces: revisiting missing data problem in low-rank matrix International Journal of Computer Vision 80 1 125 142 10.1007/s11263-008-0135-7
7. S. Christy R. Horaud 1996 Euclidean shape and motion from multiple perspective views by affine iterations IEEE Transactions on Pattern Analysis and Machine Intelligence 18 11 1098 1104 10.1109/34.544079
8. J. Costeira T. Kanade 1998 A multibody factorization method for independent moving objects International Journal of Computer Vision 29 3 159 179 10.1023/A:1008000628999
9. Del Bue, A., Smeraldi, F., & de Agapito, L. (2004). Non-rigid structure from motion using nonparametric tracking and non-linear optimization. In IEEE workshop in articulated and nonrigid motion ANM04, held in conjunction with CVPR2004 (pp. 8-15), June 2004.
10. Del Bue, A., Lladó, X., & de Agapito, L. (2006). Non-rigid metric shape and motion recovery from uncalibrated images using priors. In Proceedings of IEEE conference on computer vision and pattern recognition (Vol. 1, pp. 1191-1198) 2006.
11. Han, M., & Kanade, T. (2000). Creating 3D models with uncalibrated cameras. In Proceedings of IEEE computer society workshop on the application of computer vision (WACV2000), December 2000.
12. R. Hartley 1997 Kruppa's equations derived from the fundamental matrix IEEE Transactions on Pattern Analysis and Machine Intelligence 19 2 133 135 10.1109/34.574792 1438625
13. Hartley, R., & Schaffalizky, F. (2003). Powerfactorization: 3D reconstruction with missing or uncertain data. In Australia-Japan advanced workshop on computer vision, 2003.
14. Hartley, R., & Vidal, R. (2008). Perspective nonrigid shape and motion recovery. In ECCV (1), Lecture notes in computer science : Vol. 5302 (pp. 276-289). Berlin: Springer.
15. Hartley, R., & Zisserman, A. (2004). Multiple view geometry in computer vision (2nd edn.). Cambridge: Cambridge University Press.
16. Heyden, A., & Åström, K. (1997) Euclidean reconstruction from image sequences with varying and unknown focal length and principal point. In IEEE conference on computer vision and pattern recognition (pp. 438-443) 1997.
17. A. Heyden R. Berthilsson G. Sparr 1999 An iterative factorization method for projective structure and motion from image sequences Image and Vision Computing 17 13 981 991 10.1016/S0262-8856(99)00002-5 (Pubitemid 30505638)
18. Li, T., Kallem, V., Singaraju, D., & Vidal, R. (2007). Projective factorization of multiple rigid-body motions. In IEEE conference on computer vision and pattern recognition, 2007.
19. Q. Luong O. Faugeras 1997 Self-calibration of a moving camera from point correspondences and fundamental matrices International Journal of Computer Vision 22 3 261 289 10.1023/A:1007982716991
20. Mahamud, S., & Hebert, M. (2000). Iterative projective reconstruction from multiple views. In IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 430-437) 2000.
21. S. Maybank O. Faugeras 1992 A theory of self-calibration of a moving camera International Journal of Computer Vision 8 2 123 151 10.1007/BF00127171
22. J. Oliensis R. Hartley 2007 Iterative extensions of the Sturm/Triggs algorithm: convergence and nonconvergence IEEE Transactions on Pattern Analysis and Machine Intelligence 29 12 2217 2233 10.1109/TPAMI.2007.1132 (Pubitemid 350124069)
23. C. Poelman T. Kanade 1997 A paraperspective factorization method for shape and motion recovery IEEE Transactions on Pattern and Analysis and Machine Intelligence 19 3 206 218 10.1109/34.584098 (Pubitemid 127767374)
24. M. Pollefeys R. Koch L. Van Gool 1999 Self-calibration and metric reconstruction in spite of varying and unknown intrinsic camera parameters International Journal of Computer Vision 32 1 7 25 10.1023/A:1008109111715
25. L. Quan 1996 Self-calibration of an affine camera from multiple views International Journal of Computer Vision 19 1 93 105 10.1007/BF00131149
26. Rabaud, V., & Belongie, S. (2008). Re-thinking non-rigid structure from motion. In IEEE conference on computer vision and pattern recognition, 2008.
27. Sturm, P. F., & Triggs, B. (1996). A factorization based algorithm for multi-image projective structure and motion. In European conference on computer vision (2) (pp. 709-720) 1996.
28. C. Tomasi T. Kanade 1992 Shape and motion from image streams under orthography: a factorization method International Journal of Computer Vision 9 2 137 154 10.1007/BF00129684
29. P. H. S. Torr A. Zisserman S. J. Maybank 1998 Robust detection of degenerate configurations while estimating the fundamental matrix Computer Vision and Image Understanding 71 3 312 333 10.1006/cviu.1997.0559
30. Torresani, L., Yang, D. B., Alexander, E. J., & Bregler, C. (2001). Tracking and modeling non-rigid objects with rank constraints. In IEEE conference on computer vision and pattern recognition (Vol. 1, pp. 493-500) 2001.
31. L. Torresani A. Hertzmann C. Bregler 2008 Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors IEEE Transactions on Pattern Analysis and Machine Intelligence 30 5 878 892 10.1109/TPAMI.2007.70752 (Pubitemid 351486755)
32. Triggs, B. (1996). Factorization methods for projective structure and motion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 845-851). San Francisco, California, USA, 1996.
33. Vidal, R., & Abretske, D. (2006). Nonrigid shape and motion from multiple perspective views. In European conference on computer vision (2). Lecture notes in computer science : Vol. 3952 (pp. 205-218). Berlin: Springer.
34. R. Vidal R. Tron R. Hartley 2008 Multiframe motion segmentation with missing data using powerfactorization and GPCA International Journal of Computer Vision 79 1 85 105 10.1007/s11263-007-0099-z (Pubitemid 351578661)
35. Wang, G. (2006). A hybrid system for feature matching based on SIFT and epipolar constraints. (Tech. Rep.). Department of Electrical and Computer Engineering, University of Windsor.
36. G. Wang H.-T. Tsui J. Wu 2008 Rotation constrained power factorization for structure from motion of nonrigid objects Pattern Recognition Letters 29 1 72 80 10.1016/j.patrec.2007.09.004 (Pubitemid 350026664)
37. G. Wang Q. J. Wu 2008 Stratification approach for 3D euclidean reconstruction of nonrigid objects from uncalibrated image sequences IEEE Transactions on Systems, Man, and Cybernetics, Part B 38 1 90 101 10.1109/TSMCB.2007.910534 (Pubitemid 351285017)
38. Wang, G., & Wu, J. (2008b). Quasi-perspective projection with applications to 3D factorization from uncalibrated image sequences. In IEEE conference on computer vision and pattern recognition, 2008.
39. Wang, G., Wu, J., & Zhang, W. (2008). Camera self-calibration and three dimensional reconstruction under quasi-perspective projection. In Proceedings Canadian conference on computer and robot vision (pp. 129-136) 2008.
40. Xiao, J., & Kanade, T. (2005). Uncalibrated perspective reconstruction of deformable structures. In Proceedings of the international conference on computer vision (Vol. 2, pp. 1075-1082) 2005.
41. J. Xiao J. Chai T. Kanade 2006 A closed-form solution to non-rigid shape and motion recovery International Journal of Computer Vision 67 2 233 246 10.1007/s11263-005-3962-9
42. Yan, J., & Pollefeys, M. (2005). A factorization-based approach to articulated motion recovery. In IEEE conference on computer vision and pattern recognition (2) (pp. 815-821) 2005.
43. J. Yan M. Pollefeys 2008 A factorization-based approach for articulated nonrigid shape, motion and kinematic chain recovery from video IEEE Transactions on Pattern Analysis and Machine Intelligence 30 5 865 877 10.1109/TPAMI.2007. 70739 (Pubitemid 351486754)