Non-rigid metric reconstruction from perspective cameras

Image and Vision Computing

Volumn 28, Issue 9, 2010, Pages 1339-1353

  Lladó, Xavier ^a   Del Bue, Alessio ^b   Agapito, Lourdes ^c  

^a UNIVERSITY OF GIRONA   (Spain)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Deformable model; Motion segmentation; Non linear optimization; Non rigid structure from motion; Self calibration

Indexed keywords

CALIBRATION; CAMERAS; DEFORMATION; MOTION ESTIMATION; OPTIMIZATION; RIGIDITY; THREE DIMENSIONAL;

DEFORMABLE MODELS; MOTION SEGMENTATION; NON-LINEAR OPTIMIZATION; NON-RIGID; SELF CALIBRATION;

RIGID STRUCTURES;

EID: 77955305010     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2010.01.014     Document Type: Article

References (53)

1. H. Aanæs, F. Kahl, Estimation of deformable structure and motion, in: Workshop on Vision and Modelling of Dynamic Scenes, Copenhagen, Denmark, 2002.
2. A. Bartoli, V. Gay-Bellile, U. Castellani, J. Peyras, S. Olsen, P. Sayd, Coarse-to-fine low-rank structure-from-motion, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008.
3. A. Bartoli, S. Olsen, A batch algorithm for implicit non-rigid shape and motion recovery, in: Proc. Workshop on Dynamical Vision, Beijing, 2006, pp. 257-269.
4. M. Brand, Morphable models from video, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, December 2001, pp. 456-463.
5. M. Brand, A direct method for 3d factorization of nonrigid motion observed in 2d, in: CVPR, vol. 2, 2005, pp. 122-128.
6. C. Bregler, A. Hertzmann, H. Biermann, Recovering non-rigid 3d shape from image streams, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head, South Carolina, June 2000, pp. 690-696.
7. H. Chen, P. Meer, Robust regression with projection based m-estimators, in: Proc. 9th International Conference on Computer Vision, Nice, France, vol. 2, 2003, pp. 878-885.
8. S. Christy, and R. Horaud Euclidean shape and motion from multiple perspective views by affine iterations IEEE Transactions on Pattern Analysis and Machine Intelligence 18 11 1996 1098 1104
9. J.P. Costeira, and T. Kanade A multibody factorization method for independently moving objects International Journal of Computer Vision 29 3 1998 159 179
10. A. Del Bue, A factorization approach to structure from motion with shape priors, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008.
11. A. Del Bue, X. Lladó, L. Agapito, Non-rigid face modelling using shape priors, in: S. Gong, W. Zhao, X. Tang (Eds.), IEEE International Workshop on Analysis and Modelling of Faces and Gestures, Lecture Notes in Computer Science, vol. 3723, Springer-Verlag, 2005, pp. 96-107.
12. A. Del Bue, X. Lladó, L. Agapito, Non-rigid metric shape and motion recovery from uncalibrated images using priors, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, New York, New York, June 2006, pp. 1191-1198.
13. A. Del Bue, F. Smeraldi, and L. Agapito Non-rigid structure from motion using ranklet-based tracking and non-linear optimization Image and Vision Computing 25 3 2007 297 310
14. L. Fan, T. Pylvanainen, Robust scale estimation from ensemble inlier sets for random sample consensus methods, in: Proc. 10th European Conference on Computer Vision, Marseille, France, Springer, 2008, pp. 182-195.
15. M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, in: M.A. Fischler, O. Firschein (Eds.), Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Los Altos, CA, 1987, pp. 726-740.
16. M. Han, T. Kanade, Reconstruction of a scene with multiple linearly moving objects, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head, South Carolina, June 2000, pp. 542-549.
17. R. Hartley, R. Vidal, Perspective nonrigid shape and motion recovery, in: Proc. 10th European Conference on Computer Vision, Marseille, France, 2008.
18. R.I. Hartley, F. Schaffalitzky, Powerfactorization: an approach to affine reconstruction with missing and uncertain data, in: Australia-Japan Advanced Workshop on Computer Vision, Adelaide, Australia, September 2003.
19. R.I. Hartley, and A. Zisserman Multiple View Geometry in Computer Vision 2000 Cambridge University Press
20. R.I. Hartley In defense of the eight-point algorithm IEEE Transactions on Pattern Analysis and Machine Intelligence 19 6 1997 580 593
21. A. Heyden, K.ström. Euclidean reconstruction from image sequences with varying and unknown focal length and principal point, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1997, pp. 438-443.
22. A. Heyden, R. Berthilsson, and G. Sparr An iterative factorization method for projective structure and motion from image sequences Image and Vision Computing 17 13 1999 981 991
23. K. Kanatani Motion segmentation by subspace separation: model selection and reliability evaluation International Journal of Image and Graphics 2 2 2002 179 197
24. K. Kanatani, and Y. Sugaya Factorization without factorization: complete recipe Memories of the Faculty of Engineering, Okayama University 38 1-2 2004 61 72
25. T. Kim, K.-S. Hong, Estimating approximate shape and motion of deformable objects with a monocular view, in: Proc. Asian Conference on Computer Vision, Jeju Island, Korea, January 2004.
26. X. Lladó, A. Del Bue, L. Agapito, Euclidean reconstruction of deformable structure using a perspective camera with varying intrinsic parameters, in: Proc. International Conference on Pattern Recognition, Hong Kong, 2006, pp. 139-142.
27. S. Mahamud, M. Hebert, Iterative projective reconstruction from multiple views, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head, South Carolina, vol. 2, June 2000, pp. 430-437.
28. J. Oliensis, and R. Hartley Iterative extensions of the sturm/triggs algorithm: convergence and nonconvergence IEEE Transactions on Pattern Analysis and Machine Intelligence 29 12 2007 2217 2233
29. S. Olsen, A. Bartoli, Using priors for improving generalization in non-rigid structure-from-motion, in: Proc. 18th British Machine Vision Conference, Warwick, 2007.
30. Marco Paladini, Alessio Del Bue, Marko Stosic, Marija Dodig, Joao Xavier, Lourdes Agapito, Factorization for non-rigid and articulated structure using metric projections, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Miami Beach, Florida, 2009.
31. C.J. Poelman, T. Kanade, A paraperspective factorization method for shape and motion recovery, in: Proc. 3rd European Conference on Computer Vision, Stockholm, vol. 2, 1994, pp. 97-108.
32. M. Pollefeys, Self-Calibration and Metric 3D Reconstruction from Uncalibrated Image Sequences, PhD thesis, Katholieke Universiteit Leuven, Belgium, 1999.
33. M. Pollefeys, R. Koch, and L. Van Gool Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters International Journal of Computer Vision 32 1 1999 7 25
34. P. Sturm, B. Triggs, A factorization based algorithm for multi-image projective structure and motion, in: Proc. 4th European Conference on Computer Vision, Cambridge, April 1996, pp. 709-720.
35. W.K. Tang, Y.S. Hung, A factorization-based method for projective reconstruction with minimization of 2-d reprojection errors, in: Proc. of the 24th DAGM Symposium on Pattern Recognition, Springer-Verlag, London, UK, 2002, pp. 387-394.
36. C. Tomasi, and T. Kanade Shape and motion from image streams under orthography: a factorization approach International Journal of Computer Vision 9 2 1992 137 154
37. B.J. Tordoff, and D.W. Murray Guided-MLESAC: faster image transform estimation by using matching priors IEEE Transactions on Pattern Analysis and Machine Intelligence 27 10 2005 1523 1535
38. P.H.S. Torr, A.W. Fitzgibbon, and A. Zisserman The problem of degeneracy in structure and motion recovery from uncalibrated image sequences International Journal of Computer Vision 32 1 1999 27 44
39. P.H.S. Torr, and D. Murray The development and comparison of robust methods for estimating the fundamental matrix International Journal of Computer Vision 24 3 1997 271 300
40. L. Torresani, A. Hertzmann, and C. Bregler Learning non-rigid 3d shape from 2d motion Sebastian Thrun, Lawrence Saul, Bernhard Schölkopf, Advances in Neural Information Processing Systems, vol. 16 2004 MIT Press Cambridge, MA
41. L. Torresani, A. Hertzmann, and C. Bregler Non-rigid structure-from- motion: estimating shape and motion with hierarchical priors IEEE Transactions on Pattern Analysis and Machine Intelligence 30 5 2008
42. L. Torresani, D. Yang, E. Alexander, C. Bregler, Tracking and modeling non-rigid objects with rank constraints, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, December 2001, pp. 493-500.
43. B. Triggs, Factorization methods for projective structure and motion, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, pp. 845-851, 1996.
44. T. Ueshiba, F. Tomita, A factorization method for projective and euclidean reconstruction from multiple perspective views via iterative depth estimation, in: Proc. 5th European Conference on Computer Vision, Freiburg, Germany, vol. 1, 1998, pp. 296-310.
45. R. Vidal, D. Abretske, Nonrigid shape and motion from perspective views, in: Proc. 9th European Conference on Computer Vision, Graz, Austria, vol. 2, 2006, pp. 205-218.
46. R. Vidal, R. Hartley, Motion segmentation with missing data using powerfactorization and gpca, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, vol. 2, 2004, pp. 310-316.
47. G. Wang, H.T. Tsui, and Z. Hu Structure and motion of nonrigid object under perspective projection Pattern Recognition Letters 28 4 2007 507 515
48. G. Wang, H.T. Tsui, and Q.M.J. Wu Rotation constrained power factorization for structure from motion of nonrigid objects Pattern Recognition Letters 29 1 2008 72 80
49. G. Wang, and Q.M.J. Wu Stratification approach for 3-d euclidean reconstruction of nonrigid objects from uncalibrated image sequences IEEE Transactions on Systems Man and Cybernetics 38 1 2008 90 101
50. H. Wang, and D. Suter Robust adaptive-scale parametric model estimation for computer vision IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 2004 1459 1474
51. J. Xiao, J. Chai, T. Kanade, A closed-form solution to non-rigid shape and motion recovery, in: Proc. 8th European Conference on Computer Vision, Prague, Czech Republic, May 2004, pp. 573-587.
52. J. Xiao, T. Kanade, Uncalibrated perspective reconstruction of deformable structures, in: Proc. 10th International Conference on Computer Vision, Beijing, China, October 2005, pp. 1075-1082.
53. J. Yan, M. Pollefeys, A general framework for motion segmentation: independent, articulated, rigid, non-rigid, degenerate and non-degenerate, in: Proc. 9th European Conference on Computer Vision, Graz, Austria, vol. 4, 2006, pp. 94-106.