Nonrigid Structure from Motion via Sparse Representation

IEEE Transactions on Cybernetics

Volumn 45, Issue 8, 2015, Pages 1401-1413

  Li, Kun ^a   Yang, Jingyu ^a   Jiang, Jianmin ^b  

^a TIANJIN UNIVERSITY   (China)

^b SHENZHEN UNIVERSITY   (China)

Author keywords

Matrix completion; nonrigid structure from motion (NR SFM); occlusion; sparse representation; wavelet basis

Indexed keywords

MATRIX COMPLETION; OCCLUSION; SPARSE REPRESENTATION; STRUCTURE FROM MOTION; WAVELET BASIS;

EID: 85027923663     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2351831     Document Type: Article

References (51)

1. G. Ye et al., "Free-viewpoint video of human actors using multiple handheld Kinects," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1370-1382, Oct. 2013.
2. K. Li, Q. Dai, W. Xu, J. Yang, and J. Jiang, "Three-dimensional motion estimation via matrix completion," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 539-551, Apr. 2012.
3. A. Y. Mulayim, U. Yilmaz, and V. Atalay, "Silhouette-based 3-D model reconstruction from multiple images," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 33, no. 4, pp. 582-591, Aug. 2003.
4. A. Barmpoutis, "Tensor body: Real-time reconstruction of the human body and avatar synthesis from RGB-D," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1347-1356, Oct. 2013.
5. M. Camplani, T. Mantecon, and L. Salgado, "Depth-color fusion strategy for 3-D scene modeling with Kinect," IEEE Trans. Cybern., vol. 43, no. 6, pp. 1560-1571, Dec. 2013.
6. M. Liao, Q. Zhang, H. Wang, R. Yang, and M. Gong, "Modeling deformable objects from a single depth camera," in Proc. 12th IEEE Int. Conf. Comput. Vis., Kyoto, Japan, Sep./Oct. 2009, pp. 167-174.
7. Y. Gao et al., "Less is more: Efficient 3-D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1007-1018, Oct. 2011.
8. Y. Gao et al., "Camera constraint-free view-based 3-D object retrieval," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2269-2281, Apr. 2012.
9. Y. Gao, M. Wang, D. Tao, R. Ji, and Q. Dai, "3-D object retrieval and recognition with hypergraph analysis," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4290-4303, Sep. 2012.
10. H. V. Le, "A structure-from-motion method for 3-D reconstruction of moving objects from multiple-view image sequences," in Proc. IEEE Int. Conf. Image Process., Oct. 2004, pp. 1955-1958.
11. C. Bregler, A. Hertzmann, and H. Biermann, "Recovering non-rigid 3D shape from image streams," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Hilton Head Island, SC, USA, 2000, pp. 690-696.
12. I. Akhter, Y. A. Sheikh, S. Khan, and T. Kanade, "Nonrigid structure from motion in trajectory space," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 41-48.
13. P. F. U. Gotardo and A. M. Martinez, "Computing smooth timetrajectories for camera and deformable shape in structure from motion with occlusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 2051-2065, Oct. 2011.
14. P. F. U. Gotardo and A. M. Martinez, "Non-rigid structure from motion with complementary rank-3 spaces," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Providence, RI, USA, 2011, pp. 3065-3072.
15. D. Jacobs, "Linear fitting with missing data for structure-from-motion," Comput. Vis. Image Underst., vol. 82, no. 1, pp. 57-81, 2001.
16. H. Jia and A. Martinez, "Low-rank matrix fitting based on subspace perturbation analysis with applications to structure from motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 841-854, May 2009.
17. N. Guilbert, A. Bartoli, and A. Heyden, "Affine approximation for direct batch recovery of Euclidian structure and motion from sparse data," Int. J. Comput. Vis., vol. 69, no. 3, pp. 317-333, 2006.
18. S. Olsen and A. Bartoli, "Implicit non-rigid structure-from-motion with priors," J. Math. Imaging Vis., vol. 31, no. 2, pp. 233-244, 2008.
19. J. Tardif, A. Bartoli, M. Trudeau, N. Guilbert, and S. Roy, "Algorithms for batch matrix factorization with application to structure-frommotion," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
20. R. Hartley and F. Schaffalitzky, "PowerFactorization: 3D reconstruction with missing or uncertain data," in Proc. Aust. Jpn. Adv. Workshop Comput. Vis., vol. 74, 2003, pp. 76-85.
21. M. Paladini et al., "Factorization for non-rigid and articulated structure using metric projections," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Miami, FL, USA, Jun. 2009, pp. 2898-2905.
22. L. Torresani, A. Hertzmann, and C. Bregler, "Non-rigid structurefrom- motion: Estimating shape and motion with hierarchical priors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 878-892, May 2008.
23. A. Buchanan and A. Fitzgibbon, "Damped Newton algorithms for matrix factorization with missing data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Jun. 2005, pp. 316-322.
24. P. Chen, "Optimization algorithms on subspaces: Revisiting missing data problem in low-rank matrix," Int. J. Comput. Vis., vol. 80, no. 1, pp. 125-142, 2008.
25. E. J. Candès and B. Recht, "Exact matrix completion via convex optimization," Found. Comput. Math., vol. 9, no. 6, pp. 717-772, 2009.
26. E. J. Candès and Y. Plan, "Matrix completion with noise," Proc. IEEE, vol. 98, no. 6, pp. 925-936, Jun. 2010.
27. J. Fortuna and A. M. Martinez, "Rigid structure from motion from a blind source separation perspective," Int. J. Comput. Vis., vol. 88, no. 3, pp. 404-424, 2012.
28. P. Chen and D. Suter, "Recovering the missing components in a large noisy low-rank matrix: Application to SFM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 1051-1063, Aug. 2004.
29. A. Buchanan and A. Fitzgibbon, "Damped Newton algorithms for matrix factorization with missing data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Washington, DC, USA, 2005, pp. 316-322.
30. N. Snavely, S. M. Seitz, and R. Szeliski, "Modeling the world from internet photo collections," Int. J. Comput. Vis., vol. 80, no. 2, pp. 189-210, Nov. 2008.
31. S. Agarwal, N. Snavely, I. Simon, S. Seitz, and R. Szeliski, "Building Rome in a day," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 72-79.
32. C. Wu, S. Agarwal, B. Curless, and S. Seitz, "Multicore bundle adjustment," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Providence, RI, USA, 2011, pp. 3057-3064.
33. J. Xiao, J. Chai, and T. Kanade, "A closed-form solution to nonrigid shape and motion recovery," Int. J. Comput. Vis., vol. 67, no. 2, pp. 233-246, 2006.
34. L. Torresani, D. B. Yang, E. J. Alexander, and C. Bregler, "Tracking and modeling non-rigid objects with rank constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2001, vol. 1, pp. 493-500.
35. L. Torresani, A. Hertzmann, and C. Bregler, "Learning non-rigid 3D shape from 2D motion," in Proc. Adv. Neural Inf. Process. Syst., 2004, pp. 1-8.
36. A. Bartoli et al., "Coarse-to-fine low-rank structure-from-motion," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Anchorage, AK, USA, Jun. 2008, pp. 1-8.
37. V. Rabaud and S. Belongie, "Re-thinking non-rigid structure from motion," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Anchorage, AK, USA, 2008, pp. 1-8.
38. A. Del Bue, F. Smeraldi, and L. Agapito, "Non-rigid structure from motion using ranklet-based tracking and non-linear optimization," Image Vis. Comput., vol. 25, no. 3, pp. 297-310, 2007.
39. H. Park, T. Shiratori, I. Matthews, and Y. Sheikh, "3D reconstruction of a moving point from a series of 2D projections," in Proc. Eur. Conf. Comput. Vis., Heraklion, Greece, 2010, pp. 158-171.
40. Y. Zhu, M. Cox, and S. Lucey, "3D motion reconstruction for real-world camera motion," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 1-8.
41. J. Shi and C. Tomasi, "Good features to track," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Seattle, WA, USA, 1994, pp. 593-600.
42. M. Fazel, H. Hindi, and S. Boyd, "Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices," in Proc. Amer. Control Conf., Denver, CO, USA, 2003, pp. 2156-2162.
43. S. Ma, D. Goldfarb, and L. Chen, "Fixed point and Bregman iterative methods for matrix rank minimization," Math. Program., vol. 128, no. 1, pp. 321-353, 2011.
44. J. Gao, H. Sultan, J. Hu, and W. Tung, "Denoising nonlinear time series by adaptive filtering and wavelet shrinkage: A comparison," IEEE Signal Process. Lett., vol. 17, no. 3, pp. 237-240, Mar. 2010.
45. J. Yang, Y. Wang, W. Xu, and Q. Dai, "Image coding using dual-tree discrete wavelet transform," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1555-1569, Sep. 2008.
46. Y. Xu, X. Yang, H. Ling, and H. Ji, "A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), San Francisco, CA, USA, Jun. 2010, pp. 161-168.
47. J. R. Magnus and H. Neudecker, Matrix Differential Calculus With Applications in Statistics and Econometrics. New York, NY, USA: Wiley, 1988.
48. O. C. Hamsici, P. F. Gotardo, and A. M. Martinez, "Learning spatiallysmooth mappings in non-rigid structure from motion," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 260-273.
49. Y. Dai, H. Li, and M. He, "A simple prior-free method for non-rigid structure-from-motion factorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2018-2025.
50. L. Ding and A. M. Martinez, "Modelling and recognition of the linguistic components in American Sign Language," Image Vis. Comput., vol. 27, no. 12, pp. 1826-1844, 2009.
51. N. G. Kingsbury, "The dual-tree complex wavelet transform: A new technique for shift invariance and directional filters," in Proc. IEEE Digit. Signal Process. Workshop, vol. 86. 1998, pp. 120-131.