Dense multibody motion estimation and reconstruction from a handheld camera

ISMAR 2012 - 11th IEEE International Symposium on Mixed and Augmented Reality 2012, Science and Technology Papers

Volumn , Issue , 2012, Pages 31-40

  Roussos, Anastasios ^a   Russell, Chris ^a   Garg, Ravi ^a   Agapito, Lourdes ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

3D RECONSTRUCTION; AR APPLICATION; CAMERA TRACKING; CONTINUOUS OPTIMIZATION; DENSE DEPTH MAP; DEPTH ESTIMATION; DYNAMIC SCENES; FIELDS OF VIEWS; GRAPH-CUT; HAND-HELD CAMERAS; HILL CLIMBING; INDEPENDENT MOTIONS; INFERENCE METHODS; MARKER-FREE; MOTION SEGMENTATION; MOVING OBJECTS; MULTI-BODY; PRIOR KNOWLEDGE; REAL-WORLD SCENARIO; RIGID MOTION ESTIMATION; RIGID OBJECTS; RIGID TRANSFORMATIONS; STATE OF THE ART; TRACKING APPROACHES; VARIATIONAL APPROACHES;

AUGMENTED REALITY; OPTIMIZATION; PORTABLE EQUIPMENT; VARIATIONAL TECHNIQUES;

MOTION ESTIMATION;

EID: 84873542206     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2012.6402535     Document Type: Conference Paper

References (43)

1. K. Alahari, P. Kohli, and P. H. S. Torr. Dynamic hybrid algorithms for map inference in discrete mrfs. IEEE Trans. Pattern Anal. Mach. Intell., 32(10):1846-1857, 2010.
2. S. Baker and I. Matthews. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision, 56(3):221-255, March 2004.
3. M. Bleyer, C. Rother, and P. Kohli. Surface stereo with soft segmentation. In CVPR, pages 1570-1577, 2010.
4. Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. PAMI, 23, 2001.
5. A. Chambolle and T. Pock. A first-order primal-dual algorithm for convex problems with applications to imaging. JMIV, 2011.
6. J. Costeira and T. Kanade. A multi-body factorization method for motion analysis. In ICCV, pages 1071-1076, 1995.
7. D. Cremers, T. Pock, K. Kolev, and A. Chambolle. Convex relaxation techniques for segmentation, stereo and multiview reconstruction. In Markov Random Fields for Vision and Image Processing. MIT Press, 2011.
8. A. Delong, A. Osokin, H. N. Isack, and Y. Boykov. Fast approximate energy minimization with label costs. IJCV, 2010.
9. J. Fayad, C. Russell, and L. Agapito. Automated articulated structure and 3d shape recovery from point correspondences. In IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain, November 2011.
10. A. Fitzgibbon and A. Zisserman. Multibody structure and motion: 3-d reconstruction of independently moving objects. In European Conference on Computer Vision (ECCV), Dublin, Ireland, 2000.
11. Y. Furukawa and J. Ponce. Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell., 32(8):1362-1376, 2010.
12. R. Garg, A. Roussos, and L. de Agapito. Robust trajectory-space tv-l1 optical flow for non-rigid sequences. In EMMCVPR, 2011.
13. J.-Y. Guillemaut and A. Hilton. Joint multi-layer segmentation and reconstruction for free-viewpoint video applications. International Journal of Computer Vision, 93(1):73-100, 2011.
14. P. J. Huber. Robust Statistics. John Wiley & Sons, 1981.
15. H. Isack and Y. Boykov. Energy-based geometric multi-model fitting. International Journal of Computer Vision (IJCV), 97(2), 2012.
16. G. Klein and D. Murray. Parallel tracking and mapping for small ar workspaces. In International Symposium on Mixed and Augmented Reality (ISMAR), 2007.
17. V. Kolmogorov and C. Rother. C.: Comparison of energy minimization algorithms for highly connected graphs. in: Eccv. In In Proc. ECCV, pages 1-15, 2006.
18. A. Kundu, K. M. Krishna, and C. V. Jawahar. Realtime multibody visual slam with a smoothly moving monocular camera. In IEEE International Conference on Computer Vision. ICCV, 2011.
19. L. Ladicky, C. Russell, P. Kohli, and P. Torr. Graph cut based inference with co-occurrence statistics. In ECCV, 2010.
20. R. Newcombe, S. Lovegrove, and A. Davison. DTAM: Dense tracking and mapping in real-time. In ICCV, 2011.
21. K. Ozden, K. Schindler, and L. van Gool. Multibody structure-from-motion in practice. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2010.
22. Q. Pan, C. Arth, E. Rosten, G. Reitmayr, and T. Drummond. Rapid scene reconstruction on mobile phones from panoramic images. In International Symposium on Mixed and Augmented Reality (ISMAR), 2011.
23. Q. Pan, G. Reitmayr, and T. Drummond. Interactive model reconstruction with user guidance. In International Symposium on Mixed and Augmented Reality (ISMAR), 2009.
24. C. Pirchheim and G. Reitmayr. Homography-based planar mapping and tracking for mobile phones. In International Symposium on Mixed and Augmented Reality (ISMAR), 2011.
25. M. Pollefeys, D. Nistér, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S. J. Kim, P. Merrell, C. Salmi, S. N. Sinha, B. Talton, L.Wang, Q. Yang, H. Stewénius, R. Yang, G.Welch, and H. Towles. Detailed real-time urban 3d reconstruction from video. International Journal of Computer Vision, 78(2-3):143-167, 2008.
26. S. Rao, R. Tron, R. Vidal, and Y. Ma. Motion segmentation in the presence of outlying, incomplete or corrupted trajectories. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 32(10):1832-1845, 2010.
27. L. Rudin, S. Osher, and E. Fatemi. Nonlinear total variation based noise removal algorithms. Physica D, 60:259-268, 1992.
28. K. Schindler, D. Suter, and H. Wang. A model selection framework for multibody structure-and-motion of image sequences. International Journal of Computer Vision (IJCV), 79(2):159-177, 2008.
29. S. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York, USA, June 2006.
30. N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In SIGGRAPH Conference Proceedings, pages 835-846, New York, NY, USA, 2006. ACM Press.
31. F. Steinbrücker, J. Sturm, and D. Cremers. Real-time visual odometry from dense rgb-d images. In Workshop on Live Dense Reconstruction with Moving Cameras at ICCV, 2011.
32. F. Steinbruecker, T. Pock, and D. Cremers. Large displacement optical flow computation without warping. In ICCV, 2009.
33. J. Stuehmer, S. Gumhold, and D. Cremers. Real-time dense geometry from a handheld camera. In Pattern Recognition (Proc. DAGM), pages 11-20, September 2010.
34. C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: A factorization approach. IJCV, 1992.
35. R. Tron and R. Vidal. A benchmark for the comparison of 3d motion algorithms. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, USA, June 2007.
36. R. Vidal, Y. Ma, and S. Sastry. Generalized principal component analysis (gpca). In CVPR, pages 621-628, 2003.
37. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg. Pose tracking from natural features on mobile phones. In International Symposium on Mixed and Augmented Reality (ISMAR), 2008.
38. M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof. Anisotropic Huber-L1 optical flow. In BMCV, 2009.
39. J. Yuan and Y. Boykov. Tv-based multi-label image segmentation with label cost prior. In F. Labrosse, R. Zwiggelaar, Y. Liu, and B. Tiddeman, editors, BMVC, pages 1-12. British Machine Vision Association, 2010.
40. C. Zach. Fast and high quality fusion of depth maps. In International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT), 2008.
41. C. Zach, T. Pock, and H. Bischof. A duality based approach for realtime TV-L1 optical flow. In Pattern Recognition (Proc. DAGM), pages 214-223, 2007.
42. G. Zhang, J. Jia, and H. Bao. Simultaneous multi-body stereo and segmentation. In IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain, November 2011.
43. G. Zhang, X. Qin, W. Hua, T.-T. Wong, P.-A. Heng, and H. Bao. Robust metric reconstruction from challenging video sequences. In CVPR, 2007.