Detailed full-body reconstructions of moving people from monocular RGB-D sequences

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 2300-2308

  Bogo, Federica ^a   Black, Michael J ^a   Loper, Matthew ^a,b   Romero, Javier ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b Industrial Lights and Magic   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DEFORMATION; IMAGE TEXTURE; TISSUE;

COMMERCIAL PRODUCTS; DEFORMABLE HEAD MODELS; DISPLACEMENT MAPS; HIGH RESOLUTION SCANS; LOWER RESOLUTION; PROFESSIONAL SYSTEMS; SOFT TISSUE DEFORMATION; UNCONSTRAINED MOTION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84973890954     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.265     Document Type: Conference Paper

References (39)

1. http: //bodysnapapp. com. 7
2. http: //chumpy. org. 6
3. https: //github. com/bodylabs/monocle. 4
4. http: //mocap. cs. cmu. edu. 4
5. https: //ps. is. Tuebingen. mpg. de/research- projects/bodies-from-kinect. 6, 7, 8
6. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis. SCAPE: Shape Completion and Animation of PEople. ACM Trans. on Graph., 24 (3): 408-416, 2005. 1, 3
7. F. Bogo, J. Romero, M. Loper, and M. J. Black. FAUST: Dataset and evaluation for 3D mesh registration. In CVPR, pages 3794-3801, 2014. 3, 5
8. W. Chang and M. Zwicker. Global registration of dynamic range scans for articulated model reconstruction. ACM Trans. on Graph., 30 (3): 187: 1-187: 9, 2011. 2
9. Y. Chen, Z. Liu, and Z. Zhang. Tensor-based human body modeling. In CVPR, pages 105-112, 2013. 1, 2
10. Y. Cui, W. Chang, T. Nöll, and D. Stricker. KinectAvatar: Fully automatic body capture using a single Kinect. In ACCV Workshops, pages 133-147, 2012. 1, 2
11. E. De Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun. Performance capture from sparse multi-view video. ACM Trans. on Graph., 27 (3): 98: 1-98: 10, 2008. 2
12. M. Dou, H. Fuchs, and J. Frahm. Scanning and tracking dynamic objects with commodity depth cameras. In ISMAR, pages 99-106, 2013. 2
13. J. Gall, C. Stoll, E. De Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel. Motion capture using joint skeleton tracking and surface estimation. In CVPR, pages 1746-1753, 2009. 2
14. M. Garland and P. Heckbert. Surface simplification using quadric error metrics. In SIGGRAPH, pages 209-216, 1997. 3
15. S. Geman and D. McClure. Statistical methods for tomographic image reconstruction. Bulletin of the International Statistical Institute, 52 (4): 5-21, 1987. 4
16. T. Helten, A. Baak, G. Bharaj, M. Müller, H.-P. Seidel, and C. Theobalt. Personalization and evaluation of a real-time depth-based full body tracker. In 3DV, pages 279-286, 2013. 2
17. D. Hirshberg, M. Loper, E. Rachlin, and M. J. Black. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In ECCV, pages 242-255, 2012. 3, 5
18. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera. In UIST, pages 559-568, 2011. 2
19. H. Li, B. Adams, L. Guibas, and M. Pauly. Robust singleview geometry and motion reconstruction. ACM Trans. on Graph., 28 (5): 175: 1-175: 10, 2009. 2, 8
20. H. Li, L. Luo, D. Vlasic, P. Peers, J. Popovic, M. Pauly, and S. Rusinkiewicz. Temporally coherent completion of dynamic shapes. ACM Trans. on Graph., 31 (1): 2: 1-2: 11, 2012. 2
21. H. Li, E. Vouga, A. Gudym, L. Luo, J. Barron, and G. Gusev. 3D self-portraits. ACM Trans. on Graph., 32 (6): 187: 1-187: 9, 2013. 1, 2, 7
22. M. Liao, Q. Zhang, H. Wang, R. Yang, and M. Gong. Modeling deformable objects from a single depth camera. In ICCV, pages 167-174, 2009. 2
23. M. Loper and M. J. Black. OpenDR: An approximate differentiable renderer. In ECCV, pages 154-169, 2014. 1, 6
24. M. Mikkelsen. Simulation of wrinkled surfaces revisited. Master's thesis, University of Copenhagen, 2008. 6
25. R. Newcombe, D. Fox, and S. Seitz. DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time. In CVPR, pages 343-352, 2015. 2
26. R. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon. KinectFusion: Real-time dense surface mapping and tracking. In ISMAR, pages 127-136, 2011. 2
27. J. Nocedal and S. Wright. Numerical optimization. Springer, 2006. 6
28. F. Perbet, S. Johnson, M.-T. Pham, and B. Stenger. Human body shape estimation using a multi-resolution manifold forest. In CVPR, pages 668-675, 2014. 1, 2
29. K. Robinette, H. Daanen, and E. Paquet. The CAESAR project: A 3-D surface anthropometry survey. In Int. Conf. on 3D Digital Imag. and Model., pages 380-386, 1999. 3
30. A. Shapiro, A. Feng, R. Wang, H. Li, M. Bolas, G. Medioni, and E. Suma. Rapid avatar capture and simulation using commodity depth sensors. Computer Animation and Virtual Worlds, 25 (3-4): 201-211, 2014. 1, 2
31. J. Starck and A. Hilton. Model-based multiple view reconstruction of people. In ICCV, pages 915-922, 2003. 2
32. J. Tong, J. Zhou, L. Liu, Z. Pan, and H. Yan. Scanning 3D full human bodies using Kinects. IEEE Trans. on Visualization and Computer Graphics, 18 (4): 643-650, 2012. 1, 2
33. D. Vlasic, P. Peers, I. Baran, P. Debevec, J. Popovic, S. Rusinkiewicz, and W. Matusik. Dynamic shape capture using multi-view photometric stereo. ACM Trans. on Graph., 28 (5): 174: 1-174: 11, 2009. 2
34. A. Weiss, D. Hirshberg, and M. J. Black. Home 3D body scans from noisy image and range data. In ICCV, pages 1951-1958, 2011. 1, 2
35. G. Ye, Y. Liu, N. Hasler, X. Ji, Q. Dai, and C. Theobalt. Performance capture of interacting characters with handheld Kinects. In ECCV, pages 828-841, 2012. 2
36. M. Zeng, J. Zheng, and X. Liu. Templateless quasi-rigid shape modeling with implicit loop-closure. In CVPR, pages 145-152, 2013. 2
37. Q. Zhang, B. Fu, M. Ye, and R. Yang. Quality dynamic human body modeling using a single low-cost depth camera. In CVPR, pages 676-683, 2014. 2, 7
38. Q. Zhou and V. Koltun. Color map optimization for 3D reconstruction with consumer depth cameras. ACM Trans. on Graph., 33 (4): 155: 1-155: 10, 2014. 2
39. M. Zollhöfer, M. Nießner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, C. Theobalt, and M. Stamminger. Real-time non-rigid reconstruction using an RGB-D camera. ACM Trans. on Graph., 33 (4): 156: 1-156: 12, 2014. 2, 8