Efficient ConvNet-based marker-less motion capture in general scenes with a low number of cameras

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 3810-3818

  Elhayek, A ^a   De Aguiar, E ^a   Jain, A ^b   Tompson, J ^b   Pishchulin, L ^a   Andriluka, M ^c   Bregler, C ^b   Schiele, B ^a   Theobalt, C ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b NEW YORK UNIVERSITY   (United States)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAMERAS; COMPUTER VISION; ITERATIVE METHODS; MOTION ANALYSIS; MUSCULOSKELETAL SYSTEM;

APPEARANCE-BASED MODELING; ARTICULATED JOINTS; CONVOLUTIONAL NETWORKS; KINEMATIC SKELETON; LOCAL OPTIMIZATIONS; MOTION TRACKING ALGORITHMS; POSE CONSTRAINTS; TEMPORAL STABILITY;

PATTERN RECOGNITION;

EID: 84952346859     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7299005     Document Type: Conference Paper

References (43)

1. S. Amin, M. Andriluka, M. Rohrbach, and B. Schiele. Multiview pictorial structures for 3d human pose estimation. In BMVC, 2013
2. M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2d human pose estimation: New benchmark and state of the art analysis. In IEEE CVPR, June 2014
3. M. Andriluka, S. Roth, and B. Schiele. Pictorial structures revisited: People detection and articulated pose estimation. In CVPR, 2009
4. A. Baak, M. Müller, G. Bharaj, H.-P. Seidel, and C. Theobalt. A data-driven approach for real-time full body pose reconstruction from a depth camera. In Proc. ICCV, pages 1092-1099, 2011
5. V. Belagiannis, S. Amin, M. Andriluka, B. Schiele, N. Navab, and S. Ilic. 3d pictorial structures for multiple human pose estimation. CVPR, IEEE, 2014
6. L. Bo and C. Sminchisescu. Twin Gaussian processes for structured prediction. IJCV, 87:28-52, 2010
7. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3d human pose annotations. In ICCV, 2009
8. M. Bray, E. Koller-Meier, and L. V. Gool. Smart particle filtering for high-dimensional tracking. CVIU, 106(1):116-129, 2007
9. T. Brox, B. Rosenhahn, J. Gall, and D. Cremers. Combined region and motion-based 3d tracking of rigid and articulated objects. TPAMI, 32:402-415, 2010
10. M. Burenius, J. Sullivan, and S. Carlsson. 3d pictorial structures for multiple view articulated pose estimation. In CVPR, 2013
11. X. Chen and A. Yuille. Articulated pose estimation by a graphical model with image dependent pairwise relations. NIPS, 2014
12. M. Dantone, J. Gall, C. Leistner, and L. V. Gool. Human pose estimation using body parts dependent joint regressors. In CVPR, 2013
13. M. Eichner and V. Ferrari. Better appearance models for pictorial structures. In BMVC, 2009
14. A. Elhayek, C. Stoll, N. Hasler, K. I. Kim, H.-P. Seidel, and C. Theobaltl. Spatio-temporal motion tracking with unsynchronized cameras. In Proc. CVPR, 2012
15. A. Elhayek, C. Stoll, N. Hasler, K. I. Kim, and C. Theobaltl. Outdoor human motion capture by simultaneous optimization of pose and camera parameters. In Proc. CGF, 2014
16. P. F. Felzenszwalb and D. P. Huttenlocher. Pictorial structures for object recognition. International Journal of Com-puter Vision, 61(1), 2005
17. M. A. Fischler and R. Elschlager. The representation and matching of pictorial structures. Computers, IEEE Transac-tions on, C-22(1), Jan 1973
18. J. Gall, B. Rosenhahn, T. Brox, and H.-P. Seidel. Optimization and filtering for human motion capture-a multi-layer framework. IJCV, 87:75-92, 2010
19. J. Gall, B. Rosenhahn, and H.-P. Seidel. Drift-free tracking of rigid and articulated objects. In CVPR, 2008
20. G. Gkioxari, P. Arbelaez, L. Bourdev, and J. Malik. Articulated pose estimation using discriminative armlet classifiers. In CVPR, 2013
21. N. Hasler, B. Rosenhahn, T. Thormählen, M. Wand, J. Gall, and H.-P. Seidel. Markerless motion capture with unsynchronized moving cameras. In CVPR, 2009
22. A. Jain, J. Tompson, M. Andriluka, G. Taylor, and C. Bregler. Learning human pose estimation features with convolutional networks. In ICLR, 2014
23. A. Jain, J. Tompson, Y. LeCun, and C. Bregler. Modeep: A deep learning framework using motion features for human pose estimation. ACCV, 2014
24. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceed-ings of the IEEE, 86(11):2278-2324, 1998
25. C.-S. Lee and A. Elgammal. Coupled visual and kinematic manifold models for tracking. IJCV, 87:118-139, 2010
26. R. Li, T.-P. Tian, S. Sclaroff, and M.-H. Yang. 3d human motion tracking with a coordinated mixture of factor analyzers. IJCV, 87:170-190, 2010
27. T. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. CVIU, 104(2):90-126, 2006
28. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML, pages 807-814. Omnipress, 2010
29. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele. Poselet conditioned pictorial structures. In CVPR, 2013
30. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele. Strong appearance and expressive spatial models for human pose estimation. In ICCV, 2013
31. G. Pons-Moll, A. Baak, J. Gall, L. Leal-Taixe, M. Mueller, H.-P. Seidel, and B. Rosenhahn. Outdoor human motion capture using inverse kinematics and von Mises-Fisher sampling. In Proc. ICCV, 2011
32. R. Poppe. Vision-based human motion analysis: An overview. CVIU, 108(1-2):4-18, 2007
33. B. Sapp and B. Taskar. Modec: Multimodal decomposable models for human pose estimation. In CVPR, 2013
34. T. Shiratori, H. S. Park, L. Sigal, Y. Sheikh, and J. K. Hodgins. Motion capture from body-mounted cameras. ACM Trans. Graph., 30(4):31:1-31:10, July 2011
35. L. Sigal, A. Balan, and M. Black. Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. IJCV, 87:4-27, 2010
36. L. Sigal, M. Isard, H. Haussecker, and M. Black. Looselimbed people: Estimating 3d human pose and motion using non-parametric belief propagation. International Journal of Computer Vision, 98(1):15-48, 2012
37. S. Sridhar, A. Oulasvirta, and C. Theobalt. Interactive markerless articulated hand motion tracking using rgb and depth data. In IEEE ICCV, 2013
38. C. Stoll, N. Hasler, J. Gall, H.-P. Seidel, and C. Theobalt. Fast articulated motion tracking using a sums of gaussians body model. In ICCV, 2011
39. J. Tompson, A. Jain, Y. LeCun, and C. Bregler. Join training of a convolutional network and a graphical model for human pose estimation. NIPS, 2014
40. A. Toshev and C. Szegedy. Deeppose: Human pose estimation via deep neural networks. In CVPR, 2014
41. H. Wendland. Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree. In Adv. in Comput. Math., 1995
42. Y. Yang and D. Ramanan. Articulated pose estimation with flexible mixtures-of-parts. In CVPR, 2011
43. G. Ye, Y. Liu, N. Hasler, X. Ji, Q. Dai, and C. Theobalt. Performance capture of interacting characters with handheld kinects. In ECCV, 2012.