Unite the people: Closing the loop between 3D and 2D human representations

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 4704-4713

  Lassner, Christoph ^a,b   Romero, Javier ^c   Kiefel, Martin ^b   Bogo, Federica ^d   Black, Michael J ^b   Gehler, Peter V ^e  

^a Bernstein Center for Computational Neuroscience   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^c Body Labs Inc   (United States)

^d MICROSOFT   (United States)

^e UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION;

DISCRIMINATIVE MODELS; EXTENDED VERSIONS; FITTING PROCEDURE; HYBRID APPROACH; LANDMARK LOCATIONS; LEVEL OF DETAIL; RESEARCH PURPOSE; SHAPE ESTIMATION;

PATTERN RECOGNITION;

EID: 85030755161     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.500     Document Type: Conference Paper

References (45)

1. M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2D human pose estimation: New benchmark and state of the art analysis. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014.
2. P. Azad, T. Asfour, and R. Dillmann. Toward an unified representation for imitation of human motion on humanoids. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages 2558-2563, April 2007.
3. S. Bell, P. Upchurch, N. Snavely, and K. Bala. OpenSurfaces: A richly annotated catalog of surface appearance. ACM Trans. on Graphics (SIGGRAPH), 32(4), 2013.
4. F. Bogo, A. Kanazawa, C. Lassner, P. Gehler, J. Romero, and M. J. Black. Keep it smpl: Automatic estimation of 3d human pose and shape from a single image. In Proc. of the European Conference on Computer Vision (ECCV), pages 561-578. Springer, 2016.
5. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3d human pose annotations. In Proc. of the International Conference on Computer Vision (ICCV), sep 2009.
6. J. Charles, T. Pfister, D. Magee, D. Hogg, and A. Zisserman. Personalizing human video pose estimation. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
7. L.-C. Chen, Y. Yang, J. Wang, W. Xu, and A. L. Yuille. Attention to scale: Scale-aware semantic image segmentation. In Proc. of the 2016 IEEE Conference on Computer Vision (CVPR), 2016.
8. X. Chen, R. Mottaghi, X. Liu, S. Fidler, R. Urtasun, and A. Yuille. Detect what you can: Detecting and representing objects using holistic models and body parts. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
9. M. Dantone, J. Gall, C. Leistner, and L. van Gool. Body parts dependent joint regressors for human pose estimation in still images. Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2014.
10. P. Dollár, C. Wojek, B. Schiele, and P. Perona. Pedestrian detection: An evaluation of the state of the art. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 34(4):743-761, 2012.
11. A. Elhayek, E. de Aguiar, A. Jain, J. Tompson, L. Pishchulin, M. Andriluka, C. Bregler, B. Schiele, and C. Theobalt. Efficient convnet-based marker-less motion capture in general scenes with a low number of cameras. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3810-3818. IEEE, 2015.
12. M. Everingham, L. Gool, C. K. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. International Journal on Computer Vision (IJCV), 88(2):303-338, June 2010.
13. O. Freifeld, A. Weiss, S. Zuffi, and M. J. Black. Contour people: A parameterized model of 2D articulated human shape. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 639-646. IEEE, June 2010.
14. P. Guan, A. Weiss, A. Balan, and M. J. Black. Estimating human shape and pose from a single image. In Proc. of the International Conference on Computer Vision (ICCV), pages 1381-1388, 2009.
15. B. Hariharan, P. Arbelez, R. Girshick, and J. Malik. Hypercolumns for object segmentation and fine-grained localization. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 447-456, June 2015.
16. N. Hasler, H. Ackermann, B. Rosenhahn, T. Thormhlen, and H. P. Seidel. Multilinear pose and body shape estimation of dressed subjects from image sets. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1823-1830, June 2010.
17. D. Hogg. Model-based vision: a program to see a walking person. Image and Vision Computing, 1(1):5 -20, 1983.
18. F. N. Iandola, M. W. Moskewicz, K. Ashraf, S. Han, W. J. Dally, and K. Keutzer. Squeezenet: Alexnet-level accuracy with 50x fewer parameters and
19. E. Insafutdinov, L. Pishchulin, B. Andres, M. Andriluka, and B. Schiele. Deepercut: A deeper, stronger, and faster multiperson pose estimation model. In Proc. of the European Conference on Computer Vision (ECCV), 2016.
20. C. Ionescu, J. Carreira, and C. Sminchisescu. Iterated second-order label sensitive pooling for 3D human pose estimation. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1661-1668, 2014.
21. C. Ionescu, D. Papava, V. Olaru, and C. Sminchisescu. Human3.6M: Large scale datasets and predictive methods for 3d human sensing in natural environments. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 36(7):1325-1339, July 2014.
22. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black. Towards understanding action recognition. In Proc. of the IEEE International Conference on Computer Vision (ICCV), pages 3192-3199, Sydney, Australia, Dec. 2013. IEEE.
23. S. Johnson and M. Everingham. Clustered pose and nonlinear appearance models for human pose estimation. In Proc. of the British Machine Vision Conference (BMVC), 2010. doi:10.5244/C.24.12.
24. S. X. Ju, M. J. Black, and Y. Yacoob. Cardboard people: A parameterized model of articulated motion. In Proc. of the 2nd Int. Conf. on Automatic Face-and Gesture-Recognition, pages 38-44, Killington, Vermont, Oct. 1996.
25. S. Li and A. B. Chan. 3d human pose estimation from monocular images with deep convolutional neural network. In Proc. of the Asian Conference on Computer Vision (ACCV), pages 332-347. Springer, 2014.
26. M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black. SMPL: A skinned multi-person linear model. ACM Trans. on Graphics (Proc. SIGGRAPH Asia), 34(6):248:1-248:16, 2015.
27. M. M. Loper and M. J. Black. OpenDR: An approximate differentiable renderer. In Proc. of the European Conference on Computer Vision (ECCV), pages 154-169, Cham, 2014. Springer International Publishing.
28. M. M. Loper, N. Mahmood, and M. J. Black. MoSh: Motion and shape capture from sparse markers. ACM Trans. on Graphics, (Proc. SIGGRAPH Asia), 33(6):220:1-220:13, Nov. 2014.
29. C. Mandery, O. Terlemez, M. Do, N. Vahrenkamp, and T. Asfour. The KIT whole-body human motion database. In Proc. of the International Conference on Advanced Robotics (ICAR), pages 329-336, July 2015.
30. D. Marr and H. K. Nishihara. Representation and recognition of the spatial organization of three-dimensional shapes. Proc. of the Royal Society of London B: Biological Sciences, 200(1140):269-294, 1978.
31. K. Nevatia and T. O. Binford. Structured descriptions of complex objects. In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI).
32. A. Newell, K. Yang, and J. Deng. Stacked hourglass networks for human pose estimation. In Proc. of the European Conference on Computer Vision (ECCV), pages 483-499. Springer, 2016.
33. G. L. Oliveira, A. Valada, C. Bollen, W. Burgard, and T. Brox. Deep learning for human part discovery in images. In D. Kragic, A. Bicchi, and A. D. L. 0001, editors, Proc. of the IEEE International Conference on Robotics and Automation (ICRA) 2016, pages 1634-1641. IEEE, 2016.
34. L. Pishchulin, E. Insafutdinov, S. Tang, B. Andres, M. Andriluka, P. Gehler, and B. Schiele. Deepcut: Joint subset partition and labeling for multi person pose estimation. In Proc. of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
35. G. Pons-Moll, J. Taylor, J. Shotton, A. Hertzmann, and A. Fitzgibbon. Metric regression forests for correspondence estimation. International Journal of Computer Vision (IJCV), pages 1-13, 2015.
36. V. Ramakrishna, T. Kanade, and Y. Sheikh. Reconstructing 3D human pose from 2D image landmarks. Proc. of the European Conference on Computer Vision (ECCV), pages 573-586, 2012.
37. C. Rother, V. Kolmogorov, and A. Blake. Grabcut -interactive foreground extraction using iterated graph cuts. ACM Trans. on Graphics (SIGGRAPH), August 2004.
38. B. Sapp and B. Taskar. MODEC: Multimodal decomposable models for human pose estimation. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
39. B. Sapp, D. Weiss, and B. Taskar. Parsing human motion with stretchable models. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1281-1288. IEEE, 2011.
40. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, et al. Efficient human pose estimation from single depth images. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 35(12):2821-2840, 2013.
41. L. Sigal, A. Balan, and M. J. Black. HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal of Computer Vision (IJCV), 87(1):4-27, Mar. 2010.
42. S.-E. Wei, V. Ramakrishna, T. Kanade, and Y. Sheikh. Convolutional pose machines. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
43. F. Xia, P. Wang, L.-C. Chen, and A. L. Yuille. Zoom better to see clearer: Human part segmentation with auto zoom net. In Proc. of the European Conference on Computer Vision (ECCV), 2016.
44. S. Zhou, H. Fu, L. Liu, D. Cohen-Or, and X. Han. Parametric reshaping of human bodies in images. ACM Trans. on Computer Graphics (TOG): Special Issue of ACM SIGGRAPH, 29(4):126, 2010.
45. X. Zhou, M. Zhu, S. Leonardos, K. Derpanis, and K. Daniilidis. Sparse representation for 3D shape estimation: A convex relaxation approach. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.