Body parts dependent joint regressors for human pose estimation in still images

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 11, 2014, Pages 2131-2143

  Dantone, Matthias ^a   Gall, Juergen ^b   Leistner, Christian ^c   Van Gool, Luc ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF BONN   (Germany)

^c MICROSOFT   (United States)

Author keywords

classification; fashion; Human pose estimation; random forest; regression

Indexed keywords

BODY PARTS; FASHION; HUMAN POSE ESTIMATIONS; RANDOM FORESTS; REGRESSION; STILL IMAGES;

CLASSIFICATION (OF INFORMATION);

ALGORITHM; BODY POSTURE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; JOINT; PHYSIOLOGY; PROCEDURES;

ALGORITHMS; DATABASES, FACTUAL; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; JOINTS; POSTURE;

EID: 84907807686     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2318702     Document Type: Article

References (67)

1. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, and A. Blake, "Efficient human pose estimation from single depth images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2821-2840, Dec. 2013.
2. Y. Liu, J. Gall, C. Stoll, Q. Dai, H.-P. Seidel, and C. Theobalt, "Markerless motion capture of multiple characters using multiview image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2720-2735, Nov. 2013.
3. M. A. Fischler and R. A. Elschlager, "The representation and matching of pictorial structures," IEEE Trans. Comput., vol. 22, no. 1, pp. 67-92, Jan. 1973.
4. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
5. Y. Yang and D. Ramanan, "Articulated human detection with flexible mixtures-of-parts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2878-2890, Dec. 2013.
6. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, pp. 886-893.
7. X. Zhu, C. Vondrick, D. Ramanan, and C. C. Fowlkes, "Do we need more training data or better models for object detection?" in Proc. Brit. Mach. Vis. Conf., 2012, pp. 80.1-80.11.
8. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1297-1304.
9. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, and A. Fitzgibbon, "Efficient regression of general-activity human poses from depth images," in Proc. Int. Conf. Comput. Vis., 2011, pp. 415-422.
10. L. Sigal and M. Black, "Measure locally, reason globally: Occlusion-sensitive articulated pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 2041-2048.
11. X. Ren, A. C. Berg, and J. Malik, "Recovering human body configurations using pairwise constraints between parts," in Proc. Int. Conf. Comput. Vis., 2005, pp. 824-831.
12. H. Jiang and D. Martin, "Global pose estimation using non-tree models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008.
13. T.-P. Tian and S. Sclaroff, "Fast globally optimal 2d human detection with loopy graph models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 81-88.
14. M. Bergtholdt, J. H. Kappes, S. Schmidt, and C. Schnorr, "A study of parts-based object class detection using complete graphs," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 93-117, 2010.
15. D. Tran and D. Forsyth, "Improved human parsing with a full relational model," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 227-240.
16. M. Dantone, J. Gall, C. Leistner, and L. Van Gool, "Human pose estimation using body parts dependent joint regressors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3041-3048.
17. S. Johnson and M. Everingham, "Clustered pose and nonlinear appearance models for human pose estimation," in Proc. Brit. Mach. Vis. Conf., 2010, pp. 121-1211.
18. T. B. Moeslund, A. Hilton,V.Kruger, and L. Sigal, Eds., VisualAnalysis of Humans: Looking at People.New York,NY,USA: Springer, 2011.
19. R. Ronfard, C. Schmid, and B. Triggs, "Learning to parse pictures of people," in Proc. Eur. Conf. Comput. Vis., 2002, pp. 700-714.
20. V. K. Singh, R. Nevatia, and C. Huang, "Efficient inference with multiple heterogeneous part detectors for human pose estimation," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 314-327.
21. M. Eichner and V. Ferrari, "Appearance sharing for collective human pose estimation," in Proc. Asian Comput. Vis. Conf., 2012, pp. 138-151.
22. S. Zuffi, O. Freifeld, and M. J. Black, "From pictorial structures to deformable structures," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3546-3553.
23. L. Pishchulin, A. Jain, M. Andriluka, T. Thormahlen, and B. Schiele, "Articulated people detection and pose estimation: Reshaping the future," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3178-3185.
24. M. Burenius, J. Sullivan, and S. Carlsson, "3d pictorial structures for multiple view articulated pose estimation," in Proc. IEEE Conf. Comput. Vis Pattern Recog., 2013, pp. 3618-3625.
25. M. Andriluka, S. Roth, and B. Schiele, "Discriminative appearance models for pictorial structures," Int. J. Comput. Vis., vol. 99, no. 3, pp. 259-280, 2012.
26. M. Sun, M. Telaprolu, H. Lee, and S. Savarese, "An efficient branch-and-bound algorithm for optimal human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 1616-1623.
27. A. Lehrmann, P. Gehler, and S. Nowozin, "A non-parametric Bayesian network prior of human pose," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1281-1288.
28. Y. Wang and G. Mori, "Multiple tree models for occlusion and spatial constraints in human pose estimation," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 710-724.
29. F. Wang and Y. Li, "Beyond physical connections: Tree models in human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 596-603.
30. B. Sapp, C. Jordan, and B. Taskar, "Adaptive pose priors for pictorial structures," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 422-429.
31. L. Bo and C. Sminchisescu, "Twin Gaussian processes for structured prediction," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 28-52, 2010.
32. D. Ramanan, "Learning to parse images of articulated bodies," in Proc. Neural Inform. Process. Syst. Conf., 2006, pp. 1129-1136.
33. M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari, "2d articulated human pose estimation and retrieval in (almost) unconstrained still images," Int. J. Comput. Vis., vol. 99, no. 2, pp. 190-214, 2012.
34. M. Sun and S. Savarese, "Articulated part-based model for joint object detection and pose estimation," in Proc. Int. Conf. Comput. Vis., 2011, pp. 723-730.
35. Y. Wang, D. Tran, and Z. Liao, "Learning hierarchical poselets for human parsing," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1705-1712.
36. Y. Tian, C. L. Zitnick, and S. G. Narasimhan, "Exploring the spatial hierarchy of mixture models for human pose estimation," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 256-269.
37. L. Bourdev, S. Maji, T. Brox, and J. Malik, "Detecting people using mutually consistent poselet activations," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 168-181.
38. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele, "Poselet conditioned pictorial structures," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 588-595.
39. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele, "Strong appearance and expressive spatial models for human pose estimation," in Proc. IEEE Int. Conf. Comput. Vis., 2013.
40. G. Gkioxari, P. Arbelaez, L. Bourdev, and J. Malik, "Articulated pose estimation using discriminative armlet classifiers," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3342-3349.
41. F. Wang and Y. Li, "Learning visual symbols for parsing human poses in images," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 2510-2516.
42. Y. Amit, D. Geman, and K. Wilder, "Joint induction of shape features and tree classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 11, pp. 1300-1305, Nov. 1997.
43. G. Rogez, J. Rihan, S. Ramalingam, C. Orrite, and P. H. Torr, "Randomized trees for human pose detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
44. G. Rogez, J. Rihan, C. Orrite, and P. H. Torr, "Fast human pose detection using randomized hierarchical cascades of rejectors," Int. J. Comput. Vis., vol. 99, no. 1, pp. 25-52, 2012.
45. B. Leibe, A. Leonardis, and B. Schiele, "Robust object detection with interleaved categorization and segmentation," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 259-289, 2008.
46. J. Muller and M. Arens, "Human pose estimation with implicit shape models," in Proc. Workshop Anal. Retrieval Tracked Events Motion Imagery Streams, 2010, pp. 9-14.
47. B. Holt, E.-J. Ong, H. Cooper, and R. Bowden, "Putting the pieces together: Connected poselets for human pose estimation," in Proc. Workshop Consum. Depth Cameras Comput. Vis., 2011, pp. 1196-1201.
48. E. Sangineto, M. Cristani, A. D. Bue, and V. Murino, "Learning discriminative spatial relations for detector dictionaries: An application to pedestrian detection," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 273-286.
49. D. Tang, Y. Liu, and T.-K. Kim, "Fast pedestrian detection by cascaded random forest with dominant orientation templates," in Proc. Brit. Mach. Vis. Conf., 2012, pp. 1-11.
50. C. Keskin, F. Kraç, Y. E. Kara, and L. Akarun, "Hand pose estimation and hand shape classification using multi-layered randomized decision forests," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 852-863.
51. J. Shotton, M. Johnson, and R. Cipolla, "Semantic texton forests for image categorization and segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
52. G. Fanelli, M. Dantone, J. Gall, A. Fossati, and L. Van Gool, "Random forests for real time 3d face analysis," Int. J. Comput. Vis., vol. 101, no. 3, pp. 437-458, 2013.
53. M. Dantone, J. Gall, G. Fanelli, and L. Van Gool, "Real-time facial feature detection using conditional regression forests," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2578-2585.
54. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer, "Robust and accurate shape model fitting using random forest regression voting," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 278-291.
55. B. Glocker, O. Pauly, E. Konukoglu, and A. Criminisi, "Joint classification-regression forests for spatially structured multi-object segmentation," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 870-881.
56. N. Razavi, J. Gall, P. Kohli, and L. Van Gool, "Latent Hough transform for object detection," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 312-325.
57. D. Tang, T.-H. Yu, and T.-K. Kim, "Real-time articulated hand pose estimation using semi-supervised transductive regression forests," in Proc. IEEE Int. Conf. Comput. Vis., 2013.
58. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.
59. A. Criminisi and J. Shotton, Decision Forests for Computer Vision and Medical Image Analysis. New York, NY, USA: Springer, 2013.
60. J. Gall, A. Yao, N. Razavi, L. Van Gool, and V. Lempitsky, "Hough forests for object detection, tracking, and action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2188-2202, Nov. 2011.
61. M. Jones and J. Rehg, "Statistical color models with application to skin detection," Int. J. Comput. Vis., vol. 46, no. 1, pp. 81-96, 2002.
62. P. F. Felzenszwalb, R. B. Girshick, D. A. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
63. Y. Yang and D. Ramanan, "Articulated pose estimation with flexible mixtures-of-parts," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1385-1392.
64. K. Yamaguchi, M. H. Kiapour, L. E. Ortiz, and T. L. Berg, "Parsing clothing in fashion photographs," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3570-3577.
65. S. Johnson and M. Everingham, "Learning effective human pose estimation from inaccurate annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1465-1472.
66. V. Ferrari, M. Marin-Jimenez, and A. Zisserman, "Progressive search space reduction for human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
67. M. Andriluka, S. Roth, and B. Schiele, "Pictorial structures revisited: People detection and articulated pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1014-1021.