Tracking Human Pose Using Max-Margin Markov Models

IEEE Transactions on Image Processing

Volumn 24, Issue 12, 2015, Pages 5274-5287

  Zhao, Lin ^a   Gao, Xinbo ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

articulated shapes; max margin; pose estimation; Pose tracking

Indexed keywords

ITERATIVE METHODS; MARKOV PROCESSES; MOTION ESTIMATION;

APPROXIMATE INFERENCE; ARTICULATED SHAPES; MARKOV RANDOM FIELDS; MAX-MARGIN; POSE ESTIMATION; POSE TRACKING; STATE-OF-THE-ART APPROACH; TEMPORAL INFORMATION;

GESTURE RECOGNITION;

AUTOMATED PATTERN RECOGNITION; BODY POSTURE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; MARKOV CHAIN; PHYSIOLOGY; PROCEDURES; STATISTICAL MODEL;

DATABASES, FACTUAL; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; POSTURE;

EID: 84943764009     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2473662     Document Type: Article

References (60)

1. J. Chen, S. Nie, and Q. Ji, "Data-free prior model for upper body pose estimation and tracking," IEEE Trans. Image Process., vol. 22, no. 12, pp. 4627-4639, Dec. 2013.
2. S. Sedai, M. Bennamoun, and D. Q. Huynh, "A Gaussian process guided particle filter for tracking 3D human pose in video," IEEE Trans. Image Process., vol. 22, no. 11, pp. 4286-4300, Nov. 2013.
3. V. Ramakrishna, T. Kanade, and Y. Sheikh, "Tracking human pose by tracking symmetric parts," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2013, pp. 3728-3735.
4. R. Tokola, W. Choi, and S. Savarese, "Breaking the chain: Liberation from the temporal Markov assumption for tracking human poses," in Proc. IEEE Int. Conf. Comput. Vis., Sydney, VIC, Australia, Dec. 2013, pp. 2424-2431.
5. S. Zuffi, J. Romero, C. Schmid, and M. J. Black, "Estimating human pose with flowing puppets," in Proc. IEEE Int. Conf. Comput. Vis., Sydney, NSW, Australia, Dec. 2013, pp. 3312-3319.
6. L. Zhao, G. Gao, D. Tao, and X. Li, "Learning a tracking and estimation integrated graphical model for human pose tracking," IEEE Trans. Neural Netw. Learn. Syst., doi: 10.1109/TNNLS.2015.2411287.
7. I. Everts, J. C. van Gemert, and T. Gevers, "Evaluation of color spatiotemporal interest points for human action recognition," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1569-1580, Apr. 2014.
8. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
9. C. Liu, M. Pei, X. Wu, Y. Kong, and Y. Jia, "Learning a discriminative mid-level feature for action recognition," Sci. China Inf. Sci., vol. 57, no. 5, pp. 1-13, 2014.
10. X. Zhen, L. Shao, and X. Li, "Action recognition by spatio-temporal oriented energies," Inf. Sci., vol. 281, pp. 295-309, Oct. 2014.
11. B. Li, L. Duan, J. Wang, R. Ji, C. Lin, and W. Gao, "Spatiotemporal grid flow for video retargeting," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1615-1628, Apr. 2014.
12. L. Shao, S. Jones, and X. Li, "Efficient search and localization of human actions in video databases," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 3, pp. 504-512, Mar. 2014.
13. F. S. Khan, J. van de Weijer, R. M. Anwer, M. Felsberg, and C. Gatta, "Semantic pyramids for gender and action recognition," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3633-3645, Aug. 2014.
14. H. Zhou, M. Fei, A. H. Sadka, Y. Zhang, and X. Li, "Adaptive fusion of particle filtering and spatio-temporal motion energy for human tracking," Pattern Recognit., vol. 47, no. 11, pp. 3552-3567, 2014.
15. Y.-C. Yu, "A social interaction system based on cloud computing for mobile video telephony," Sci. China Inf. Sci., vol. 57, no. 3, pp. 1-10, 2014.
16. J. O'Rourke and N. I. Badler, "Model-based image analysis of human motion using constraint propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 2, no. 6, pp. 522-536, Nov. 1980.
17. C. Bregler and J. Malik, "Tracking people with twists and exponential maps," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Santa Barbara, CA, USA, Jun. 1998, pp. 8-15.
18. A. O. Balan and M. J. Black, "An adaptive appearance model approach for model-based articulated object tracking," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., New York, NY, USA, Jun. 2006, pp. 758-765.
19. P. Buehler, M. Everingham, D. P. Huttenlocher, and A. Zisserman, "Long term arm and hand tracking for continuous sign language TV broadcasts," in Proc. Brit. Mach. Vis. Conf., Leeds, U.K., Sep. 2008, pp. 1105-1114.
20. D. Ramanan, D. A. Forsyth, and A. Zisserman, "Strike a pose: Tracking people by finding stylized poses," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA, Jun. 2005, pp. 271-278.
21. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
22. M. Andriluka, S. Roth, and B. Schiele, "Pictorial structures revisited: People detection and articulated pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 1014-1021.
23. D. Ramanan, "Learning to parse images of articulated bodies," in Proc. Adv. Neural Inf. Process. Syst., vol. 19. Vancouver, BC, Canada, Dec. 2007, pp. 1129-1136.
24. L. Zhao, X. Gao, D. Tao, and X. Li, "A deep structure for human pose estimation," Signal Process., vol. 108, pp. 36-45, Mar. 2015.
25. V. Ferrari, M. Marin-Jimenez, and A. Zisserman, "Progressive search space reduction for human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
26. M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari, "2D articulated human pose estimation and retrieval in (almost) unconstrained still images," Int. J. Comput. Vis., vol. 99, no. 2, pp. 190-214, 2012.
27. B. Sapp, A. Toshev, and B. Taskar, "Cascaded models for articulated pose estimation," in Proc. 11th Eur. Conf. Comput. Vis., Crete, Greece, Sep. 2010, pp. 406-420.
28. H. Lu, X. Shao, and Y. Xiao, "Pose estimation with segmentation consistency," IEEE Trans. Image Process., vol. 22, no. 10, pp. 4040-4048, Oct. 2013.
29. S. Johnson and M. Everingham, "Learning effective human pose estimation from inaccurate annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1465-1472.
30. H. Jiang and D. R. Martin, "Global pose estimation using non-tree models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
31. D. Tran and D. Forsyth, "Improved human parsing with a full relational model," in Proc. 11th Eur. Conf. Comput. Vis., Crete, Greece, Sep. 2010, pp. 227-240.
32. Y. Wang and G. Mori, "Multiple tree models for occlusion and spatial constraints in human pose estimation," in Proc. 10th Eur. Conf. Comput. Vis., Marseille, France, Oct. 2008, pp. 710-724.
33. T.-P. Tian and S. Sclaroff, "Fast globally optimal 2D human detection with loopy graph models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, Jun. 2010, pp. 81-88.
34. B. Taskar, C. Guestrin, and D. Koller, "Max-margin Markov networks," in Proc. Adv. Neural Inf. Process. Syst., vol. 16. Vancouver, BC, Canada, Dec. 2004, pp. 25-32.
35. Y. Altun, I. Tsochantaridis, and T. Hofmann, "Hidden Markov support vector machines," in Proc. 20th Int. Conf. Mach. Learn., Washington, DC, USA, Jun. 2003, pp. 1-8.
36. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun, "Support vector machine learning for interdependent and structured output spaces," in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, Jun. 2004, p. 104.
37. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," J. Mach. Learn. Res., vol. 6, pp. 1453-1484, Sep. 2005.
38. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting," IEEE Trans. Pattern Anal. Mach. Intell., doi: 10.1109/TPAMI.2015.2456899.
39. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning," IEEE Trans. Pattern Anal. Mach. Intell., doi: 10.1109/TPAMI.2015.2417578.
40. D. Tao, J. Cheng, M. Song, and X. Lin, "Manifold ranking-based matrix factorization for saliency detection," IEEE Trans. Neural Netw. Learn. Syst., doi: 10.1109/TNNLS.2015.2461554.
41. F. Sha and L. K. Saul, "Large margin hidden Markov models for automatic speech recognition," in Proc. Adv. Neural Inf. Process. Syst., vol. 19. Vancouver, BC, Canada, Dec. 2007, pp. 1249-1256.
42. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
43. Y. Yang and D. Ramanan, "Articulated pose estimation with flexible mixtures-of-parts," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1385-1392.
44. B. Sapp and B. Taskar, "MODEC: Multimodal decomposable models for human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2013, pp. 3674-3681.
45. Y. Yang and D. Ramanan, "Articulated human detection with flexible mixtures of parts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2878-2890, Dec. 2013.
46. M. Sun and S. Savarese, "Articulated part-based model for joint object detection and pose estimation," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 723-730.
47. Y. Tian, C. L. Zitnick, and S. G. Narasimhan, "Exploring the spatial hierarchy of mixture models for human pose estimation," in Proc. 12th Eur. Conf. Comput. Vis., Florence, Italy, Oct. 2012, pp. 256-269.
48. Y. Wang, D. Tran, and Z. Liao, "Learning hierarchical poselets for human parsing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1705-1712.
49. L. Sigal, M. Isard, B. H. Sigelman, and M. J. Black, "Attractive people: Assembling loose-limbed models using nonparametric belief propagation," in Proc. Adv. Neural Inf. Process. Syst., vol. 16. Vancouver, BC, Canada, Dec. 2004, pp. 1539-1546.
50. L. Sigal, S. Bhatia, S. Roth, M. J. Black, and M. Isard, "Tracking looselimbed people," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Washington, DC, USA, Jun. 2004, pp. I-421-I-428.
51. L. Sigal and M. J. Black, "Measure locally, reason globally: Occlusionsensitive articulated pose estimation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., New York, NY, USA, Jun. 2006, pp. 2041-2048.
52. D. Weiss, B. Sapp, and B. Taskar, "Sidestepping intractable inference with structured ensemble cascades," in Proc. Adv. Neural Inf. Process. Syst., vol. 23. Vancouver, BC, Canada, Dec. 2010, pp. 2415-2423.
53. D. Park and D. Ramanan, "N-best maximal decoders for part models," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 2627-2634.
54. B. Sapp, D. Weiss, and B. Taskar, "Parsing human motion with stretchable models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1281-1288.
55. B. Sapp. (2011). Parsing Human Motion With Stretchable Models, Version 1.0. [Online]. Available: http://vision.grasp.upenn.edu/cgibin/index.php?n=VideoLearning.StretchableModelsCode
56. T. Joachims, T. Finley, and C.-N. J. Yu, "Cutting-plane training of structural SVMs," Mach. Learn., vol. 77, no. 1, pp. 27-59, 2009.
57. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA, Jun. 2005, pp. 886-893.
58. A. Bruhn, J. Weickert, and C. Schnörr, "Lucas/Kanade meets horn/schunck: Combining local and global optic flow methods," Int. J. Comput. Vis., vol. 61, no. 3, pp. 211-231, 2005.
59. L. Sigal, A. O. Balan, and M. J. Black, "HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion," Int. J. Comput. Vis., vol. 87, nos. 1-2, pp. 4-27, 2010.
60. M. W. Tao, J. Bai, P. Kohli, and S. Paris, "SimpleFlow: A non-iterative, sublinear optical flow algorithm," Comput. Graph. Forum, vol. 31, no. 2, pp. 345-353, 2012.