Learning a tracking and estimation integrated graphical model for human pose tracking

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 12, 2015, Pages 3176-3186

  Zhao, Lin ^a   Gao, Xinbo ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Pictorial structure (PS); Pose estimation; Pose tracking; Visual tracking

Indexed keywords

ITERATIVE METHODS; MOTION ESTIMATION; TARGET TRACKING; TRACKING (POSITION); VIDEO STREAMING;

APPROXIMATE INFERENCE; COMPUTATIONAL COSTS; DIVIDE AND CONQUER; HUMAN POSE TRACKING; INTEGRATED MODELING; PARSING PROBLEMS; SPATIAL CONFIGURATION; TEMPORAL INFORMATION;

GESTURE RECOGNITION;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BODY POSTURE; HUMAN; IMAGE PROCESSING; LEARNING; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PROCEDURES; THEORETICAL MODEL; VIDEORECORDING; WHOLE BODY IMAGING;

ALGORITHMS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MODELS, THEORETICAL; MOVEMENT; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; POSTURE; VIDEO RECORDING; WHOLE BODY IMAGING;

EID: 84958123150     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2411287     Document Type: Article

References (56)

1. T. B. Moeslund, A. Hilton, V. Kruger, and L. Sigal, Eds., Visual Analysis of Humans: Looking at People. London, U.K.: Springer-Verlag, 2011.
2. R. Saegusa, G. Metta, G. Sandini, and L. Natale, "Developmental perception of the self and action, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 1, pp. 183-202, Jan. 2014.
3. X. Zhen, L. Shao, and X. Li, "Action recognition by spatio-temporal oriented energies, " Inf. Sci., vol. 281, pp. 295-309, Oct. 2014.
4. C. Liu, M. Pei, X. Wu, Y. Kong, and Y. Jia, "Learning a discriminative mid-level feature for action recognition, " Sci. China Inf. Sci., vol. 57, no. 5, pp. 1-13, 2014.
5. K. Bousmalis, S. Zafeiriou, L. Morency, and M. Pantic, "Infinite hidden conditional random fields for human behavior analysis, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 1, pp. 170-177, Jan. 2013.
6. X. Zhen, L. Shao, D. Tao, and X. Li, "Embedding motion and structure features for action recognition, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 7, pp. 1182-1190, Jul. 2013.
7. D. Tao, L. Jin, Y. Wang, and X. Li, "Rank preserving discriminant analysis for human behavior recognition on wireless sensor networks, " IEEE Trans. Ind. Informat., vol. 10, no. 1, pp. 813-823, Feb. 2014.
8. C. Ding, C. Xu, and D. Tao, "Multi-task pose-invariant face recognition, " IEEE Trans. Image Process., vol. 24, no. 3, pp. 980-993, Mar. 2015.
9. N. Wang, D. Tao, X. Gao, X. Li, and J. Li, "A comprehensive survey to face hallucination, " Int. J. Comput. Vis., vol. 106, no. 1, pp. 9-30, 2014.
10. L. Maddalena and A. Petrosino, "Stopped object detection by learning foreground model in videos, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 723-735, May 2013.
11. Y.-C. Yu, "A social interaction system based on cloud computing for mobile video telephony, " Sci. China Inf. Sci., vol. 57, no. 3, pp. 1-10, 2014.
12. L. Shao, S. Jones, and X. Li, "Efficient search and localization of human actions in video databases, " IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 3, pp. 504-512, Mar. 2014.
13. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
14. D. Tao, X. Tang, X. Li, and X. Wu, "Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1088-1099, Jul. 2006.
15. D. Ramanan, D. A. Forsyth, and A. Zisserman, "Tracking people by learning their appearance, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 65-81, Jan. 2007.
16. S. Salti, A. Cavallaro, and L. Di Stefano, "Adaptive appearance modeling for video tracking: Survey and evaluation, " IEEE Trans. Image Process., vol. 21, no. 10, pp. 4334-4348, Oct. 2012.
17. J. Fan, X. Shen, and Y. Wu, "What are we tracking: A unified approach of tracking and recognition, " IEEE Trans. Image Process., vol. 22, no. 2, pp. 549-560, Feb. 2013.
18. H. Zhou, M. Fei, A. Sadka, Y. Zhang, and X. Li, "Adaptive fusion of particle filtering and spatio-temporal motion energy for human tracking, " Pattern Recognit., vol. 47, no. 11, pp. 3552-3567, 2014.
19. X. Li, W. Hu, Z. Zhang, X. Zhang, and G. Luo, "Robust visual tracking based on incremental tensor subspace learning, " in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
20. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking, " Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, 2008.
21. J. Wen, X. Gao, X. Li, D. Tao, and J. Li, "Incremental pairwise discriminant analysis based visual tracking, " Neurocomputing, vol. 74, nos. 1-3, pp. 428-438, 2010.
22. J. Wen, X. Gao, Y. Yuan, D. Tao, and J. Li, "Incremental tensor biased discriminant analysis: A new color-based visual tracking method, " Neurocomputing, vol. 73, nos. 4-6, pp. 827-839, 2010.
23. S. Hare, A. Saffari, and P. H. S. Torr, "Struck: Structured output tracking with kernels, " in Proc. IEEE Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 263-270.
24. M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. Van Gool, "Robust tracking-by-detection using a detector confidence particle filter, " in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, Sep./Oct. 2009, pp. 1515-1522.
25. Z. Kalal, K. Mikolajczyk, and J. Matas, "Tracking-learning-detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1409-1422, Jul. 2012.
26. B. Babenko, M.-H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1619-1632, Aug. 2011.
27. F. Tang, S. Brennan, Q. Zhao, and H. Tao, "Co-tracking using semi-supervised support vector machines, " in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
28. J. Fan, X. Shen, and Y. Wu, "Scribble tracker: A matting-based approach for robust tracking, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 8, pp. 1633-1644, Aug. 2012.
29. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition, " Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
30. M. A. Fischler and R. A. Elschlager, "The representation and matching of pictorial structures, " IEEE Trans. Comput., vol. C-22, no. 1, pp. 67-92, Jan. 1973.
31. Y. Wang, D. Tran, and Z. Liao, "Learning hierarchical poselets for human parsing, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1705-1712.
32. V. Ferrari, M. Marin-Jimenez, and A. Zisserman, "Progressive search space reduction for human pose estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
33. D. Ramanan, "Learning to parse images of articulated bodies, " in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2007, pp. 1129-1136.
34. M. Andriluka, S. Roth, and B. Schiele, "Discriminative appearance models for pictorial structures, " Int. J. Comput. Vis., vol. 99, no. 3, pp. 259-280, 2012.
35. Y. Yang and D. Ramanan, "Articulated pose estimation with flexible mixtures-of-parts, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1385-1392.
36. Y. Tian, C. L. Zitnick, and S. G. Narasimhan, "Exploring the spatial hierarchy of mixture models for human pose estimation, " in Proc. Eur. Conf. Comput. Vis., Florence, Italy, Oct. 2012, pp. 256-269.
37. S. Johnson and M. Everingham, "Learning effective human pose estimation from inaccurate annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1465-1472.
38. M. Sun and S. Savarese, "Articulated part-based model for joint object detection and pose estimation, " in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 723-730.
39. Y. Yang and D. Ramanan, "Articulated human detection with flexible mixtures of parts, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2878-2890, Dec. 2013.
40. L. Zhao, X. Gao, D. Tao, and X. Li, "A deep structure for human pose estimation, " Signal Process., vol. 108, pp. 36-45, Mar. 2015.
41. H. Jiang and D. R. Martin, "Global pose estimation using non-tree models, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
42. B. Sapp, A. Toshev, and B. Taskar, "Cascaded models for articulated pose estimation, " in Proc. Eur. Conf. Comput. Vis., Crete, Greece, Sep. 2010, pp. 406-420.
43. D. Tran and D. Forsyth, "Improved human parsing with a full relational model, " in Proc. Eur. Conf. Comput. Vis., Crete, Greece, Sep. 2010, pp. 227-240.
44. M. Sun, M. Telaprolu, H. Lee, and S. Savarese, "An efficient branchand- bound algorithm for optimal human pose estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 1616-1623.
45. H. Jiang, "Human pose estimation using consistent max covering, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1911-1918, Sep. 2011.
46. C. Xu, D. Tao, and C. Xu, "Large-margin multi-view information bottleneck, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1559-1572, Aug. 2014.
47. M. Andriluka, S. Roth, and B. Schiele, "People-tracking-by-detection and people-detection-by-tracking, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
48. L. Sigal, S. Bhatia, S. Roth, M. J. Black, and M. Isard, "Tracking looselimbed people, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Washington, DC, USA, Jun./Jul. 2004, pp. I-421-I-428.
49. E. B. Sudderth, M. I. Mandel, W. T. Freeman, and A. S. Willsky, "Visual hand tracking using nonparametric belief propagation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshop, Washington, DC, USA, Jun. 2004, pp. 189-196.
50. P. Buehler, M. Everingham, D. P. Huttenlocher, and A. Zisserman, "Long term arm and hand tracking for continuous sign language TV broadcasts, " in Proc. Brit. Mach. Vis. Conf., Leeds, U.K., Sep. 2008, pp. 1105-1114.
51. D. Park and D. Ramanan, "N-best maximal decoders for part models, " in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 2627-2634.
52. B. Sapp, D. Weiss, and B. Taskar, "Parsing human motion with stretchable models, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 1281-1288.
53. M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari, "2D articulated human pose estimation and retrieval in (almost) unconstrained still images, " Int. J. Comput. Vis., vol. 99, no. 2, pp. 190-214, 2012.
54. C. M. Bishop, Pattern Recognition and Machine Learning. London, U.K.: Springer-Verlag, 2006.
55. K. Rose, "Deterministic annealing for clustering, compression, classification, regression, and related optimization problems, " Proc. IEEE, vol. 86, no. 11, pp. 2210-2239, Nov. 1998.
56. L. Sigal, A. O. Balan, and M. J. Black, "HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion, " Int. J. Comput. Vis., vol. 87, nos. 1-2, pp. 4-27, 2010.