Human pose regression through multiview visual fusion

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 7, 2010, Pages 957-966

  Zhao, Xu ^a   Fu, Yun ^b   Ning, Huazhong ^c   Liu, Yuncai ^a   Huang, Thomas S ^d  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b the State University of New York   (United States)

^c AKiiRA Media Systems Inc   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Gaussian processes regression; Human pose estimation; Image feature; Multiple views

Indexed keywords

COMPREHENSIVE EVALUATION; CRITICAL FACTORS; DESCRIPTORS; FEATURE LEVEL; GAUSSIAN PROCESSES; HUMAN BODIES; HUMAN MOTIONS; HUMAN POSE; ILL CONDITIONED PROBLEMS; IMAGE FEATURES; IMAGE INFORMATION; INFORMATION QUANTITY; INTEREST POINTS; MULTI-VIEWS; MULTIPLE CAMERAS; MULTIPLE VIEWS; POSE ESTIMATION; ROBUST SOLUTIONS; SCALE INVARIANT FEATURE TRANSFORMS; STRUCTURAL INFORMATION; VISUAL OBSERVATIONS; VISUAL SIGNALS; WIDE GAP;

CAMERAS; ESTIMATION; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); GESTURE RECOGNITION; LEARNING ALGORITHMS; METAL RECOVERY; REGRESSION ANALYSIS; THREE DIMENSIONAL; VIDEO CAMERAS; WAVELET TRANSFORMS;

FEATURE EXTRACTION;

EID: 77954859980     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2045916     Document Type: Article

References (40)

1. X. Zhao, H. Ning, Y. Liu, and T. Huang, "Discriminative estimation of 3-D human pose using Gaussian processes," in Proc. Int. Conf. Pattern Recognit., 2008, pp. 1-4.
2. T. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in vision-based human motion capture and analysis," Comput. Vision Image Understand., vol. 104, nos. 2-3, pp. 90-126, 2006.
3. C. Sminchisescu, A. Kanaujia, Z. Li, and D. Metaxas, "Discriminative density propagation for 3-D human motion estimation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2005, pp. 390-397.
4. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), vol. 2. 2000, pp. 126-133.
5. H. Ning, T. Tan, L. Wang, and W. Hu, "People tracking based on motion model and motion constraints with automatic initialization," Pattern Recognit., vol. 37, no. 7, pp. 1423-1440, 2004.
6. G. Mori and J. Malik, "Recovering 3-D human body configurations using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1052-1062, Jul. 2006.
7. M. Lee and I. Cohen, "A model-based approach for estimating human 3-D poses in static images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 905-916, Jun. 2006.
8. X. Zhao and Y. Liu, "Generative tracking of 3-D human motion by hierarchical annealed genetic algorithm," Pattern Recognit., vol. 41, no. 8, pp. 2470-2483, 2008.
9. A. Agarwal and B. Triggs, "Recovering 3-D human pose from monocular images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 44-58, Jan. 2006.
10. M. Brand, "Shadow puppetry," in Proc. IEEE Int. Conf. Comput. Vision, vol. 2. 1999, pp. 1237-1244.
11. A. Elgammal and C.-S. Lee, "Inferring 3-D body pose from silhouettes using activity manifold learning," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2004, pp. 681-688.
12. C. Lee and A. Elgammal, "Modeling view and posture manifolds for tracking," in Proc. IEEE Int. Conf. Comput. Vision, 2007, pp. 1-8.
13. R. Rosales and S. Sclaroff, "Learning body pose via specialized maps," in Proc. Adv. Neural Inform. Process. Syst., vol. 2. 2002, pp. 1263-1270.
14. C. H. Ek, P. H. Torr, and N. D. Lawrence, "Gaussian process latent variable models for human pose estimation," in Lecture Notes in Computer Sciences, vol. 4892. Berlin, Germany: Springer, 2008, pp. 132-143.
15. J. Gall, B. Rosenhahn, T. Brox, and H.-P. Seidel, "Optimization and filtering for human motion capture: A multilayer framework," Int. J. Comput. Vision, vol. 87, nos. 1-2, pp. 75-92, 2010.
16. H. Ning, X. Wei, Y. Gong, and T. Huang, "Discriminative learning of visual words for 3-D human pose estimation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2008, pp. 1-8.
17. A. Bissacco, M.-H. Yang, and S. Soatto, "Fast human pose estimation using appearance and motion via multidimensional boosting regression," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2007, pp. 1-8.
18. J. Gall, B. Rosenhahn, and H.-P. Seidel, "Drift-free tracking of rigid and articulated objects," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2008, pp. 1-8.
19. R. Urtasun and T. Darrell, "Local probabilistic regression for activity-independent human pose inference," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2008, pp. 1-8.
20. Q. Delamarre and O. Faugeras, "3-D articulated models and multiview tracking with silhouettes," in Proc. IEEE Int. Conf. Comput. Vision, vol. 99. 1999, pp. 716-721.
21. D. Gavrila and L. Davis, "3-D model-based tracking of humans in action: A multiview approach," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 1996, pp. 73-80.
22. F. Remondino, "3-D reconstruction of static human body shape from image sequence," Comput. Vision Image Understand., vol. 93, no. 1, pp. 65-85, 2004.
23. I. Mikić, M. Trivedi, E. Hunter, and P. Cosman, "Human body model acquisition and tracking using voxel data," Int. J. Comput. Vision, vol. 53, no. 3, pp. 199-223, 2003.
24. R. Plankers and P. Fua, "Articulated soft objects for video-based body modeling," in Proc. IEEE Int. Conf. Comput. Vision, vol. 1. 2001, pp. 394-401.
25. S. Dockstader and A. Tekalp, "Multiple camera tracking of interacting and occluded human motion," Proc. IEEE, vol. 89, no. 10, pp. 1441-1455, Oct. 2001.
26. I. Kakadiaris and D. Metaxas, "3-D human body model acquisition from multiple views," Int. J. Comput. Vision, vol. 30, no. 3, pp. 191-218, 1998.
27. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
28. G. Shakhnarovich, P. Viola, and T. Darrell, "Fast pose estimation with parameter-sensitive hashing," in Proc. IEEE Int. Conf. Comput. Vision, 2003, pp. 750-757.
29. A. Agarwal and B. Triggs, "Tracking articulated motion using a mixture of autoregressive models," in Proc. Eur. Conf. Comput. Vision (ECCV), 2004, pp. 54-65.
30. L. Sigal and M. Black, "HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Dept. Comput. Sci., Brown Univ., Providence, RI, Tech. Rep. CS-06-08, 2006.
31. L. Sigal, A. Balan, and M. Black, "HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Int. J. Comput. Vision, vol. 87, nos. 1-2, pp. 4-27, 2010.
32. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vision Conf., 1988, pp. 147-151.
33. A. Kelman, M. Sofka, and C. Stewart, "Keypoint descriptors for matching across multiple image modalities and nonlinear intensity variations," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2007, pp. 1-7.
34. M. Liu, S. Yan, Y. Fu, and T. Huang, "Flexible X-Y patches for face recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 2113-2116.
35. L. Fei-Fei and P. Perona, "A Bayesian heirarchical model for learning natural scene categories," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2005, pp. 524-531.
36. Y. Fu, L. Cao, G. Guo, and T. Huang, "Multiple feature fusion by subspace learning," in Proc. Assoc. Comput. Machinery Int. Conf. Image Video Retrieval (CIVR), 2008, pp. 127-134.
37. C. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press, 2006.
38. S. Weisberg, Applied Linear Regression. Hoboken, NJ: Wiley-Interscience, 2004.
39. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
40. X. Zhao, Y. Fu, and Y. Liu, "Temporal-Spatial Local Gaussian Process Experts for Human Pose Estimation," in Proc. 9th Asian Conf. Comput. Vision, 2009.