Dual gait generative models for human motion estimation from a single camera

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 4, 2010, Pages 1034-1049

  Zhang, Xin ^a   Fan, Guoliang ^a  

^a Oklahoma State University   (United States)

Author keywords

Gait appearances; gait kinematics; generative models; human motion estimation; manifold learning; Markov chain Monte Carlo (MCMC); particle filtering; tensor analysis

Indexed keywords

GAIT KINEMATICS; GENERATIVE MODEL; HUMAN MOTION ESTIMATION; MANIFOLD LEARNING; PARTICLE FILTERING;

ALGORITHMS; CAMERAS; ESTIMATION; KINEMATICS; MARKOV PROCESSES; MONTE CARLO METHODS; NONLINEAR FILTERING; TENSORS;

MOTION ESTIMATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; GAIT; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; MOVEMENT (PHYSIOLOGY); PHOTOGRAPHY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; COMPUTER SIMULATION; GAIT; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, BIOLOGICAL; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 77954758582     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2044240     Document Type: Article

References (64)

1. L. Mudermann, S. Corazza, and T. P. Andriacchi, "The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications," J. Neuroengineering Rehabil., vol.3, no.6, 2006.
2. A. Elgammal and C.-S. Lee, "Separating style and content on a nonlinear manifold," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 478-485.
3. C.-S. Lee and A. Elgammal, "Modeling view and posture manifolds for tracking," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
4. CMU Human Motion Capture Database. [Online]. Available: http://mocap.cs.cmu.edu
5. L. Sigal and M. Black, "HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Brown Univ., Providence, RI, Tech. Rep. CS-06-08, 2006.
6. T. B.Moeslund, A. Hilton, and V. Kruger, "A survey of advances in visionbased human motion capture and analysis," Comput. Vis. Image Underst., vol.104, no.2, pp. 90-126, Nov. 2006.
7. R. Poppe, "Vision-based human motion analysis: an overview," Comput. Vis. Image Underst., vol. 108, no. 1/2, pp. 4-18, Oct./Nov. 2007.
8. A. Agarwal and B. Triggs, "3D human pose from silhouettes by relevance vector regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 882-888.
9. A. Agarwal and B. Triggs, "Recovering 3D human pose from monocular images," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.1, pp. 44-58, Jan. 2006.
10. K. Gauman, G. Shakhanarovich, and T. Darrell, "Inferring 3D structure with a statistical image-based shape model," in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 641-647.
11. R. Urtasun and T. Darrell, "Sparse probabilistic regression for activityindependent human pose inference," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
12. L. Sigal, R. Memisevic, and D. J. Fleet, "Shared kernel information embedding for discriminative inference," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 2852-2859.
13. L. Bo, C. Sminchisescu, A. Kanaujia, and D. Metaxas, "Fast algorithms for large scale conditional 3D prediction," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
14. R. Poppe, "Evaluating example-based pose estimation: experiments on the HumanEva set," in Proc. CVPR 2nd Workshop Eval. Articulated Human Motion Pose Estimation, 2007.
15. N. R. Howe, "Recognition-based motion capture and the HumanEva II test data," in Proc. CVPR 2nd Workshop Eval. Articulated Human Motion Pose Estimation, 2007.
16. R. Rosales and S. Sclaroff, "Estimating 3D body pose using uncalibrated cameras," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2001, pp. 821-827.
17. A. Elgammal and C.-S. Lee, "Tracking people on torus," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.3, pp. 520-538, Mar. 2009.
18. L. Mudermann, S. Corazza, and T. P. Andriacchi, "Markerless human motion capture through visual hull and articulated ICP," in Proc. NIPS Workshop Eval. Articulated Human Motion Pose Estimation, 2006.
19. C. Canton-Ferrer, J. Casas, and M. Pardas, "Exploiting structural hierarchy in articulated objects towards robust motion capture," in Proc. Conf. Articulated Motion Deformable Objects, 2008, pp. 82-91.
20. F. Guo and G. Qian, "Monocular 3D tracking of articulated human motion in silhouette and pose manifolds," EURASIP J. Image Video Process., vol.2008, no.3, pp. 1-18, 2008.
21. T. Jaeggli, E. Koller-Meier, and L. V. Gool, "Multi-activity tracking in LLE body pose space," in Proc. Int. Conf. Comput. Vis./2nd Workshop Human Motion, 2007, pp. 42-57.
22. T. Tangkuampien and D. Suter, "Real-time human pose inference using kernel principal component pre-image approximations," in Proc. Brit. Mach. Vis. Conf., 2006, pp. 599-608.
23. M. Brubaker, D. Fleet, and A. Hertzmann, "Physics-based human pose tracking," in Proc. NIPS Workshop Eval. Articulated Human Motion Pose Estimation, 2006.
24. H. Ning, T. Tan, L. Wang, and W. Hu, "Kinematics-based tracking of human walking in monocular video sequences," Image Vis. Comput., vol.22, no.5, pp. 429-441, May 2004.
25. L. Sigal, S. Bhatia, S. Roth, M. Black, and M. Isard, "Tracking looselimbed people," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 421-428.
26. G. Rogez, J. Rihan, S. Ramalingam, C. Orrite, and P. H. Torr, "Randomized trees for human pose detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
27. L. Sigal, A. Balan, and M. J. Black, "Combined discriminative and generative articulated pose and non-rigid shape estimation," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 1337-1344.
28. D. Ramanan, D. A. Forsyth, and A. Zisserman, "Strike a pose: Tracking people by finding stylized poses," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, pp. 271-278.
29. L. Sigal and M. J. Black, "Measure locally, reason globally: Occlusionsensitive articulated pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 2041-2048.
30. P. Peurum, S. Venkatesh, and G. West, "The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications," Int. J. Comput. Vis., vol. 87, no. 1/2, Mar. 2010.
31. Z. L. Husz, A. Wallace, and P. Green, "Evaluation of a hierarchical partitioned particle filter with action primitives," in Proc. CVPR 2nd Workshop Eval. Articulated Human Motion Pose Estimation, 2007.
32. X. Xu and B. Li, "Learning motion correlation for tracking articulated human body with a Rao-Blackwellised particle filter," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
33. X. Lan and D. Huttenlocher, "A unified spatio-temporal articulated model for tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 722-729.
34. S. Y. Cheng and M. M. Trivedi, "Articulated human body pose inference from voxel data using a kinematically constrained Gaussian mixture model," in Proc. CVPR 2nd Workshop Eval. Articulated Human Motion Pose Estimation, 2007.
35. J. Gall, B. Rosenhahn, T. Brox, and H. P. Seidel, "Optimization and filtering for human motion capture-A multi-layer framework," Int. J. Comput. Vis., vol. 87, no. 1/2, pp. 75-92, Mar. 2010.
36. B. Rosenhahn, C. Schmaltz, and T. Brox, "Markerless motion capture of man-machine interaction," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
37. L. Mundermann, S. Corazza, and T. P. Andriacchi, "Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-6.
38. A. O. Balan, L. Sigal, M. J. Black, J. E. Davis, and H. W. Haussecker, "Detailed human shape and pose from images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
39. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, and J. Rodgers, "SCAPE: Shape completion and animation of people," ACM Trans. Graph., vol.24, no.3, pp. 408-416, Jul. 2005.
40. X. Lan and D. Huttenlocher, "Beyond trees: Common-factor models for 2D human pose recovery," in Proc. IEEE Int. Conf. Comput. Vis., 2005, pp. 470-477.
41. M. W. Lee and I. Cohen, "Proposal maps driven MCMC for estimating human body pose in static images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. II-344-II-341.
42. M. Vondrak, L. Sigal, and O. C. Jenkins, "Physical simulation for probabilistic motion tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
43. M. Brubaker, D. Fleet, and A. Hertzmann, "Physics-based person tracking using simplified lower-body dynamics," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
44. M. Brubaker and D. Fleet, "The kneed walker for human pose tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
45. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, no.5500, pp. 2323-2326, Dec. 2000.
46. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol.290, no.5500, pp. 2319-2323, Dec. 2000.
47. N. Lawrence, "Gaussian process latent variable models for visualization of high dimensional data," in Proc. Adv. Neural Inf. Process., 2003, pp. 329-336.
48. J. Wang, D. Fleet, and A. Hertzmann, "Gaussian process dynamic models," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 1441-1448.
49. R. Urtansun, "Motion model for robust 3D human body tracking," Ph.D. dissertation, EPFL, Lausanne, Switzerland, 2006.
50. K. Moon and V. Pavlovic, "Impact of dynamics on subspace embedding and tracking of sequences," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 198-205.
51. N. Lawrence and J. Candela, "Local distance preservation in the GPLVM through back constraints," in Proc. Int. Conf. Mach. Learn., 2006, pp. 513-520.
52. A. Gupta, T. Chen, F. Chen, D. Kimber, and L. Daivs, "Context and observation driven latent variable model for human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
53. A. Elgammal and C.-S. Lee, "Inferring 3D body pose from silhouettes using activity manifold learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, vol.2, pp. 681-688.
54. C.-S. Lee and A. Elgammal, "Body pose tracking from uncalibrated camera using supervised manifold learning," in Proc. NIPS Workshop Eval. Articulated Human Motion Pose Estimation, 2006.
55. R. Urtasun, D. Fleet, A. Hertzmann, and P. Fua, "Priors for people tracking from small training sets," in Proc. IEEE Int. Conf. Comput. Vis., 2005, pp. 403-410.
56. T.-P. Tian, R. Li, and S. Sclaroff, "Articulated pose estimation in a learned smooth space of feasible solutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, p. 50.
57. C. H. Ek, P. Torr, and N. Lawrence, "Gaussian process latent variable models for human pose estimation," in Proc. Mach. Learn. Multimodal Interaction, 2007, pp. 132-143.
58. C.-S. Lee and A. Elgammal, "Simultaneous inference of view and body pose using torus manifolds," in Proc. Int. Conf. Pattern Recog., 2006, pp. 489-494.
59. M. A. O. Vasilescu and D. Terzopoulos, "Multilinear subspace analysis of image ensembles," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2003, pp. 93-99.
60. T. Zhao and R. Nevatia, "Tracking multiple humans in crowded environment," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 406-413.
61. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. Eur. Conf. Comput. Vis., 2000, pp. 751-767.
62. J.-S. Monzani, P. Baerlocher, R. Boulic, and D. Thalmann, "Using an intermediate skeleton and inverse kinematics for motion retargeting," Comput. Graph. Forum, vol.19, no.3, pp. 11-19, Sep. 2000.
63. R. Okada and S. Soatto, "Relevant feature selection for human pose estimation and localization in cluttered images," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 434-445.
64. B. Ni, A. A. Kassim, and S. Winkler, "A hybrid framework for 3D human motion tracking," IEEE Trans. Circuits Syst. Video Technol., vol.18, no.8, pp. 1075-1084, Aug. 2008.