Tracking human position and lower body parts using Kalman and particle filters constrained by human biomechanics

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 1, 2011, Pages 26-37

  Del Rincón, Jesús Martínez ^a   Makris, Dimitrios ^a   Uruñuela, Carlos Orrite ^b   Nebel, Jean Christophe ^a  

^a KINGSTON UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF ZARAGOZA   (Spain)

Author keywords

2 D articulated model; Biomechanics; bipedal motion; human pose; particle filter; video surveillance

Indexed keywords

2-D ARTICULATED MODEL; BIPEDAL MOTION; HUMAN POSE; PARTICLE FILTER; VIDEO SURVEILLANCE;

BIOMECHANICS; BIOPHYSICS; CAMERAS; DISTRIBUTED COMPUTER SYSTEMS; MONITORING; NONLINEAR FILTERING; TARGET TRACKING;

SECURITY SYSTEMS;

ALGORITHM; ARTICLE; BIOLOGICAL MODEL; BIOMECHANICS; BODY POSTURE; CYBERNETICS; GAIT; HISTOLOGY; HUMAN; IMAGE PROCESSING; LEG; METHODOLOGY; PHYSIOLOGY; VIDEORECORDING; WALKING;

ALGORITHMS; BIOMECHANICS; CYBERNETICS; GAIT; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LOWER EXTREMITY; MODELS, BIOLOGICAL; POSTURE; VIDEO RECORDING; WALKING;

EID: 79551665921     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2044041     Document Type: Article

References (55)

1. Y. Wu, G. Hua, and T. Yu, "Tracking articulated body by dynamic Markov network," in Proc. ICCV, 2003, pp. 1094-1101.
2. G. McAllister, S. J. McKenna, and I. W. Ricketts, "MLESAC-based tracking with 2-D revolute-prismatic articulated models," in Proc. ICPR, Quebec City, QC, Canada, 2002, vol. 2, pp. 725-728.
3. P. Noriega and O. Bernier, "Multicues 2-D articulated pose tracking using particle filtering and belief propagation on factor graphs," in Proc. ICIP, 2007, vol. 5, no. 2, pp. 725-728.
4. I. Bouchrika and M. S. Nixon, "People detection and recognition using gait for automated visual surveillance," in Proc. IET Conf. Crime Security, 2006, pp. 576-581.
5. L. Sigal and M. J. Black, "HumanEva: Synchronized video and motion capture data set for evaluation of articulated human motion," Brown Univ., Providence, RI, Tech. Rep. CS-06-08, 2006.
6. J. Xue, N. Zheng, J. Geng, and X. Zhong, "Tracking multiple visual targets via particle-based belief propagation," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 38, no. 1, pp. 196-209, Feb. 2008.
7. L. Li, W. Huang, I. Y.-H. Gu, R. Luo, and Q. Tian, "An efficient sequential approach to tracking multiple objects through crowds for real-time intelligent CCTV systems," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 38, no. 5, pp. 1254-1269, Oct. 2008.
8. L. Sigal and M. J. Black, "Predicting 3-D people from 2-D pictures," in Proc. AMDO, 2006, pp. 185-195.
9. N. R. Howe, "Evaluating lookup-based monocular human pose tracking on the HumanEva test data," in Proc. Workshop Eval. Articulated Human Motion Pose Estimation (EHuM2), 2007.
10. N. R. Howe, "Recognition-based motion capture and the HumanEva II test data," in Proc. Workshop Eval. Articulated Human Motion Pose Estimation (EHuM2), 2007.
11. R. Poppe, "Evaluating example-based pose estimation: Experiments on the HumanEva sets," in Proc. Workshop Eval. Articulated Human Motion Pose Estimation (EHuM2), 2007.
12. C. S. Lee and A. Elgammal, "Body pose tracking from uncalibrated camera using supervised manifold learning," in Proc. NIPS Workshop Eval. Articulated Human Motion Pose Estimation (EHuM), Whistler, BC, Canada, 2006.
13. Z. L. Husz, A. M. Wallace, and P. R. Green, "Evaluation of a hierarchical partitioned particle filter with action primitives," in Proc. Workshop Eval. Articulated Human Motion Pose Estimation (EHuM2), 2007.
14. J. Deutscher and I. D. Reid, "Articulated body motion capture by stochastic search," Int. J. Comput. Vis., vol. 61, no. 2, pp. 185-205, Feb. 2005.
15. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, Jan. 2005.
16. M. W. Lee and I. Cohen, "Human body tracking with auxiliary measurements," in Proc. IEEE Int. Workshop AMFG, 2003, pp. 112-119.
17. J. MacCormick and M. Isard, "Partitioned sampling, articulated objects, and interface-quality hand tracking," in Proc. ECCV, 2000, vol. 2, pp. 3-19.
18. C. Sminchisescu and B. Triggs, "Covariance scaled sampling for monocular 3-D body tracking," in Proc. CVPR, 2001, vol. 1, pp. 447-454.
19. M. Isard and A. Blake, "Condensation: Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, Aug. 1998.
20. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. CVPR, 2000, vol. 2, pp. 126-133.
21. K. Choo and D. Fleet, "People tracking using hybrid Monte Carlo filtering," in Proc. ICCV, 2001, pp. 321-328.
22. C. M. Fryer, "Biomechanics of the lower extremity," Instruct Course Lect., vol. 20, pp. 124-130, 1971.
23. S. X. Ju, M. J. Black, and Y. Yacoob, "Cardboard people: A parameterized model of articulated image motion," in Proc. 2nd Int. Conf. Autom. Face Gesture Recog. (FG), 1996, pp. 38-44.
24. J. O'Rourke and N. I. Badler, "Model-based image analysis of human motion using constraint propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-2, no. 6, pp. 522-536, Nov. 1980.
25. D. Hogg, "Model-based vision: A program to see a walking person," Image Vis. Comput., vol. 1, no. 1, pp. 5-20, Feb. 1983.
26. Z. Chen and H. Lee, "Knowledge-guided visual perception of 3-D human gait from a single image sequence," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 2, pp. 336-342, Mar./Apr. 1992.
27. K. Rohr, "Towards model-based recognition of human movements in image sequences," CVGIP: Image Underst., vol. 59, no. 1, pp. 94-115, Jan. 1994.
28. J. M. Rehg and T. Kanade, "Model-based tracking of self-occluding articulated objects," in Proc. 5th ICCV, 1995, pp. 612-617.
29. D. M. Gavrila and L. S. Davis, "3-D model-based tracking of humans in action: A multiview approach," in Proc. Conf. CVPR, 1996, pp. 73-80.
30. I. A. Kakadiaris and D. Metaxas, "Model-based estimation of 3-D human motion with occlusion based on active multiviewpoint selection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 1996, pp. 81-87.
31. A. Elgammal and C. Lee, "Inferring 3-D body pose from silhouettes using activity manifold learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 681-688.
32. B. Li, Q. Meng, and H. Holstein, "Articulated pose identification with sparse point features," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 34, no. 3, pp. 1412-1422, Jun. 2004.
33. R. Li, M. H. Yang, S. Sclaroff, and T. P. Tian, "Monocular tracking of 3-D human motion with a coordinated mixture of factor analyzers," in Proc. ECCV, 2006, vol. 2, pp. 137-150.
34. Q. Wang, G. Xu, and H. Ai, "Learning object intrinsic structure for robust visual tracking," in Proc. CVPR, 2003, vol. 2, pp. 227-233.
35. A. Safonova, J. K. Hodgins, and N. S. Pollard, "Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces," ACM Trans. Graph., vol. 23, no. 3, pp. 514-521, Aug. 2004.
36. A. Rahimi, B. Recht, and T. Darrell, "Learning appearance manifolds from video," in Proc. IEEE Comput. Soc. Conf. CVPR, 2005, vol. 1, pp. 868-875.
37. R. Urtasun, D. J. Fleet, and P. Fua, "Monocular 3-D tracking of the golf swing," in Proc. IEEE Comput. Soc. Conf. CVPR, 2005, vol. 2, pp. 932-938.
38. R. Urtasun, D. J. Fleet, and P. Fua, "3-D people tracking with Gaussian process dynamical models," in Proc. IEEE Comput. Soc. Conf. CVPR, 2006, pp. 238-245.
39. R. Urtasun, D. J. Fleet, A. Hertzmann, and P. Fua, "Priors for people tracking from small training sets," in Proc. 10th IEEE ICCV, 2005, vol. 1, pp. 403-410.
40. C. Sminchisescu and A. Jepson, "Generative modeling for continuous nonlinearly embedded visual inference," in Proc. 21st ICML, 2004, p. 96.
41. S. B. Hou, A. Galata, F. Caillette, N. Thacker, and P. Bromiley, "Real-time body tracking using a Gaussian process latent variable model," in Proc. ICCV, 2007, pp. 1-8.
42. J. M. Rehg, D. D. Morris, and T. Kanade, "Ambiguities in visual tracking of articulated objects using two-and three-dimensional models," Int. J. Robot. Res., vol. 22, no. 6, pp. 393-418, Jun. 2003.
43. E. A. Hunter, P. H. Kelly, and R. C. Jain, "Estimation of articulated motion using kinematically constrained mixture densities," in Proc. IEEE Workshop Motion Nonrigid Articulated Objects (NAM), 1997, pp. 10-17.
44. H. Sidenbladh, M. J. Black, and D. J. Fleet, "Stochastic tracking of 3-D human figures using 2-D image motion," in Proc. 6th ECCV-Part II, 2000, pp. 702-718.
45. T. Tian, R. Li, and S. Sclaroff, "Articulated pose estimation in a learned smooth space of feasible solutions," in Proc. IEEE Comput. Soc. Conf. CVPR, 2005, p. 50.
46. J. Martínez, J. C. Nebel, D. Makris, and C. Orrite, "Tracking human body parts using particle filters constrained by human biomechanics," in Proc. BMVC, Leeds, U.K., 2008.
47. G. Rogez, C. Orrite, and J. Martínez-del-Rincon, "A spatiotemporal 2-D-models framework for human pose recovery in monocular sequences," Pattern Recognit., vol. 41, no. 9, pp. 2926-2944, Sep. 2008.
48. R. Okad and S. Soatto, "Relevant feature selection for human pose estimation and localization in cluttered images," in Proc. ECCV, 2008, pp. 434-445.
49. P. Kuo, T. Ammar, M. Lewandowski, D. Makris, and J.-C. Nebel, "Exploiting human bipedal motion constraints for 3-D pose recovery from a single uncalibrated camera," in Proc. Int. Conf. Comput. Vis. Theory Appl. (VISAPP), 2009, pp. 557-564.
50. A. Utsumi, H. Mori, J. Ohya, and M. Yachida, "Multiple-view-based tracking of multiple humans," in Proc. 14th ICPR, 1998, vol. 1, pp. 597-601.
51. L. Raskin, E. Rivlin, and M. Rudzsky, "Using Gaussian process annealing particle filter for 3-D human tracking," EURASIP J. Adv. Signal Process., vol. 2008, pp. 1-13, 2008.
52. Z. Lu, M. C. Perpinan, and C. Sminchisescu, "People tracking with the Laplacian eigenmaps latent variable model," in Proc. NIPS, 2007, pp. 1705-1712.
53. X. Li, S. J. Maybank, S. Yan, D. Tao, and D. Xu, "Gait components and their application to gender recognition," IEEE Trans. Syst., Man, Cybern. C: Appl. Rev., vol. 38, no. 2, pp. 145-155, Mar. 2008.
54. J. Darby, B. Li, N. Costen, D. Fleet, and N. Lawrence, "Backing off: Hierarchical decomposition of activity for 3-D novel pose recovery," in Proc. BMVC, London, U.K., 2009.
55. J. Wang and Y. Yagi, "Adaptive mean-shift tracking with auxiliary particles," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 39, no. 6, pp. 1578-1589, Dec. 2009.