Monocular 3-D gait tracking in surveillance scenes

IEEE Transactions on Cybernetics

Volumn 44, Issue 6, 2014, Pages 894-909

  Rogez, Grégory ^a   Rihan, Jonathan ^b   Guerrero, Jose J ^a   Orrite, Carlos ^a  

^a UNIVERSITY OF ZARAGOZA   (Spain)

^b OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

3 D body pose; monocular gait tracking; particle filtering; video surveillance; view invariance

Indexed keywords

BIOMETRICS; CAMERAS; GAIT ANALYSIS; MONITORING; TARGET TRACKING;

BODY POSE; GAIT TRACKING; PARTICLE FILTERING; VIDEO SURVEILLANCE; VIEW INVARIANCE;

SECURITY SYSTEMS;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; GAIT; HUMAN; PHYSIOLOGY; PROCEDURES; THREE DIMENSIONAL IMAGING;

ALGORITHMS; BAYES THEOREM; GAIT; HUMANS; IMAGING, THREE-DIMENSIONAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84901282859     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2275731     Document Type: Article

References (58)

1. L. Wang, G. Zhao, N. Rajpoot, and M. S. Nixon, "Special issue on new advances in video-based gait analysis and applications: Challenges and solutions," IEEE Trans. Syst., Man, Cybern. B, vol. 40, no. 4, pp. 982-985, Aug. 2010.
2. W. Kusakunniran, Q. Wu, J. Zhang, and H. Li, "Gait recognition across various walking speeds using higher order shape configuration based on a differential composition model," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1654-1668, Dec. 2012.
3. J. Zhang, J. Pu, C. Chen, and R. Fleischer, "Low-resolution gait recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 986-996, Aug. 2010.
4. Y. Ran, Q. Zheng, R. Chellappa, and T. M. Strat, "Applications of a simple characterization of human gait in surveillance," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1009-1020, Aug. 2010.
5. X. Zhang and G. Fan, "Dual gait generative models for human motion estimation from a single camera," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1034-1049, Aug. 2010.
6. M. Goffredo, I. Bouchrika, J. N. Carter, and M. S. Nixon, "Selfcalibrating view-invariant gait biometrics," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 997-1008, Aug. 2010.
7. J. Gu, X. Ding, S. Wang, and Y. Wu, "Action and gait recognition from recovered 3-D human joints," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1021-1033, Aug. 2010.
8. T. Jaeggli, E. Koller-Meier, and L. J. V. Gool, "Learning generative models for multi-activity body pose estimation," Int. J. Comput. Vision, vol. 83, no. 2, pp. 121-134, 2009.
9. A. M. Elgammal and C.-S. Lee, "Tracking people on a torus," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 520-538, Mar. 2009.
10. Caviar Dataset. (2004). EC Funded CAVIAR Project IST 2001 37540 [Online]. Available: http://homepages.inf.ed.ac.uk/rbf/CAVIAR/
11. R. Gross and J. Shi, "The CMU motion of body (MoBo) database," Robot. Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep., 2001.
12. J. Deutscher and I. Reid, "Articulated body motion capture by stochastic search," Int. J. Comput. Vision, vol. 61, no. 2, pp. 185-205, 2005.
13. C. Canton-Ferrer, J. R. Casas, and M. Pardás, "Human motion capture using scalable body models," Comput. Vision Image Understanding, vol. 115, no. 10, pp. 1363-1374, 2011.
14. R. Li, T.-P. Tian, S. Sclaroff, and M.-H. Yang, "3-D human motion tracking with a coordinated mixture of factor analyzers," Int. J. Comput. Vision, vol. 87, nos. 1-2, pp. 170-190, 2010.
15. I.-C. Chang and S.-Y. Lin, "3-D human motion tracking based on a progressive particle filter," Pattern Recognit., vol. 43, no. 10, pp. 3621-3635, 2010.
16. C.-S. Lee and A. M. Elgammal, "Coupled visual and kinematic manifold models for tracking," Int. J. Comput. Vision, vol. 87, nos. 1-2, pp. 118-139, 2010.
17. H. Ning, T. Tan, L. Wang, and W. Hu, "People tracking based on motion model and motion constraints with automatic initialization," Pattern Recognit., vol. 37, no. 7, pp. 1423-1440, Jul. 2004. (Pubitemid 38653371)
18. R. Urtasun, D. Fleet, and P. Fua, "Temporal motion models for monocular and multiview 3-D human body tracking," Comput. Vision Image Understanding, vol. 103, pp. 157-177, Nov. 2006. (Pubitemid 44573874)
19. R. Urtasun, D. J. Fleet, and P. Fua, "3-D people tracking with Gaussian process dynamical models," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2006, pp. 238-245. (Pubitemid 44931336)
20. C. H. Ek, J. Rihan, P. H. S. Torr, G. Rogez, and N. D. Lawrence, "Ambiguity modeling in latent spaces," in Proc. Int. Workshop Mach. Learning Multimodal Interaction, 2008, pp. 62-73.
21. M. Andriluka, S. Roth, and B. Schiele, "Monocular 3-D pose estimation and tracking by detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2010, pp. 623-630.
22. B. Daubney, D. P. Gibson, and N. W. Campbell, "Estimating pose of articulated objects using low-level motion," Comput. Vision Image Understanding, vol. 116, no. 3, pp. 330-346, 2012.
23. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vision, vol. 61, no. 1, pp. 55-79, 2005.
24. R. Rosales and S. Sclaroff, "Combining generative and discriminative models in a framework for articulated pose estimation," Int. J. Comput. Vision, vol. 67, no. 3, pp. 251-276, 2006. (Pubitemid 43741483)
25. G. Rogez, J. Rihan, S. Ramalingam, C. Orrite, and P. H. Torr, "Randomized trees for human pose detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2008, pp. 1-8.
26. J. Zhang, R. T. Collins, and Y. Liu, "Bayesian body localization using mixture of nonlinear shape models," in Proc. IEEE Int. Conf. Comput. Vision, 2005, pp. 725-732. (Pubitemid 44055027)
27. X. Lan and D. P. Huttenlocher, "A unified spatio-temporal articulated model for tracking," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2004, pp. 722-729.
28. G. Rogez, C. Orrite, and J. Martínez, "A spatio-temporal 2D-models framework for human pose recovery in monocular sequences," Pattern Recognit., vol. 41, no. 9, pp. 2926-2944, 2008.
29. L. Sigal, A. O. Balan, and M. J. Black, "Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion," Int. J. Comput. Vision, vol. 87, nos. 1-2, pp. 4-27, 2010.
30. X. Ji and H. Liu, "Advances in view-invariant human motion analysis: A review," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, no. 1, pp. 13-24, Jan. 2010.
31. A. Kale, A. K. R. Chowdhury, and R. Chellappa, "Toward a view invariant gait recognition algorithm," in Proc. IEEE Conf. Advanced Video Signal Based Surveillance, 2003, pp. 143-150.
32. I. Bouchrika, M. Goffredo, J. N. Carter, and M. S. Nixon, "Covariate analysis for view-point independent gait recognition," in Proc. Int. Conf. Advances Biometrics, 2009, pp. 990-999.
33. M. Goffredo, R. D. Seely, J. N. Carter, and M. S. Nixon, "Markerless view independent gait analysis with self-camera calibration," in Proc. IEEE Conf. Automatic Face Gesture Recognit., 2008, pp. 1-6.
34. R. Rosales, M. Siddiqui, J. Alon, and S. Sclaroff, "Estimating 3-D body pose using uncalibrated cameras," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol. 1. 2001, pp. 821-827.
35. G. Rogez, J. J. Guerrero, J. Martínez, and C. Orrite, "Viewpoint independent human motion analysis in man-made environments," in Proc. Brit. Mach. Vision Conf., vol. 2. 2006, pp. 659-668.
36. G. Rogez, J. J. Guerrero, and C. Orrite, "View-invariant human feature extraction for video-surveillance applications," in Proc. IEEE Conf. Advanced Video Signal Based Surveillance, 2007, pp. 324-329.
37. Y. Li, B. Wu, and R. Nevatia, "Human detection by searching in 3-D space using camera and scene knowledge," in Proc. Int. Conf. Pattern Recognit., 2008, pp. 1-5.
38. T. Riklin-Raviv, N. Kiryati, and N. A. Sochen, "Prior-based segmentation and shape registration in the presence of perspective distortion," Int. J. Comput. Vision, vol. 72, no. 3, pp. 309-328, 2007. (Pubitemid 46094754)
39. G. Rogez, "Advances in monocular exemplar-based human body pose analysis: Modeling, detection and tracking," Ph.D. dissertation, Dept. Electron. Commun. Eng., Univ. Zaragoza, Zaragoza, Spain, Jun. 2012.
40. M. Isard and A. Blake, "Condensation: Conditional density propagation for visual tracking," Int. J. Comput. Vision, vol. 29, no. 1, pp. 5-28, 1998. (Pubitemid 128523364)
41. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
42. G. Mori and J. Malik, "Recovering 3-D human body configurations using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1052-1062, Jul. 2006.
43. D. Cremers, "Dynamical statistical shape priors for level set-based tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1262-1273, Aug. 2006. (Pubitemid 46405024)
44. Z. Lin and L. S. Davis, "Shape-based human detection and segmentation via hierarchical part-template matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 604-618, Apr. 2010.
45. A. Baumberg and D. Hogg, "Learning flexible models from image sequences," in Proc. Eur. Conf. Comput. Vision, 1994, pp. 299-308.
46. N. T. Siebel and S. J. Maybank, "Fusion of multiple tracking algorithms for robust people tracking," in Proc. Eur. Conf. Comput. Vision, vol. 4. 2002, pp. 373-387.
47. J. Giebel, D. Gavrila, and C. Schnörr, "A Bayesian framework for multicue 3-D object tracking," in Proc. Eur. Conf. Comput. Vision, vol. 4. 2004, pp. 241-252.
48. H. Sidenbladh, M. J. Black, and L. Sigal, "Implicit probabilistic models of human motion for synthesis and tracking," in Proc. Eur. Conf. Comput. Vision, vol. 1. 2002, pp. 784-800.
49. B. Stenger, A. Thayananthan, P. H. S. Torr, and R. Cipolla, "Modelbased hand tracking using a hierarchical Bayesian filter," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1372-1384, Sep. 2006. (Pubitemid 44132645)
50. M. Hofmann and D. Gavrila, "Multi-view 3-D human pose estimation in complex environment," Int. J. Comput. Vision, vol. 96, no. 1, pp. 103-124, 2012.
51. J. MacCormick and A. Blake, "A probabilistic exclusion principle for tracking multiple objects," Int. J. Comput. Vision, vol. 39, no. 1, pp. 57-71, 2000.
52. K. Smith, D. Gatica-Perez, and J.-M. Odobez, "Using particles to track varying numbers of interacting people," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2005, pp. 962-969. (Pubitemid 43897296)
53. M. Isard and J. MacCormick, "Bramble: A Bayesian multiple-blob tracker," in Proc. IEEE Int. Conf. Comput. Vision, 2001, pp. 34-41. (Pubitemid 32795038)
54. T. Zhao and R. Nevatia, "Tracking multiple humans in complex situations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1208-1221, Sep. 2004.
55. R. Okada and S. Soatto, "Relevant feature selection for human pose estimation and localization in cluttered images," in Proc. Eur. Conf. Comput. Vision, 2008, pp. 434-445.
56. K. Toyama and A. Blake, "Probabilistic tracking with exemplars in a metric space," Int. J. Comput. Vision, vol. 48, no. 1, pp. 9-19, 2002. (Pubitemid 34491072)
57. R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2004.
58. A. Criminisi, I. D. Reid, and A. Zisserman, "Single view metrology," Int. J. Comput. Vision, vol. 40, no. 2, pp. 123-148, 2000. (Pubitemid 32136369) Raras Raras