Applications of a simple characterization of human gait in surveillance

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 4, 2010, Pages 1009-1020

  Ran, Yang ^a   Zheng, Qinfen ^a   Chellappa, Rama ^b   Strat, Thomas M ^a  

^a SAIC FREDERICK INC   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Activity detection; carrying status; double helical signature; gait; human motion; real time; video surveillance

Indexed keywords

ACTIVITY DETECTION; BACKGROUND SUBTRACTION; BODY PARTS; CAMERA MOTIONS; CLUTTERED SCENES; COMPACT REPRESENTATION; DOUBLE-HELICAL; EMBEDDING ALGORITHMS; GAIT PARAMETERS; GEOMETRIC SYMMETRY; HUMAN GAIT; HUMAN MOTIONS; LOAD CARRYING; PERIODIC PATTERN; REAL TIME; REAL TIME VIDEOS; SPATIOTEMPORAL CHARACTERIZATION; VIDEO SEQUENCES; VIEWING ANGLE;

MONITORING; VIDEO RECORDING;

SECURITY SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; GAIT; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; PHOTOGRAPHY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; GAIT; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 77954762435     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2044173     Document Type: Article

References (50)

1. A. F. Bobick and J.W. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.3, pp. 257-267, Mar. 2001.
2. A. A. Efros, A. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. Int. Conf. Comput. Vis., Nice, France, Oct. 2003, vol.2, pp. 726-733.
3. A. Leykin, Y. Ran, and R. I. Hammoud, "Thermal-visible video fusion for moving target tracking and pedestrian classification," in Proc. 4th IEEE Int. Workshop Object Tracking/Classification Beyond Visible Spectrum (IEEE CVPR), Minneapolis, MN, Jun. 2007, pp. 1-8.
4. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. Neural Inf. Process. Syst., 2001, vol.14, pp. 849-856.
5. C. R. Bolles, H. H. Baker, and D. H. Mariont, "Epipolar-plane image analysis: An approach to determining structure from motion," Int. J. Comput. Vis., vol.1, no.1, pp. 7-55, Mar. 1987.
6. C. R. Bolles and H. H. Baker, "Generalizing epipolar-plane image analysis on the spatiotemporal surface," Int. J. Comput. Vis., vol.3, no.1, pp. 33- 49, May 1989.
7. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Tech. J., vol.60, no.7, pp. 1389-1409, Sep. 1981.
8. C. S. Lee and A. M. Elgammal, "Carrying object detection using posepreserving dynamic-shape models," in Proc. Int. Conf. Articulated Motion Deformable Objects, Spain, Jul. 2006, pp. 315-325.
9. D. Tao, X. Li, X. Wu, and S. Maybank, "Human carrying status in visual surveillance," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., New York, Jun. 2006, vol.2, pp. 1670-1677.
10. D. M. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Underst., vol.73, no.1, pp. 82-98, Jan. 1999.
11. D. Mumford, C. Series, and D. Wright, Indra's Pearls: The Vision of Felix Klein. Cambridge, U.K.: Cambridge Univ. Press, 2005.
12. G. Doretto, A. Chiuso, S. Soatto, and Y. N. Wu, "Dynamic textures," Int. J. Comput. Vis., vol.51, no.2, pp. 91-109, Feb. 2003.
13. E. Shechtman and M. Irani, "Space-time-behavior-based correlation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., San Diego, CA, Jun. 2005, pp. 405-412.
14. F. Liu and R. W. Picard, "Finding periodicity in space and time," in Proc. 6th Int. Conf. Comput. Vis., Bombay, India, Jan. 1998, pp. 376-382.
15. G. Y. Zhao and M. Pietikinen, "Dynamic texture recognition using local binary patterns, with an application to facial expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.6, pp. 915-928, Jun. 2007.
16. H. Sun and D. Metaxas, "Automating gait animation," in Proc. SIGGRAPH, Los Angeles, CA, Aug. 2001, pp. 261-270.
17. H. Weyl, Symmetry. Princeton, NJ: Princeton Univ. Press, 1952.
18. I. Haritaoglu, R. Cutler, D. Harwood, and L. S. Davis, "Backpack: Detection of people carrying objects using silhouettes," Comput. Vis. Image Underst., vol.81, no.3, pp. 385-397, Mar. 2001.
19. J. J. Little and J. E. Boyd, "Recognizing people by their gait: The shape of motion," Videre: J. Comput. Vis. Res., vol.1, no.2, pp. 1-33, 1998.
20. J. B. Hayfron-Acquah, M. S. Nixon, and J. N. Carter, "Human identification by spatiotemporal symmetry," in Proc. IEEE Conf. Pattern Recog., Quebec, QC, Canada, Aug. 2002, vol.1, pp. 632-635.
21. J. J. Verbeek, N. Vlassis, and B. J. A. Kröse, "A k-segments algorithm for finding principal curves," Pattern Recognit. Lett., vol.23, no.8, pp. 1009- 1017, Jun. 2002.
22. J. E. Boyd, "Synchronization of oscillations for machine perception of gaits," Comput. Vis. Image Underst., vol.96, no.1, pp. 35-59, Oct. 2004.
23. J.-C. Cheng and J. M. F. Moura, "Capture and representation of human walking in live video sequences," IEEE Trans. Multimedia, vol.1, no.2, pp. 144-156, Jun. 1999.
24. J. Y. Zhang, J. B. Luo, R. Collins, and Y. Liu, "Body localization in still images using hierarchical models and hybrid search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., New York, Jun. 2006, pp. 1526-1543.
25. L. Wang, W. Hu, and T. Tan, "Recent developments in human motion analysis," Pattern Recognit., vol.36, no.3, pp. 585-601, Mar. 2003.
26. L. Zelnik-Manor and M. Irani, "Event-based analysis of video," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Kauai, HI, Dec. 2001, vol.2, pp. 123-130.
27. M. C. Allmen, "Image sequence description using spatiotemporal flow curves: Toward motion-based recognition," Ph.D. dissertation, Univ. Wisconsin, Madison, WI, 1991.
28. M. Shah and R. Jain, Motion-Based Recognition. Norwell, MA: Kluwer, 1997, ser. Computational Imaging and Vision Series.
29. M. S. Nixon and J. N. Carter, "Automatic recognition by gait," Proc. IEEE, vol.94, no.11, pp. 2013-2024, Nov. 2006.
30. P. J. Phillips, S. Sarkar, I. Robledo, P. Grother, and K. W. Bowyer, "The gait identification challenge problem: Data sets and baseline algorithm," in Proc. IEEE Conf. Pattern Recog., Quebec, QC, Canada, Aug. 2002, pp. 385-388.
31. P. Tsai, M. Shah, K. Keiter, and K. Kasparis, "Cyclic motion detection," Pattern Recognit., vol.27, no.12, pp. 1591-1603, Dec. 1994.
32. R. Cutler and L. Davis, "Robust real-time periodic motion detection, analysis, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.8, pp. 781-796, Aug. 2000.
33. R. Jain and S. P. Liou, "Qualitative motion analysis using a spatiotemporal approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Maui, HI, Jun. 1991, pp. 726-727.
34. R. Polana and R. C. Nelson, "Detection and recognition of periodic nonrigid motion," Int. J. Comput. Vis., vol.23, no.3, pp. 261-282, Jun. 1997.
35. S. A. Niyogi and E. H. Adelson, "Analyzing and recognizing walking figures in XYT," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Seattle, WA, Jun. 1994, pp. 469-474.
36. S. A. Niyogi and E. H. Adelson, "Analyzing gait with spatiotemporal surfaces," in Proc. IEEE Workshop Nonrigid Articulated Motion, Austin, TX, Nov. 1994, pp. 64-69.
37. S. Sarkar, D.Majchrzak, and K. Korimilli, "Perceptual organization-based computational model for robust segmentation of moving objects," Comput. Vis. Image Underst., vol.86, no.3, pp. 141-170, Jun. 2002.
38. S. Sarkar, P. Jonathon Phillips, Z. Liu, I. Robledo, P. Grother, and K. W. Bowyer, "The human ID gait challenge problem: Data sets, performance, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.2, pp. 162-177, Feb. 2005.
39. S. Seitz and C. Dyer, "View-invariant analysis of cyclic motion," Int. J. Comput. Vis., vol.25, no.3, pp. 231-251, Dec. 1997.
40. S. Lee, Y. Liu, and R. Collins, "Shape-variation-based frieze pattern for robust gait recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Minneapolis, MN, Jun. 2007, pp. 1-8.
41. S. D. Mowbray and M. S. Nixon, "Extraction and recognition of periodically deforming objects by continuous spatiotemporal shape description," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Washington, DC, Jun. 2004, vol.2, pp. 895-901.
42. T. Hastie and W. Stuetzle, "Principal curves," J. Amer. Statistical Assoc., vol.84, no.406, pp. 502-516, Jun. 1989.
43. W. M. Hu, T. N. Tan, L. Wang, and S. Maybank, "A survey of visual surveillance of object motion and behaviors," IEEE Trans. Syst., Man, Cybern. C: Appl. Rev., vol.34, no.3, pp. 334-352, Aug. 2004.
44. V. M. Zatsiorsky, Kinematics of Human Motion. Champaign, IL: Human Kinematics, 1998.
45. Y. Liu, R. T. Collins, and Y. Tsin, "Gait sequence analysis using frieze patterns," in Proc. Eur. Conf. Comput. Vis., Copenhagen, Denmark, Jun. 2002, pp. 657-671.
46. Y. Liu, R. T. Collins, and Y. Tsin, "A computational model for periodic pattern perception based on frieze and wallpaper groups," IEEE Trans. Pattern Anal. Mach. Intell., vol.26, no.3, pp. 354-371, Mar. 2004.
47. Y. Ran, R. Chellappa, and Q. Zheng, "Finding gait in space and time," in Proc. IEEE Int. Conf. Pattern Recog., Hong Kong, Aug. 2006, vol.4, pp. 586-589.
48. Y. Yacoob and M. Black, "Parameterized modeling and recognition of activities," Comput. Vis. Image Underst., vol.73, no.2, pp. 232-247, Feb. 1999.
49. Y. Sheikh and M. Shah, "Exploring the space of human action," in Proc. IEEE Int. Conf. Comput. Vis., Beijing, China, Oct. 2005, pp. 144-149.
50. Z. Liu and S. Sarkar, "Effect of silhouette quality on hard problems in gait recognition," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol.35, no.2, pp. 170-183, Apr. 2005.