Incremental learning for video-based gait recognition with LBP flow

IEEE Transactions on Cybernetics

Volumn 43, Issue 1, 2013, Pages 77-89

  Hu, Maodi ^a   Wang, Yunhong ^a   Zhang, Zhaoxiang ^a   Zhang, De ^a   Little, James J ^b  

^a BEIHANG UNIVERSITY   (China)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Gait recognition; Incremental learning; Individual hidden Markov model (HMM) (iHMM); Local binary pattern (LBP) flow

Indexed keywords

BACKGROUND SUBTRACTION; GAIT RECOGNITION; INCREMENTAL LEARNING; INDIVIDUAL HIDDEN MARKOV MODEL (HMM) (IHMM); INTELLIGENT VIDEO SURVEILLANCE; LOCAL BINARY PATTERNS; MULTI-FRAME DETECTION; VIDEO-SURVEILLANCE APPLICATIONS;

DYNAMICS; HIDDEN MARKOV MODELS; OPTICAL FLOWS; SECURITY SYSTEMS;

GAIT ANALYSIS;

EID: 84885164659     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2199310     Document Type: Article

References (53)

1. Z. Liu, L. Malave, and S. Sarkar, "Studies on silhouette quality and gait recognition," in Proc. IEEE Comput. Vis. Pattern Recog., 2004, pp. II-704-II-711.
2. Z. Liu and S. Sarkar, "Simplest representation yet for gait recognition: Averaged silhouette," in Proc. IEEE/IAPR Int. Conf. Pattern Recog., 2004, pp. 211-214.
3. S. Yu, T. Tan, K. Huang, K. Jia, and X. Wu, "A study on gait-based gender classification," IEEE Trans. Image Process., vol. 18, no. 8, pp. 1905-1910, Aug. 2009.
4. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance," in Proc. Eur. Conf. Comput. Vis., May 2006, vol. 3952, pp. 428-441.
5. X. Wang, T. X. Han, and S. Yan, "An HOG-LBP human detector with partial occlusion handling," in Proc. IEEE Int. Conf. Comput. Vis., Sep. 2009, pp. 32-39.
6. M. Enzweiler, A. Eigenstetter, B. Schiele, and D. M. Gavrila, "Multi-cue pedestrian classification with partial occlusion handling," in Proc. IEEE Comput. Vis. Pattern Recog., Jun. 2010, vol. 1, pp. 990-997.
7. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 2, pp. 726-733.
8. R. Chaudhry, A. Ravichandran, G. Hager, and R. Vidal, "Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions," in Proc. IEEE Comput. Vis. Pattern Recog., Jun. 2009, vol. 1, pp. 1932-1939.
9. N. Papenberg, A. Bruhn, T. Brox, S. Didas, and J. Weickert, "Highly accurate optic flow computation with theoretically justified warping," Int. J. Comput. Vis., vol. 67, no. 2, pp. 141-158, Apr. 2006.
10. K. R. T. Aires, A. M. Santana, and A. A. D. Medeiros, "Optical flow using color information: Preliminary results," in Proc. ACM Symp., 2008, pp. 1607-1611.
11. T. Brox and J. Malik, "Large displacement optical flow: Descriptor matching in variational motion estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 500-513, Mar. 2011.
12. J. Little and J. Boyd, "Recognizing people by their gait: The shape of motion," Videre: J. Comput. Vis. Res., vol. 1, no. 2, pp. 1-45, 1998.
13. P. Huang, C. Harris, and M. Nixon., "Human gait recognition in canonical space using temporal templates," in Proc. Vis., Image, Signal Process., Aug. 1999, vol. 146, no. 2, pp. 93-100.
14. K. Bashir, T. Xiang, and S. Gong, "Gait representation using flow fields," in Proc. Brit. Mach. Vis. Conf., 2009, pp. 1-11.
15. S. Yu, D. Tan, and T. Tan, "A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition," in Proc. IEEE/IAPR Int. Conf. Pattern Recog., 2006, vol. 4, pp. 441-444.
16. D. A. Ross, J. Lim, and R.-S. Lin, "Incremental learning for robust visual tracking," Int. J. Comput. Vis., vol. 77, no. 1-3, pp. 125-141, Nov. 2008.
17. Z. Liu and S. Sarkar, "Improved gait recognition by gait dynamics normalization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 863-876, Jun. 2006.
18. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter: Particle Filters for Tracking Applications. Norwood, MA: Artech House, 2004.
19. L. Wang, T. Tan, H. Ning, and W. Hu, "Silhouette analysis-based gait recognition for human identification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1505-1518, Dec. 2003.
20. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. Eur. Conf. Comput. Vis., May 2004, vol. 4, pp. 25-36.
21. T. Brox, "From pixels to regions: Partial differential equations in image analysis," Ph.D. dissertation, Saarland Univ., Saarbrücken, Germany, 2005.
22. T. Brox, C. Bregler, and J. Malik, "Large displacement optical flow," in Proc. IEEE Comput. Vis. Pattern Recog., Jun. 2009, vol. 1, pp. 41-48.
23. T. Ojala, M. Pietikinen, and D. Harwood, "A comparative study of texture measures with classification based on feature distributions," Pattern Recog., vol. 29, no. 1, pp. 51-59, Jan. 1996.
24. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
25. M. P. Murray, A. B. Drought, and R. C. Kory, "Walking patterns of normal men," J. Bone Join Surg., vol. 46, no. 2, pp. 335-360, Mar. 1964.
26. M. P. Murray, "Gait as a total pattern of movement," Amer. J. Phys. Med., vol. 46, no. 1, pp. 290-333, Feb. 1967.
27. M. Hildebrand, "Vertebrate locomotion an introduction how does an animal's body move itself along?" Bioscience, vol. 39, no. 39, pp. 764-765, 1989.
28. G. Florez-Larrahondo, S. Bridges, and E. A. Hansen, "Incremental estimation of discrete hidden Markov models based on a new backward procedure," in Proc. Nat. Conf. Artif. Intell., 2005, vol. 1, pp. 758-763.
29. V. Krishnamurthy and J. B. Moore, "On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure," IEEE Trans. Signal Process., vol. 41, no. 8, pp. 2557-2573, Aug. 1993.
30. B. Stenger, V. Ramesh, N. Paragios, F. Coetzee, and J. Buhmann, "Topology free hidden Markov models: Application to background modeling," in Proc. IEEE Int. Conf. Comput. Vis., 2001, vol. 1, pp. 294-301.
31. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 1169-1179, Jul. 1989.
32. J. Moore, "Discrete-time fixed-lag smoothing algorithms," Automatica, vol. 9, no. 2, pp. 163-173, Mar. 1973.
33. S. Calinon and A. Billard, "Incremental learning of gestures by imitation in a humanoid robot," in Proc. ACM/IEEE Int. Conf. Human-Robot Interaction, Mar. 2007, pp. 255-262.
34. S. Calinon, Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press. 2009 ePFL Press ISBN 978-2-940222-31-5, CRC Press ISBN 978-1-4398-0867-2.
35. W. Kei and M. Takao, "Data stream prediction using incremental hidden Markov models," in Data Warehousing and Knowledge Discovery, vol. 5691. Berlin, Germany: Springer-Verlag, 2009, ser. Lecture Notes in Computer Science, pp. 63-74.
36. O. Arandjelovic and R. Cipolla, "Incremental learning of temporally-coherent Gaussian mixture models," Soc. Manuf. Eng., Dearborn, MI, 2006, Technical Papers.
37. Z. Liu and S. Sarkar, "Effect of silhouette quality on hard problems in gait recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 2, pp. 170-183, Apr. 2005.
38. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Vis. Pattern Recog., 2005, vol. 1, pp. 886-893.
39. L. Lee, G. Dalley, and K. Tieu, "Learning pedestrian models for silhouette refinement," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 1, pp. 663-670.
40. S. H. Guang, "Gaussian mixture regression and classification," Ph.D. dissertation, Rice Univ., Houston, TX, 2004.
41. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. Duluth, MN: Academic, 1979.
42. J. A. Bilmes, "A gentle tutorial on the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Univ. Berkeley, Berkeley, CA, Tech. Rep. ICSI-TR-97-021, 1997.
43. M. H. Cheng, M. F. Ho, and C.-L. Huang, "Gait analysis for human identification through manifold learning and HMM," Pattern Recog., vol. 41, no. 8, pp. 2541-2553, Aug. 2008.
44. O. Ghitza, "Auditory nerve representation as a front-end for speech recognition in a noisy environment," Comput. Speech Lang., vol. 1, no. 2, pp. 109-130, Dec. 1986.
45. A. Kale, N. Cuntoor, B. Yegnanarayana, A. Rajagopalan, and R. Chellappa, "Gait analysis for human identification," in Proc. Int. Conf. Audio- Video-based Biometric Person Authentication, 2003, pp. 706-714.
46. M. E. Munich and P. Perona, "Continuous dynamic time warping for translation-invariant curve alignment with applications to signature verification," in Proc. IEEE Int. Conf. Comput. Vis., 1999, vol. 1, pp. 108-115.
47. C. Ann and R. E. Keogh, "Three myths about dynamic time warping data mining," in Proc. SIAM Int. Conf. Data Mining, 2005, vol. 21, pp. 506-510.
48. A. Veeraraghavan, A. K. Roy-Chowdhury, and R. Chellappa, "Matching shape sequences in video with applications in human movement analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 12, pp. 1896-1909, Dec. 2005.
49. S. Sarkar, P. J. Phillips, Z. Liu, I. R. Vega, P. Grother, and K. W. Bowyer, "The human ID gait challenge problem: Data sets, performance, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 162-177, Feb. 2005.
50. H. Lee, S. Hong, I. F. Nizami, and E. Kim, "A noise robust gait representation: Motion energy image," Int. J. Control, Autom., Syst., vol. 7, no. 4, pp. 638-643, Aug. 2009.
51. S. Hong, H. Lee, K.-A. Toh, and E. Kim, "Gait recognition using multi-bipolarized contour vector," Int. J. Control, Autom., Syst., vol. 7, no. 5, pp. 799-808, Oct. 2009.
52. B. Lee, S. Hong, H. Lee, and E. Kim, "Multiple views gait recognition using view transformation model based on optimized gait energy image," in Proc. Int. Conf. Ind. Electron. Appl., Jun. 2010, pp. 313-316.
53. B. Lee, S. Hong, H. Lee, and E. Kim, "Regularized eigenspace-based gait recognition system for human identification," in Proc. Int. Conf. Ind. Electron. Appl., Jun. 2011, pp. 1966-1970.