The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits

Journal of Visual Communication and Image Representation

Volumn 25, Issue 1, 2014, Pages 195-206

  Hofmann, Martin ^a   Geiger, Jürgen ^a   Bachmann, Sebastian ^a   Schuller, Björn ^a   Rigoll, Gerhard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Acoustic gait recognition; Depth gradient histogram energy image; Gait energy image; Gait recognition; Multimodal fusion; Soft biometrics

Indexed keywords

DEPTH GRADIENT; GAIT ENERGY IMAGES; GAIT RECOGNITION; MULTI-MODAL FUSION; SOFT BIOMETRICS;

BIOMETRICS; DATABASE SYSTEMS; FACE RECOGNITION; UTILITY TRUCKS; VIDEO STREAMING;

GAIT ANALYSIS;

EID: 84891628140     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2013.02.006     Document Type: Article

References (49)

1. J. Han, and B. Bhanu Individual recognition using gait energy image IEEE Transactions on Pattern Analysis and Machine Intelligence 28 2 2006 316 322 (Pubitemid 46395297)
2. Y. Huang, D. Xu, and T.-J. Cham Face and human gait recognition using image-to-class distance IEEE Transactions on Circuits and Systems for Video Technology 20 3 2010 431 438
3. A. Kale, A. Sundaresan, A. Rajagopalan, N. Cuntoor, A. RoyChowdhury, and V. Krueger Identification of humans using gait IEEE Transactions on Image Processing 13 9 2004 1163 1173
4. Z. Liu, and S. Sarkar Improved gait recognition by gait dynamics normalization IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 2006 863 876
5. S. Sarkar, P.J. Phillips, Z. Liu, I.R. Vega, P. Grother, and K.W. Bowyer The humanID gait challenge problem: data sets, performance, and analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2 2005 162 177 (Pubitemid 40377311)
6. M. Hofmann, G. Rigoll, Improved gait recognition using gradient histogram energy image, in: IEEE International Conference on Image Processing, Orlando, FL, USA, 2012, pp. 1389-1392.
7. M. Hofmann, S. Schmidt, A. Rajagopalan, G. Rigoll, Combined face and gait recognition using alpha matte preprocessing, in: IAPR/IEEE International Conference on Biometrics, New Delhi, India, 2012, pp. 1-6.
8. R.D. Seely, S. Samangooei, L. Middleton, J.N. Carter, M.S. Nixon, The University of Southampton multi-biometric tunnel and introducing a novel 3D gait dataset, in: Proceedings of IEEE International Conference on Biometrics: Theory, Applications and Systems, Washington DC, USA, 2008, pp. 1-6.
9. S. Sivapalan, D. Chen, S. Denman, S. Sridharan, C. Fookes, Gait energy volumes and frontal gait recognition using depth images, in: Proceedings of International Joint Conference on Biometrics, Washington DC, USA, 2011, pp. 1-6.
10. M. Hofmann, S. Bachmann, G. Rigoll, 2.5d gait biometrics using the depth gradient histogram energy image, in: Proceedings of IEEE International Conference on Biometrics: Theory, Applications and Systems, Washington DC, USA, 2012.
11. Y. Shoji, T. Takasuka, H. Yasukawa, Personal identification using footstep detection, in: Proceedings of IEEE International Symposium on Intelligent Signal Processing and Communication Systems, Seoul, South Korea, 2004, pp. 43-47. (Pubitemid 40915306)
12. K. Mäkelä, J. Hakulinen, M. Turunen, The use of walking sounds in supporting awareness, in: Proceedings of International Conference on Auditory Display, Boston, MA, USA, 2003, pp. 144-147.
13. C. BenAbdelkader, R. Cutler, L. Davis, Stride and cadence as a biometric in automatic person identification and verification, in: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, Washington, DC, USA, 2002, pp. 372-377.
14. C. Yam, M. Nixon, and J. Carter Automated person recognition by walking and running via model-based approaches Pattern Recognition 37 5 2004 1057 1072 (Pubitemid 38485224)
15. D. Tao, X. Li, X. Wu, and S. Maybank General tensor discriminant analysis and gabor features for gait recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 29 10 2007 1700 1715
16. A. Sundaresan, A. Chowdhury, R. Chellappa, A hidden markov model based framework for recognition of humans from gait sequences, in: Proceedings of IEEE International Conference on Image Processing, 2003, pp. 90-93.
17. A. Kale, A. Roy-Chowdhury, and R. Chellappa Fusion of gait and face for human identification Proceedings of Acoustics, Speech, and Signal Processing 5 2004 2004 901 904
18. X. Zhou, and B. Bhanu Feature fusion of side face and gait for video-based human identification Pattern Recognition 41 3 2008 778 795 (Pubitemid 47632662)
19. T. Zhang, X. Li, D. Tao, and J. Yang Multimodal biometrics using geometry preserving projections Pattern Recognition 41 3 2008 805 813 (Pubitemid 47632663)
20. T.K.M. Lee, S. Ranganath, S. Sanei, Fusion of chaotic measure into a new hybrid face-gait system for human recognition, in: Proceedings of the 18th International Conference on Pattern Recognition Vol. 04, ICPR '06, IEEE Computer Society, Washington, DC, USA, 2006, pp. 541-544. (Pubitemid 46553478)
21. G. Shakhnarovich, L. Lee, T. Darrell, Integrated face and gait recognition from multiple views, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, 2001, pp. 439-446.
22. X. Zhou, B. Bhanu, Feature fusion of face and gait for human recognition at a distance in video, in: Proceedings of the 18th International Conference on Pattern Recognition, vol. 4, Hong Kong, China, 2006, pp. 529-532. (Pubitemid 46553475)
23. B. She, Framework of footstep detection in in-door environment, in: Proceedings of International Congress on Acoustics, 2004, pp. 715-718.
24. A. Itai, H. Yasukawa, Footstep recognition with psyco-acoustics parameter, in: Proceedings of IEEE Asia Pacific Conference on Circuits and Systems, Singapore, 2006, pp. 992-995.
25. A. Itai, H. Yasukawa, Footstep classification using simple speech recognition technique, in: Proceedings of IEEE International Symposium on Circuits and Systems, Seattle, WA, USA, 2008, pp. 3234-3237.
26. R. de Carvalho, P. Rosa, Identification system for smart homes using footstep sounds, in: Proceedings of IEEE International Symposium on Industrial Electronics, Bari, Italy, 2010, pp. 1639-1644.
27. K. Kalgaonkar, B. Raj, Acoustic doppler sonar for gait recogination, in: Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance, London, UK, 2007, pp. 27-32.
28. J. Yun, S. Lee, W. Woo, J. Ryu, The user identification system using walking pattern over the ubifloor, in: Proceedings of International Conference on Control, Automation, and Systems, Gyeongju, Korea, 2003, pp. 1046-1050.
29. J. Little, and J. Boyd Recognizing people by their gait: the shape of motion Videre: Journal of Computer Vision Research 1 2 1998 1 32
30. R. Gross, J. Shi, The CMU motion of body (mobo) database, Tech. rep., CMU, 2001.
31. A.Y. Johnson, A.F. Bobick, A multi-view method for gait recognition using static body parameters, in: Proceedings of International Conference on Audio- and Video-Based Biometric Person Authentication, Halmstad, Sweden, 2001, pp. 301-311. (Pubitemid 33292021)
32. A. Kale, N. Cuntoor, R. Chellappa, A framework for activity-specific human identification, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Orlando, FL, USA, 2002.
33. N. Cuntoor, A. Kale, R. Chellappa, Combining multiple evidences for gait recognition, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Hong Kong, China, 2003, pp. 6-10.
34. R.T. Collins, R. Gross, J. Shi, Silhouette-based human identification from body shape and gait, in: Proceedings of IEEE Conference on Face and Gesture Recognition, Washington, DC, USA, 2002, pp. 351-356.
35. J.S.M. Nixon, J. Carter, M. Grant, Experimental plan for automatic gait recognition, Tech. rep., University of Southampton (2001).
36. S. Yu, D. Tan, T. Tan, A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition, in: Proceedings of IEEE International Conference on Pattern Recognition, vol. 4, Hong Kong, China, 2006, pp. 441-444. (Pubitemid 46553453)
37. Y. Makihara, H. Mannami, A. Tsuji, M. Hossain, K. Sugiura, A. Mori, and Y. Yagi The OU-ISIR gait database comprising the treadmill dataset IPSJ Transactions on Computer Vision and Applications 4 2012 53 62
38. D. Matovski, M. Nixon, S. Mahmoodi, and J. Carter The effect of time on gait recognition performance IEEE Transactions on Information Forensics and Security 7 2 2012 543 552
39. M. Hofmann, S. Sural, G. Rigoll, Gait recognition in the presence of occlusion: A new dataset and baseline algorithms, in: Proceedings of International Conference on Computer Graphics, Visualization and Computer Vision, Plzen, Czech Republic, 2011, pp. 99-104.
40. , accessed 13.07.2012.
41. C. Stauffer, W.E.L. Grimson, Adaptive background mixture models for real-time tracking, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Los Alamitos, CA, USA, 1999, pp. 2246-2252.
42. A. Criminisi, P. Perez, and K. Toyama Region filling and object removal by exemplar-based image inpainting IEEE Transactions on Image Processing 13 9 2004 1200 1212
43. M. Camplani, L. Salgado, Efficient spatio-temporal hole filling strategy for kinect depth maps, in: IS&T/SPIE International Conference on 3D Image Processing (3DIP) and Applications, vol. 8290, Burlingame, CA, USA, 2012, pp. 82900E1-10.
44. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings of International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, 2005, pp. 886-893. (Pubitemid 43897286)
45. F. Eyben, M. Wöllmer, B. Schuller, openSMILE: the munich versatile and fast open-source audio feature extractor, in: Proceedings of ACM Multimedia, Florence, Italy, 2010, pp. 1459-1462.
46. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, M. Pantic, AVEC 2011 - The first international audio/visual emotion challenge, in: Proceedings of International Audio/Visual Emotion Challenge and Workshop, Memphis, TN, USA, 2011, pp. 415-424.
47. T. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844 (Pubitemid 128741345)
48. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. Witten The weka data mining software: an update SIGKDD Explorations 11 1 2009 10 18
49. Y. Makihara, M. Okumura, H. Iwama, Y. Yagi, Gait-based age estimation using a whole-generation gait database, in: Proceedings of the International Joint Conference on Biometrics (IJCB2011), Washington DC, USA, 2011, pp. 1-6.