Recurrent attention models for depth-based person identification

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1229-1238

  Haque, Albert ^a   Alahi, Alexandre ^a   Li, Fei Fei ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; PATTERN RECOGNITION; REINFORCEMENT LEARNING; THREE DIMENSIONAL COMPUTER GRAPHICS;

4D VISUALIZATION; ATTENTION MODEL; IDENTIFICATION PROBLEM; MOTION DYNAMICS; PERSON IDENTIFICATION; SPATIO TEMPORAL; STATE OF THE ART; VOLUMETRIC CHANGES;

RECURRENT NEURAL NETWORKS;

EID: 84986309164     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.138     Document Type: Conference Paper

References (81)

1. E. Ahmed, M. Jones, and T. K. Marks. An improved deep learning architecture for person re-identification. In CVPR, 2015.
2. A. Alahi, V. Ramanathan, and L. Fei-Fei. Socially-aware large-scale crowd forecasting. In CVPR, 2014.
3. A. Albiol, J. Oliver, and J. M. Mossi. Who is who at different cameras: people re-identification using depth cameras. Computer Vision, 2012.
4. V. Andersson, R. Dutra, and R. Araújo. Anthropometric and human gait identification using skeleton data from kinect sensor. In Symposium on Applied Computing. ACM, 2014.
5. B. I. Barbosa, M. Cristani, A. Del Bue, L. Bazzani, and V. Murino. Re-identification with rgb-d sensors. In EECV, 2012.
6. K. Bashir, T. Xiang, and S. Gong. Gait recognition without subject cooperation. Pattern Recognition Letters, 2010.
7. H. Bay, T. Tuytelaars, and L. Van Gool. Surf: Speeded up robust features. In ECCV. 2006.
8. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri. Actions as space-time shapes. In ICCV, 2005.
9. Y.-L. Boureau, J. Ponce, and Y. LeCun. A theoretical analysis of feature pooling in visual recognition. In ICML, 2010.
10. R. J. C. Chen and N. Kehtarnavaz. Utd-mhad: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor. In ICIP, 2015.
11. J. Caicedo and S. Lazebnik. Semantic guidance of visual attention for localizing objects in scenes. ICCV, 2015.
12. L. Cao, Z. Liu, and T. S. Huang. Cross-dataset action detection. In CVPR, 2010.
13. W. Chan, N. Jaitly, Q. V. Le, and O. Vinyals. Listen, attend and spell. ArXiv preprint, 2015.
14. X. Chen and C. L. Zitnick. Minds eye: A recurrent visual representation for image caption generation. CVPR, 2015.
15. S. Cho, J. Park, and O. Kwon. Gender differences in three dimensional gait analysis data from 98 healthy korean adults. Clinical biomechanics, 2004.
16. L. Chunli and W. Kejun. A behavior classification based on enhanced gait energy image. In Networking and Digital Society. IEEE, 2010.
17. J. E. Cutting and L. T. Kozlowski. Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the psychonomic society, 1977.
18. M. Denil, L. Bazzani, H. Larochelle, and N. de Freitas. Learning where to attend with deep architectures for image tracking. Neural computation, 2012.
19. S. Ding, L. Lin, G. Wang, and H. Chao. Deep feature learning with relative distance comparison for person reidentification. Pattern Recognition, 2015.
20. A. Dubois and F. Charpillet. A gait analysis method based on a depth camera for fall prevention. In Engineering in Medicine and Biology Society. IEEE, 2014.
21. H. Fang, S. Gupta, F. Iandola, R. Srivastava, L. Deng, P. Dollár, J. Gao, X. He, M. Mitchell, J. Platt, et al. From captions to visual concepts and back. CVPR, 2015.
22. M. Farenzena, L. Bazzani, A. Perina, V. Murino, and M. Cristani. Person re-identification by symmetry-driven accumulation of local features. In CVPR, 2010.
23. A. Graves, S. Fernández, F. Gomez, and J. Schmidhuber. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In ICML, 2006.
24. D. Gray and H. Tao. Viewpoint invariant pedestrian recognition with ensemble localized features. In ECCV. 2008.
25. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Draw: A recurrent neural network for image generation. ICML, 2015.
26. J. Han and B. Bhanu. Individual recognition using gait energy image. PAMI, 2006.
27. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 1997.
28. M. Hofmann, S. Bachmann, and G. Rigoll. 2. 5d gait biometrics using the depth gradient histogram energy image. In Biometrics. IEEE, 2012.
29. X. Huang and N. V. Boulgouris. Gait recognition using linear discriminant analysis with artificial walking conditions. In ICIP, 2010.
30. D. Ioannidis, D. Tzovaras, I. G. Damousis, S. Argyropoulos, and K. Moustakas. Gait recognition using compact feature extraction transforms and depth information. Information Forensics and Security, 2007.
31. C. Ionescu, D. Papava, V. Olaru, and C. Sminchisescu. Human3. 6m: Large scale datasets and predictive methods for 3d human sensing in natural environments. PAMI, 2014.
32. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black. Towards understanding action recognition. In ICCV, 2013.
33. S. Ji, W. Xu, M. Yang, and K. Yu. 3d convolutional neural networks for human action recognition. PAMI, 2013.
34. A. Kale, N. Cuntoor, B. Yegnanarayana, A. Rajagopalan, and R. Chellappa. Gait analysis for human identification. In Audio-and Video-Based Biometric Person Authentication. Springer, 2003.
35. A. Karpathy, J. Johnson, and L. Fei-Fei. Visualizing and understanding recurrent networks. ArXiv preprint, 2015.
36. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
37. I. Kviatkovsky, A. Adam, and E. Rivlin. Color invariants for person reidentification. PAMI, 2013.
38. I. Laptev. On space-time interest points. IJCV, 2005.
39. I. Laptev, B. Caputo, C. Schüldt, and T. Lindeberg. Local velocity-adapted motion events for spatio-temporal recognition. Computer Vision and Image Understanding, 2007.
40. W. Li and X. Wang. Locally aligned feature transforms across views. In CVPR, 2013.
41. W. Li, R. Zhao, T. Xiao, and X. Wang. Deepreid: Deep filter pairing neural network for person re-identification. In CVPR, 2014.
42. D. Lowe. Object recognition from local scale-invariant features. In ICCV, 1999.
43. M. T. Luong, H. Pham, and C. D. Manning. Effective approaches to attention-based neural machine translation. EMNLP, 2015.
44. A. Mansur, Y. Makihara, R. Aqmar, and Y. Yagi. Gait recognition under speed transition. In CVPR, 2014.
45. J. Masci, U. Meier, D. Cireşan, and J. Schmidhuber. Stacked convolutional auto-encoders for hierarchical feature extraction. In ICANN. Springer, 2011.
46. G. Mather and L. Murdoch. Gender discrimination in biological motion displays based on dynamic cues. Biological Sciences, 1994.
47. D. Maturana and S. Scherer. 3d convolutional neural networks for landing zone detection from lidar. In ICRA, 2015.
48. D. Maturana and S. Scherer. Voxnet: A 3d convolutional neural network for real-time object recognition. In IROS, 2015.
49. A. Mignon and F. Jurie. Pcca: A new approach for distance learning from sparse pairwise constraints. In CVPR, 2012.
50. V. Mnih, N. Heess, A. Graves, et al. Recurrent models of visual attention. In NIPS, 2014.
51. A. Mogelmose, T. B. Moeslund, and K. Nasrollahi. Multimodal person re-identification using rgb-d sensors and a transient identification database. In Biometrics and Forensics. IEEE, 2013.
52. M. Munaro, A. Basso, A. Fossati, L. Van Gool, and E. Menegatti. 3d reconstruction of freely moving persons for re-identification with a depth sensor. In ICRA, 2014.
53. M. Munaro, A. Fossati, A. Basso, E. Menegatti, and L. Van Gool. One-shot person re-identification with a consumer depth camera. In Person Re-Identification. Springer, 2014.
54. M. Munaro, S. Ghidoni, D. T. Dizmen, and E. Menegatti. A feature-based approach to people re-identification using skeleton keypoints. In ICRA, 2014.
55. B. C. Munsell, A. Temlyakov, C. Qu, and S. Wang. Person identification using full-body motion and anthropometric biometrics from kinect videos. In ECCV, 2012.
56. M. P. Murray. Gait as a total pattern of movement: indcluding a bibliography on gait. American Journal of Physical Medicine & Rehabilitation, 1967.
57. M. P. Murray, A. B. Drought, and R. C. Kory. Walking patterns of normal men. Journal of Bone & Joint Surgery, 1964.
58. O. Oreifej and Z. Liu. Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences. In CVPR, 2013.
59. F. Pala, R. Satta, G. Fumera, and F. Roli. Multi-modal person re-identification using rgb-d cameras. In Circuits and Systems for Video Technology. IEEE, 2015.
60. B. Prosser, W.-S. Zheng, S. Gong, T. Xiang, and Q. Mary. Person re-identification by support vector ranking. In BMVC, 2010.
61. P. Salvagnini, L. Bazzani, M. Cristani, and V. Murino. Person re-identification with a ptz camera: An introductory study. In ICIP, 2013.
62. H. C. Shin, M. R. Orton, D. J. Collins, S. J. Doran, and M. O. Leach. Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4d patient data. PAMI, 2013.
63. S. Sivapalan, D. Chen, S. Denman, S. Sridharan, and C. Fookes. Gait energy volumes and frontal gait recognition using depth images. In Biometrics. IEEE, 2011.
64. D. Skog. Gait-based reidentification of people in urban surveillance video. 2010.
65. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. JMLR, 2014.
66. A. Veeraraghavan, A. K. Roy-Chowdhury, and R. Chellappa. Matching shape sequences in video with applications in human movement analysis. PAMI, 2005.
67. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu. Robust 3d action recognition with random occupancy patterns. In ECCV. 2012.
68. X. Wang, G. Doretto, T. Sebastian, J. Rittscher, and P. Tu. Shape and appearance context modeling. In ICCV, 2007.
69. R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 1992.
70. T. Xiao, Y. Xu, K. Yang, J. Zhang, Y. Peng, and Z. Zhang. The application of two-level attention models in deep convolutional neural network for fine-grained image classification. CVPR, 2015.
71. K. Xu, J. Ba, R. Kiros, A. Courville, R. Salakhutdinov, R. Zemel, and Y. Bengio. Show, attend, tell: Neural image caption generation with visual attention. JMLR, 2015.
72. L. Yao, A. Torabi, K. Cho, N. Ballas, C. Pal, H. Larochelle, and A. Courville. Describing videos by exploiting temporal structure. In CVPR, 2015.
73. D. Yi, Z. Lei, and S. Z. Li. Deep metric learning for practical person re-identification. ICPR, 2014.
74. J. Yue-Hei Ng, M. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici. Beyond short snippets: Deep networks for video classification. In CVPR, 2015.
75. M. Zanfir, M. Leordeanu, and C. Sminchisescu. The moving pose: An efficient 3d kinematics descriptor for low-latency action recognition and detection. In ICCV, 2013.
76. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV. 2014.
77. G. Zhao, G. Liu, H. Li, and M. Pietikäinen. 3d gait recognition using multiple cameras. In Automatic Face and Gesture Recognition. IEEE, 2006.
78. R. Zhao, W. Ouyang, and X. Wang. Unsupervised salience learning for person re-identification. In CVPR, 2013.
79. R. Zhao, W. Ouyang, and X. Wang. Learning mid-level filters for person re-identification. In CVPR, 2014.
80. W. S. Zheng, X. Li, T. Xiang, S. Liao, J. Lai, and S. Gong. Partial person re-identification. In ICCV, 2015.
81. M. Zontak, I. Mosseri, and M. Irani. Separating signal from noise using patch recurrence across scales. In CVPR, 2013.