3D convolutional neural networks for human action recognition

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 495-502

  Ji, Shuiwang ^a   Xu, Wei ^b   Yang, Ming ^b   Yu, Kai ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b NEC LABORATORIES AMERICA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION RECOGNITION; AUTOMATED RECOGNITION; CNN MODELS; CONVOLUTIONAL NEURAL NETWORK; DEVELOPED MODEL; DOMAIN KNOWLEDGE; FEATURE CONSTRUCTION; FEATURE REPRESENTATION; HUMAN ACTIONS; HUMAN-ACTION RECOGNITION; MOTION INFORMATION; MULTIPLE CHANNELS; REAL WORLD ENVIRONMENTS; TEMPORAL DIMENSIONS;

CONVOLUTION; GESTURE RECOGNITION; LEARNING SYSTEMS; NEURAL NETWORKS;

THREE DIMENSIONAL;

EID: 77956507967     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Ahmed, A., Yu, K., Xu, W., Gong, Y. and Xing, E. Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks. In ECCV, pp. 69-82, 2008.
2. Bengio, Y. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1):1- 127, 2009.
3. Bromley, J., Guyon, I., LeCun, Y., Sackinger, B. and Shah, R. Signature verification using a siamese time delay neural network. In NIPS. 1993.
4. Collobert, R. and Weston, J. A unified architecture for natural language processing: deep neural networks with multitask learning. In ICML, pp. 160- 167, 2008.
5. Dollár, R, Rabaud, V., Cottrell, G. and Belongie, S. Behavior recognition via sparse spatio-temporal features. In ICCV VS-PETS, pp. 65-72, 2005.
6. Efros, A. A., Berg, A. C., Mori, G. and Malik, J. Recognizing action at a distance. In ICCV, pp. 726- 733, 2003.
7. Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cyb., 36: 193-202, 1980.
8. Hinton, G. E. and Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, July 2006.
9. Hinton, G. E., Osindero, S. and Teh, Y. A fast learning algorithm for deep belief nets. Neural Computation, 18:1527-1554, 2006.
10. Jain, V., Murray, J. F., Roth, F., Turaga, S., Zhigulin, V., Briggman, K. L., Helmstaedter, M. N., Denk, W. and Seung, H. S. Supervised learning of image restoration with convolutional networks. In ICCV, 2007.
11. Jhuang, H., Serre, T., Wolf, L. and Poggio, T. A biologically inspired system for action recognition. In ICCV, pp. 1-8, 2007.
12. Kim, H.-J., Lee, J. S. and Yang, H.-S. Human action recognition using a modified convolutional neural network. In Proceedings of the 4th International Symposium on Neural Networks, pp. 715-723, 2007.
13. Laptev, I. and Pérez, P. Retrieving actions in movies. In ICCV, pp. 1-8, 2007.
14. Lazebnik, S., Achmid, C. and Ponce, J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, pp. 2169- 2178, 2006.
15. LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
16. LeCun, Y., Huang, F.-J. and Bottou, L. Learning methods for generic object recognition with invariance to pose and lighting. In CVPR, 2004.
17. Lee, H., Grosse, R., Ranganath, R. and Ng, A. Y. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, pp. 609-616, 2009a.
18. Lee, H., Pham, P., Largman, Y. and Ng, A. Unsupervised feature learning for audio classification using convolutional deep belief networks. In NIPS, pp. 1096-1104. 2009b.
19. Lowe, D. G. Distinctive image features from scale invariant keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
20. Mobahi, H., Collobert, R. and Weston, J. Deep learning from temporal coherence in video. In ICML, pp. 737-744, 2009.
21. Mutch, J. and Lowe, D. G. Object class recognition and localization using sparse features with limited receptive fields. International Journal of Computer Vision, 80(1):45-57, October 2008.
22. Niebles, J. C., Wang, H. and Fei-Fei, L. Unsupervised learning of human action categories using spatial- temporal words. International Journal of Computer Vision, 79(3):299-318, 2008.
23. Ning, F., Delhomme, D., LeCun, Y., Piano, F., Bottou, L. and Barbano, P. Toward automatic phenotyping of developing embryos from videos. IEEE Trans. on Image Processing, 14(9):1360-1371, 2005.
24. Ranzato, M., Huang, F.-J., Boureau, Y. and LeCun, Y. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR, 2007.
25. Schindler, K. and Van Gool, L. Action snippets: How many frames does human action recognition require? In CVPR, 2008.
26. Schiildt, C., Laptev, I. and Caputo, B. Recognizing human actions: A local SVM approach. In ICPR, pp. 32-36, 2004.
27. Serre, T., Wolf, L. and Poggio, T. Object recognition with features inspired by visual cortex. In CVPR, pp. 994-1000, 2005.
28. Yang, M., Lv, F., Xu, W., Yu, K and Gong, Y. Human action detection by boosting efficient motion features. In IEEE Workshop on Video-oriented Object and Event Classification, 2009.
29. Yu, K., Xu, W. and Gong, Y. Deep learning with kernel regularization for visual recognition. In NIPS, pp. 1889-1896, 2008.