Efficient large-scale action recognition in videos using extreme learning machines

Expert Systems with Applications

Volumn 42, Issue 21, 2015, Pages 8274-8282

  Varol, Gül ^a   Salah, Albert Ali ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Action recognition; Extreme learning machine; Fisher vector; Multimedia mining

Indexed keywords

ENCODING (SYMBOLS); KNOWLEDGE ACQUISITION;

ACTION CLASSIFICATIONS; ACTION RECOGNITION; DEEP NEURAL NETWORKS; EXTREME LEARNING MACHINE; FISHER VECTORS; MID-LEVEL FEATURES; MULTIMEDIA MINING; TRAJECTORY FEATURES;

LEARNING SYSTEMS;

EID: 84938409656     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.06.013     Document Type: Article

References (56)

1. Blank, M., Gorelick, L., Shechtman, E., Irani, M., & Basri, R. (2005). Actions as space-time shapes. In IEEE International Conference on Computer Vision (ICCV) (pp. 1395-1402).
2. A.A. Chaaraoui, P. Climent-Pérez, and F. Flórez-Revuelta A review on vision techniques applied to human behaviour analysis for ambient-assisted living Expert Systems with Applications 39 2012 10873 10888
3. C.-C. Chang, and C.-J. Lin LIBSVM: A library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 27 2011 1 27:27
4. Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2. (pp. 886-893).
5. N. Dalal, B. Triggs, and C. Schmid Human detection using oriented histograms of flow and appearance European Conference on Computer Vision (ECCV) Vol. 3952 2006 Springer Berlin Heidelberg 428 441
6. Deng, J., Dong, W., Socher, R., Li, L.- J., Li, K., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
7. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., et al. (2014). DeCAF: A deep convolutional activation feature for generic visual recognition. In International Conference on Machine Learning (ICML).
8. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin LIBLINEAR: A library for large linear classification Journal of Machine Learning Research 9 2008 1871 1874
9. G. Farnebäck Two-frame motion estimation based on polynomial expansion Image analysis Vol. 2749 2003 Springer Berlin Heidelberg 363 370
10. I. Gómez-Conde, and D.N. Olivieri A KPCA spatio-temporal differential geometric trajectory cloud classifier for recognizing human actions in a CBVR system Expert Systems with Applications 42 2015 5472 5490
11. Caba Heilbron, F., Escorcia, V., Ghanem, B., & Carlos Niebles, J. (2015). Activitynet: A large-scale video benchmark for human activity understanding. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
12. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang Extreme learning machine for regression and multiclass classification IEEE Transactions on Systems, Man, and Cybernetics, Part B 42 2012 513 529
13. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew Extreme learning machine: Theory and applications Neurocomputing 70 2006 489 501
14. A. Iosifidis, A. Tefas, and I. Pitas Regularized extreme learning machine for multi-view semi-supervised action recognition Neurocomputing 145 2014 250 262
15. T. Jaakkola, and D. Haussler Exploiting generative models in discriminative classifiers Advances in neural information processing systems (NIPS) 1998 MIT Press 487 493
16. Jain, M., van Gemert, J., & Snoek, C. G. M. (2014). University of Amsterdam at Thumos challenge 2014. In ECCV workshop on action recognition with a large number of classes.
17. Jain, M., van Gemert, J. C., & Snoek, C. G. M. (2015). What do 15,000 object categories tell us about classifying and localizing actions? In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
18. Jiang, Y.- G., Dai, Q., Xue, X., Liu, W., & Ngo, C.- W. (2012). Trajectory-based modeling of human actions with motion reference points. In European Conference on Computer Vision (ECCV), Vol. 7576 (pp. 425-438).
19. Jiang, Y.-G., Liu, J., Roshan Zamir, A., Toderici, G., Laptev, I., Shah, M., et al. (2014). THUMOS challenge: Action recognition with a large number of classes. .
20. Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014). Large-scale video classification with convolutional neural networks. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
21. Khosla, A., Hamid, R., Lin, C.- J., & Sundaresan, N. (2013). Large-scale video summarization using web-image priors. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
22. Kläser, A., Marszałek, M., & Schmid, C. (2008). A spatio-temporal descriptor based on 3D-gradients. In British Machine Vision Conference (BMVC) (pp. 995-1004).
23. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (NIPS).
24. Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011). HMDB: A large video database for human motion recognition. In IEEE International Conference on Computer Vision (ICCV).
25. I. Laptev On space-time interest points International Journal of Computer Vision 64 2005 107 123
26. Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008). Learning realistic human actions from movies. In IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
27. Liu, J., Kuipers, B., & Savarese, S. (2011). Recognizing human actions by attributes. In IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3337-3344).
28. Shugao Ma, N. I.- C., Zhang, J. & Sclaroff, S. (2013). Action recognition and localization by hierarchical space-time segments. In IEEE International Conference on Computer Vision (ICCV).
29. Marszalek, M., Laptev, I., & Schmid, C. (2009). Actions in context. In IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2929-2936).
30. R. Minhas, A. Baradarani, S. Seifzadeh, and Q.J. Wu Human action recognition using extreme learning machine based on visual vocabularies Neurocomputing 73 2010 1906 1917
31. Oneata, D., Verbeek, J., & Schmid, C. (2013). Action and event recognition with Fisher vectors on a compact feature set. In IEEE International Conference on Computer Vision (ICCV) (pp. 1817-1824).
32. Oneata, D., Verbeek, J., & Schmid, C. (2014). The LEAR submission at Thumos 2014. In ECCV workshop on action recognition with a large number of classes.
33. X. Peng, C. Zou, Y. Qiao, and Q. Peng Action recognition with stacked Fisher vectors European Conference on Computer Vision (ECCV) Vol. 8693 2014 Springer International Publishing 581 595
34. Perronnin, F., & Dance, C. (2007). Fisher kernels on visual vocabularies for image categorization. In IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
35. Perronnin, F., Sanchez, J., & Mensink, T. (2010). Improving the Fisher kernel for large-scale image classification. In European Conference on Computer Vision (ECCV).
36. Rodriguez, M., Ahmed, J., & Shah, M. (2008). Action MACH a spatio-temporal maximum average correlation height filter for action recognition. In IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
37. Sadanand, S., & Corso, J. J. (2012). Action bank: A high-level representation of activity in video. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
38. Schmidt, W. F., Kraaijveld, M. A., & Duin, R. P. (1992). Feedforward neural networks with random weights. In Pattern recognition. Vol. II. Conference B: Pattern recognition methodology and systems (pp. 1-4).
39. Schuldt, C., Laptev, I., & Caputo, B. (2004). Recognizing human actions: A local SVM approach. In International Conference on Pattern Recognition (ICPR), Vol. 3 (pp. 32-36).
40. Scovanner, P., Ali, S., & Shah, M. (2007). A 3-dimensional SIFT descriptor and its application to action recognition. In ACM international conference on multimedia (pp. 357-360).
41. Simonyan, K., & Zisserman, A. (2014). Two-stream convolutional networks for action recognition in videos. In Advances in neural information processing systems (NIPS) (pp. 568-576).
42. Soomro, K., Roshan Zamir, A., & Shah, M. (2012). UCF101: A dataset of 101 human actions classes from videos in the wild. In CRCV-TR-12-01.
43. Tamrakar, A., Ali, S., Yu, Q., Liu, J., Javed, O., Divakaran, A., et al. (2012). Evaluation of low-level features and their combinations for complex event detection in open source videos. In IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3681-3688).
44. K. van de Sande, T. Gevers, and C. Snoek Accelerating visual categorization with the GPU K. Kutulakos, Trends and topics in computer vision Vol. 6554 2012 Springer Berlin Heidelberg 436 449
45. Varol, G., & Salah, A. A. (2014). Extreme learning machine for large-scale action recognition. In ECCV workshop on action recognition with a large number of classes.
46. Viola, P., & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR), Vol. 1 (pp. I-511-I-518).
47. Wang, H., & Schmid, C. (2013a). Action recognition with improved trajectories. In IEEE International Conference on Computer Vision (ICCV).
48. Wang, H., & Schmid, C. (2013b). LEAR-INRIA submission for the Thumos workshop. In ICCV workshop on action recognition with a large number of classes.
49. Wang, H., Ullah, M. M., Klser, A., Laptev, I., & Schmid, C. (2009). Evaluation of local spatio-temporal features for action recognition. In British Machine Vision Conference (BMVC).
50. Wang, L., Qiao, Y., & Tang, X. (2013). Motionlets: Mid-level 3D parts for human motion recognition. In IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2674-2681).
51. Wang, L., Qiao, Y., & Tang, X. (2015). Action recognition with trajectory-pooled deep-convolutional descriptors. In IEEE conference on Computer Vision and Pattern Recognition (CVPR).
52. H. Wang, A. Klser, C. Schmid, and C.-L. Liu Dense trajectories and motion boundary descriptors for action recognition International Journal of Computer Vision 103 2013 60 79
53. Xu, Z., Yang, Y., & Hauptmann, A. G. (2015). A discriminative CNN video representation for event detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
54. Yang, X., & Tian, Y. (2014). Action recognition using super sparse coding vector with spatio-temporal awareness. In European Conference on Computer Vision (ECCV), Vol. 8690 (pp. 727-741).
55. S.M. Yoon, and A. Kuijper Human action recognition based on skeleton splitting Expert Systems with Applications 40 2013 6848 6855
56. Zhu, J., Wang, B., Yang, X., Zhang, W., & Tu, Z. (2013). Action recognition with actons. In IEEE International Conference on Computer Vision (ICCV).