Temporal Action Localization with Pyramid of Score Distribution Features

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3093-3102

  Yuan, Jun ^a   Ni, Bingbing ^b   Yang, Xiaokang ^b   Kassim, Ashraf A ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; RECURRENT NEURAL NETWORKS;

DETECTION APPROACH; DETECTION WINDOWS; DISTRIBUTION FEATURES; MOTION INFORMATION; MULTIPLE RESOLUTIONS; PERFORMANCE GAIN; PERFORMANCE IMPROVEMENTS; STATE OF THE ART;

FEATURE EXTRACTION;

EID: 84986267340     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.337     Document Type: Conference Paper

References (42)

1. Lstm networks for sentiment analysis. http://deeplearning.net/tutorial/lstm.html.
2. M. A. R. Ahad, J. Tan, H. Kim, and S. Ishikawa. Action dataseta survey. In SICE Annual Conference (SICE), 2011 Proceedings of, pages 1650-1655. IEEE, 2011.
3. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. J. Goodfellow, A. Bergeron, N. Bouchard, and Y. Bengio. Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012Workshop, 2012.
4. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy), June 2010. Oral Presentation.
5. W. Byeon, T. M. Breuel, F. Raue, and M. Liwicki. Scene labeling with lstm recurrent neural networks. June 2015.
6. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, and T. Darrell. Long-term recurrent convolutional networks for visual recognition and description. 2014.
7. J. L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990.
8. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9:1871-1874, 2008.
9. A. Gorban, H. Idrees, Y.-G. Jiang, A. Roshan Zamir, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http://www.thumos.info/, 2015.
10. A. Gorban, H. Idrees, Y.-G. Jiang, A. Roshan Zamir, I. Laptev, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. http://www.thumos.info/, 2015.
11. M. Hoai and A. Zisserman. Improving human action recognition using score distribution and ranking. In Computer Vision-ACCV 2014-12th Asian Conference on Computer Vision, Singapore, Singapore, November 1-5, 2014, Revised Selected Papers, Part V, pages 3-20, 2014.
12. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735-1780, Nov. 1997.
13. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR '14, pages 1725-1732, Washington, DC, USA, 2014. IEEE Computer Society.
14. A. Klaser, M. Marsza?ek, and C. Schmid. A spatio-temporal descriptor based on 3d-gradients. In BMVC 2008-19th British Machine Vision Conference, pages 275-1. British Machine Vision Association, 2008.
15. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In F. Pereira, C. Burges, L. Bottou, and K. Weinberger, editors, Advances in Neural Information Processing Systems 25, pages 1097-1105. Curran Associates, Inc., 2012.
16. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre. HMDB: a large video database for human motion recognition. In Proceedings of the International Conference on Computer Vision (ICCV), 2011.
17. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005.
18. I. Laptev and P. Perez. Retrieving actions in movies. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8, Oct 2007.
19. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. In Proceedings of the IEEE, pages 2278-2324, 1998.
20. M. Marsza?ek, I. Laptev, and C. Schmid. Actions in context. In IEEE Conference on Computer Vision & Pattern Recognition, 2009.
21. A. Patron, M. Marszalek, A. Zisserman, and I. Reid. High five: Recognising human interactions in tv shows. In Proceedings of the British Machine Vision Conference, pages 50.1-50.11. BMVA Press, 2010. doi:10.5244/C.24.50.
22. F. Perronnin and C. Dance. Fisher kernels on visual vocabularies for image categorization. In Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on, pages 1-8. IEEE, 2007.
23. F. Perronnin, J. Sánchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In Proceedings of the 11th European Conference on Computer Vision: Part IV, ECCV'10, pages 143-156, Berlin, Heidelberg, 2010. Springer-Verlag.
24. P. Pinheiro and R. Collobert. Recurrent convolutional neural networks for scene labeling. In T. Jebara and E. P. Xing, editors, Proceedings of the 31st International Conference on Machine Learning (ICML-14), pages 82-90. JMLR Workshop and Conference Proceedings, 2014.
25. M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele. A database for fine grained activity detection of cooking activities. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1194-1201, June 2012.
26. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: A local svm approach. In Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3-Volume 03, ICPR '04, pages 32-36, Washington, DC, USA, 2004. IEEE Computer Society.
27. P. Scovanner, S. Ali, and M. Shah. A 3-dimensional sift descriptor and its application to action recognition. In Proceedings of the 15th international conference on Multimedia, pages 357-360. ACM, 2007.
28. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems, 2014.
29. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014.
30. K. Soomro, A. Roshan Zamir, and M. Shah. UCF101: A dataset of 101 human actions classes from videos in the wild. In CRCV-TR-12-01, 2012.
31. A. Stoian, F. M., B.-P. J., and M. Crucianu. Action recognition and detection by combining motion and appearance fea-tures. http://mexculture.cnam.fr/xwiki/bin/view/Datasets/Mex+action+dataset, 2014.
32. A. Vedaldi and B. Fulkerson. VLFeat: An open and portable library of computer vision algorithms. http://www.vlfeat.org/, 2008.
33. V. Veeriah, N. Zhuang, and G.-J. Qi. Differential recurrent neural networks for action recognition. arXiv preprint arXiv:1504.06678, 2015.
34. H. Wang, A. Kläser, C. Schmid, and L. Cheng-Lin. Action Recognition by Dense Trajectories. In CVPR 2011-IEEE Conference on Computer Vision & Pattern Recognition, pages 3169-3176, Colorado Springs, United States, June 2011. IEEE.
35. H. Wang and C. Schmid. Action recognition with improved trajectories. In IEEE International Conference on Computer Vision, Sydney, Australia, 2013.
36. L. Wang, Y. Qiao, and X. Tang. Action recognition and detection by combining motion and appearance features. http://crcv.ucf.edu/THUMOS14/papers/CUHK&SIAT.pdf, 2014.
37. G. Willems, T. Tuytelaars, and L. Van Gool. An efficient dense and scale-invariant spatio-temporal interest point detector. In Computer Vision-ECCV 2008, pages 650-663. Springer, 2008.
38. Z. Wu, X. Wang, Y.-G. Jiang, H. Ye, and X. Xue. Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. arXiv preprint arXiv:1504.01561, 2015.
39. Z. Xu, Y. Yang, and A. G. Hauptmann. A discriminative cnn video representation for event detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1798-1807, 2015.
40. L. Yeffet and L. Wolf. Local trinary patterns for human action recognition. In Computer Vision, 2009 IEEE 12th International Conference on, pages 492-497. IEEE, 2009.
41. J. Yuan, Z. Liu, and Y. Wu. Discriminative video pattern search for efficient action detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(9):1728-1743, Sept 2011.
42. M. D. Zeiler. ADADELTA: an adaptive learning rate method. CoRR, abs/1212.5701, 2012.